python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1853037 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2647412'] with mtr_portfolio_ids : ['21136630'] and first list_photo_ids : [] new path : /proc/1853037/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 4.47087836265564 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Mar 7 09:20:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9924 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-07 09:20:38.662334: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-07 09:20:38.691244: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-07 09:20:38.693533: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa9ec000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-07 09:20:38.693614: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-07 09:20:38.698371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-07 09:20:38.857237: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xabecf90 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-07 09:20:38.857309: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-07 09:20:38.858812: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 09:20:38.859421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 09:20:38.863223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 09:20:38.866770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 09:20:38.867581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 09:20:38.871266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 09:20:38.872686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 09:20:38.877838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 09:20:38.882033: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 09:20:38.882668: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 09:20:38.883493: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 09:20:38.883512: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 09:20:38.883523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 09:20:38.884962: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8435 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-07 09:20:39.198777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 09:20:39.198882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 09:20:39.198926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 09:20:39.198948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 09:20:39.198967: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 09:20:39.198985: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 09:20:39.199002: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 09:20:39.199019: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 09:20:39.200661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 09:20:39.202657: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 09:20:39.202855: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 09:20:39.202955: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 09:20:39.202998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 09:20:39.203034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 09:20:39.203065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 09:20:39.203106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 09:20:39.203145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 09:20:39.204969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 09:20:39.205050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 09:20:39.205062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 09:20:39.205126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 09:20:39.206537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8435 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-07 09:20:53.507385: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 09:20:53.760087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 09:20:56.451160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.452062: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.452656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.453213: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.453778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.454592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.455321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.455367: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.455979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.455997: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.462596: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.462639: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.463232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.463252: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.469982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.470052: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.470641: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.470665: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.506380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.506438: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.507062: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.507082: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.512720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.512769: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.513354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.513372: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-07 09:20:56.542433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.543066: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.544758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.545335: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.581688: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.582281: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.584241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.584826: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.610277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.610873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.612440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.613021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.618488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.619088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.620785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.621366: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.627076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.627656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.629238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.629814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.656630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.657217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.657790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.658362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.661975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.662559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.678578: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.679360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.680019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.680593: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.693142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.693740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.694319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.694913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.699313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.699905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.704669: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.705263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.717805: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.718407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.722697: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.723329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.723927: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.724502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.725325: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.725926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.736689: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.737286: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.737882: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.738458: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.739043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.739615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.740183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.740753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.750603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.751264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.757809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.758410: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.817293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.818066: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.852563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.853331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.883474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.884196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.885354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.885944: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.890376: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.891188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.891760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.892338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.893321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.893338: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-03-07 09:20:56.906873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.907475: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.921170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.921747: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.922338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.922916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.923497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-07 09:20:56.924065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 54 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 Detection mask done ! Trying to reset tf kernel 1854300 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9179 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10372 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0017328262329101562 nb_pixel_total : 58541 time to create 1 rle with old method : 0.06355857849121094 length of segment : 387 time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 15680 time to create 1 rle with old method : 0.01811075210571289 length of segment : 124 time for calcul the mask position with numpy : 0.003017425537109375 nb_pixel_total : 111848 time to create 1 rle with old method : 0.12276983261108398 length of segment : 499 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 36021 time to create 1 rle with old method : 0.03988504409790039 length of segment : 224 time for calcul the mask position with numpy : 0.003841400146484375 nb_pixel_total : 108610 time to create 1 rle with old method : 0.1226203441619873 length of segment : 889 time for calcul the mask position with numpy : 0.00154876708984375 nb_pixel_total : 71973 time to create 1 rle with old method : 0.08270668983459473 length of segment : 509 time for calcul the mask position with numpy : 0.0005869865417480469 nb_pixel_total : 16052 time to create 1 rle with old method : 0.023291826248168945 length of segment : 245 time for calcul the mask position with numpy : 0.0017905235290527344 nb_pixel_total : 110170 time to create 1 rle with old method : 0.12782931327819824 length of segment : 237 time for calcul the mask position with numpy : 0.005012989044189453 nb_pixel_total : 181988 time to create 1 rle with new method : 0.012600898742675781 length of segment : 486 time for calcul the mask position with numpy : 0.0015959739685058594 nb_pixel_total : 22335 time to create 1 rle with old method : 0.02567601203918457 length of segment : 238 time for calcul the mask position with numpy : 0.0067806243896484375 nb_pixel_total : 113613 time to create 1 rle with old method : 0.13469815254211426 length of segment : 696 time for calcul the mask position with numpy : 0.002354860305786133 nb_pixel_total : 45455 time to create 1 rle with old method : 0.05910825729370117 length of segment : 340 time for calcul the mask position with numpy : 0.005123615264892578 nb_pixel_total : 152181 time to create 1 rle with new method : 0.015028238296508789 length of segment : 319 time for calcul the mask position with numpy : 0.009475231170654297 nb_pixel_total : 170281 time to create 1 rle with new method : 0.015412569046020508 length of segment : 760 time for calcul the mask position with numpy : 0.0026433467864990234 nb_pixel_total : 41973 time to create 1 rle with old method : 0.04741859436035156 length of segment : 319 time for calcul the mask position with numpy : 0.0006470680236816406 nb_pixel_total : 12667 time to create 1 rle with old method : 0.014905929565429688 length of segment : 139 time for calcul the mask position with numpy : 0.00028705596923828125 nb_pixel_total : 5907 time to create 1 rle with old method : 0.007008075714111328 length of segment : 99 time for calcul the mask position with numpy : 0.004693031311035156 nb_pixel_total : 102260 time to create 1 rle with old method : 0.13267207145690918 length of segment : 421 time for calcul the mask position with numpy : 0.0009131431579589844 nb_pixel_total : 10011 time to create 1 rle with old method : 0.018067359924316406 length of segment : 132 time for calcul the mask position with numpy : 0.0013120174407958984 nb_pixel_total : 18435 time to create 1 rle with old method : 0.032877206802368164 length of segment : 132 time for calcul the mask position with numpy : 0.00899505615234375 nb_pixel_total : 127917 time to create 1 rle with old method : 0.21122121810913086 length of segment : 383 time for calcul the mask position with numpy : 0.0007944107055664062 nb_pixel_total : 23992 time to create 1 rle with old method : 0.028418302536010742 length of segment : 303 time for calcul the mask position with numpy : 0.0006473064422607422 nb_pixel_total : 15644 time to create 1 rle with old method : 0.018822669982910156 length of segment : 164 time for calcul the mask position with numpy : 0.0020449161529541016 nb_pixel_total : 38685 time to create 1 rle with old method : 0.05754709243774414 length of segment : 288 time for calcul the mask position with numpy : 0.0036902427673339844 nb_pixel_total : 102899 time to create 1 rle with old method : 0.11628580093383789 length of segment : 878 time for calcul the mask position with numpy : 0.0015020370483398438 nb_pixel_total : 27898 time to create 1 rle with old method : 0.031700849533081055 length of segment : 320 time for calcul the mask position with numpy : 0.0010464191436767578 nb_pixel_total : 31408 time to create 1 rle with old method : 0.03967547416687012 length of segment : 394 time for calcul the mask position with numpy : 0.0009925365447998047 nb_pixel_total : 18091 time to create 1 rle with old method : 0.02153182029724121 length of segment : 187 time for calcul the mask position with numpy : 0.002160787582397461 nb_pixel_total : 66355 time to create 1 rle with old method : 0.0769655704498291 length of segment : 322 time for calcul the mask position with numpy : 0.007897138595581055 nb_pixel_total : 244210 time to create 1 rle with new method : 1.578852891921997 length of segment : 591 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 15718 time to create 1 rle with old method : 0.018932104110717773 length of segment : 143 time for calcul the mask position with numpy : 0.0016565322875976562 nb_pixel_total : 74539 time to create 1 rle with old method : 0.08629417419433594 length of segment : 536 time for calcul the mask position with numpy : 0.00688624382019043 nb_pixel_total : 226750 time to create 1 rle with new method : 0.6190931797027588 length of segment : 766 time for calcul the mask position with numpy : 0.004141092300415039 nb_pixel_total : 169660 time to create 1 rle with new method : 0.01320648193359375 length of segment : 502 time for calcul the mask position with numpy : 0.0006287097930908203 nb_pixel_total : 9103 time to create 1 rle with old method : 0.010541915893554688 length of segment : 162 time for calcul the mask position with numpy : 0.004405498504638672 nb_pixel_total : 107695 time to create 1 rle with old method : 0.14098501205444336 length of segment : 384 time for calcul the mask position with numpy : 0.007977724075317383 nb_pixel_total : 160704 time to create 1 rle with new method : 0.015001058578491211 length of segment : 635 time for calcul the mask position with numpy : 0.006283760070800781 nb_pixel_total : 124636 time to create 1 rle with old method : 0.1502065658569336 length of segment : 446 time for calcul the mask position with numpy : 0.0022745132446289062 nb_pixel_total : 27850 time to create 1 rle with old method : 0.04379081726074219 length of segment : 303 time for calcul the mask position with numpy : 0.00766444206237793 nb_pixel_total : 110756 time to create 1 rle with old method : 0.17070364952087402 length of segment : 536 time for calcul the mask position with numpy : 0.00024366378784179688 nb_pixel_total : 4203 time to create 1 rle with old method : 0.005999326705932617 length of segment : 79 time for calcul the mask position with numpy : 0.0035119056701660156 nb_pixel_total : 96847 time to create 1 rle with old method : 0.1261615753173828 length of segment : 403 time for calcul the mask position with numpy : 0.003042459487915039 nb_pixel_total : 127247 time to create 1 rle with old method : 0.16399550437927246 length of segment : 488 time for calcul the mask position with numpy : 0.004456043243408203 nb_pixel_total : 192562 time to create 1 rle with new method : 0.011210918426513672 length of segment : 430 time for calcul the mask position with numpy : 0.004370450973510742 nb_pixel_total : 104762 time to create 1 rle with old method : 0.11771464347839355 length of segment : 771 time for calcul the mask position with numpy : 0.007434844970703125 nb_pixel_total : 209995 time to create 1 rle with new method : 0.015628337860107422 length of segment : 650 time for calcul the mask position with numpy : 0.0015537738800048828 nb_pixel_total : 55157 time to create 1 rle with old method : 0.06241631507873535 length of segment : 288 time for calcul the mask position with numpy : 0.0017609596252441406 nb_pixel_total : 70815 time to create 1 rle with old method : 0.0869443416595459 length of segment : 305 time for calcul the mask position with numpy : 0.0010943412780761719 nb_pixel_total : 49099 time to create 1 rle with old method : 0.058302879333496094 length of segment : 208 time for calcul the mask position with numpy : 0.0030364990234375 nb_pixel_total : 116725 time to create 1 rle with old method : 0.13502883911132812 length of segment : 283 time for calcul the mask position with numpy : 0.0008370876312255859 nb_pixel_total : 23544 time to create 1 rle with old method : 0.0269467830657959 length of segment : 227 time for calcul the mask position with numpy : 0.012841463088989258 nb_pixel_total : 296170 time to create 1 rle with new method : 0.04255533218383789 length of segment : 1678 time for calcul the mask position with numpy : 0.0027496814727783203 nb_pixel_total : 113090 time to create 1 rle with old method : 0.12793850898742676 length of segment : 454 time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 15847 time to create 1 rle with old method : 0.018405437469482422 length of segment : 214 time for calcul the mask position with numpy : 0.0022459030151367188 nb_pixel_total : 66517 time to create 1 rle with old method : 0.07974386215209961 length of segment : 610 time for calcul the mask position with numpy : 0.00805211067199707 nb_pixel_total : 335093 time to create 1 rle with new method : 0.014612913131713867 length of segment : 830 time for calcul the mask position with numpy : 0.0006783008575439453 nb_pixel_total : 31670 time to create 1 rle with old method : 0.041358232498168945 length of segment : 282 time for calcul the mask position with numpy : 0.0032491683959960938 nb_pixel_total : 138230 time to create 1 rle with old method : 0.1702568531036377 length of segment : 546 time for calcul the mask position with numpy : 0.0024175643920898438 nb_pixel_total : 65392 time to create 1 rle with old method : 0.07452726364135742 length of segment : 425 time for calcul the mask position with numpy : 0.0030477046966552734 nb_pixel_total : 117703 time to create 1 rle with old method : 0.13581442832946777 length of segment : 534 time for calcul the mask position with numpy : 0.001149892807006836 nb_pixel_total : 34417 time to create 1 rle with old method : 0.0381474494934082 length of segment : 368 time for calcul the mask position with numpy : 0.004477977752685547 nb_pixel_total : 129477 time to create 1 rle with old method : 0.14234304428100586 length of segment : 781 time for calcul the mask position with numpy : 0.006172657012939453 nb_pixel_total : 304355 time to create 1 rle with new method : 0.014574766159057617 length of segment : 581 time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 22999 time to create 1 rle with old method : 0.03755974769592285 length of segment : 372 time for calcul the mask position with numpy : 0.0011990070343017578 nb_pixel_total : 45315 time to create 1 rle with old method : 0.05178046226501465 length of segment : 435 time for calcul the mask position with numpy : 0.005831241607666016 nb_pixel_total : 267160 time to create 1 rle with new method : 0.01617121696472168 length of segment : 626 time for calcul the mask position with numpy : 0.0018885135650634766 nb_pixel_total : 42194 time to create 1 rle with old method : 0.04997086524963379 length of segment : 231 time for calcul the mask position with numpy : 0.0013692378997802734 nb_pixel_total : 24552 time to create 1 rle with old method : 0.036333322525024414 length of segment : 263 time for calcul the mask position with numpy : 0.0017957687377929688 nb_pixel_total : 27328 time to create 1 rle with old method : 0.04036831855773926 length of segment : 315 time for calcul the mask position with numpy : 0.03357243537902832 nb_pixel_total : 665787 time to create 1 rle with new method : 0.07911872863769531 length of segment : 1765 time for calcul the mask position with numpy : 0.02371525764465332 nb_pixel_total : 666333 time to create 1 rle with new method : 0.04856133460998535 length of segment : 1015 time for calcul the mask position with numpy : 0.0007116794586181641 nb_pixel_total : 12079 time to create 1 rle with old method : 0.014060497283935547 length of segment : 152 time for calcul the mask position with numpy : 0.002750396728515625 nb_pixel_total : 53754 time to create 1 rle with old method : 0.06171536445617676 length of segment : 372 time for calcul the mask position with numpy : 0.0021440982818603516 nb_pixel_total : 112834 time to create 1 rle with old method : 0.1259019374847412 length of segment : 693 time for calcul the mask position with numpy : 0.0005538463592529297 nb_pixel_total : 7241 time to create 1 rle with old method : 0.008431434631347656 length of segment : 130 time for calcul the mask position with numpy : 0.0006625652313232422 nb_pixel_total : 15334 time to create 1 rle with old method : 0.017460346221923828 length of segment : 140 time for calcul the mask position with numpy : 0.00411677360534668 nb_pixel_total : 43289 time to create 1 rle with old method : 0.050341129302978516 length of segment : 486 time for calcul the mask position with numpy : 0.001226663589477539 nb_pixel_total : 19237 time to create 1 rle with old method : 0.023321866989135742 length of segment : 210 time for calcul the mask position with numpy : 0.0006544589996337891 nb_pixel_total : 15726 time to create 1 rle with old method : 0.018234968185424805 length of segment : 165 time for calcul the mask position with numpy : 0.005037546157836914 nb_pixel_total : 119419 time to create 1 rle with old method : 0.13616585731506348 length of segment : 610 time for calcul the mask position with numpy : 0.0029206275939941406 nb_pixel_total : 86713 time to create 1 rle with old method : 0.09757423400878906 length of segment : 363 time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 13079 time to create 1 rle with old method : 0.015294790267944336 length of segment : 151 time for calcul the mask position with numpy : 0.001997709274291992 nb_pixel_total : 55948 time to create 1 rle with old method : 0.06325626373291016 length of segment : 453 time for calcul the mask position with numpy : 0.0021190643310546875 nb_pixel_total : 56810 time to create 1 rle with old method : 0.06549215316772461 length of segment : 566 time for calcul the mask position with numpy : 0.006991147994995117 nb_pixel_total : 181146 time to create 1 rle with new method : 0.008553266525268555 length of segment : 451 time for calcul the mask position with numpy : 0.0003402233123779297 nb_pixel_total : 7728 time to create 1 rle with old method : 0.008956193923950195 length of segment : 144 time for calcul the mask position with numpy : 0.004390239715576172 nb_pixel_total : 107001 time to create 1 rle with old method : 0.12672042846679688 length of segment : 639 time for calcul the mask position with numpy : 0.002231121063232422 nb_pixel_total : 46774 time to create 1 rle with old method : 0.05493783950805664 length of segment : 285 time for calcul the mask position with numpy : 0.0041277408599853516 nb_pixel_total : 84946 time to create 1 rle with old method : 0.09833955764770508 length of segment : 419 time for calcul the mask position with numpy : 0.003923892974853516 nb_pixel_total : 74357 time to create 1 rle with old method : 0.08687496185302734 length of segment : 383 time for calcul the mask position with numpy : 0.0071964263916015625 nb_pixel_total : 156559 time to create 1 rle with new method : 0.008581876754760742 length of segment : 402 time for calcul the mask position with numpy : 0.0016214847564697266 nb_pixel_total : 31107 time to create 1 rle with old method : 0.0358889102935791 length of segment : 219 time for calcul the mask position with numpy : 0.0013551712036132812 nb_pixel_total : 22506 time to create 1 rle with old method : 0.026366233825683594 length of segment : 278 time for calcul the mask position with numpy : 0.0035903453826904297 nb_pixel_total : 45769 time to create 1 rle with old method : 0.051027536392211914 length of segment : 630 time for calcul the mask position with numpy : 0.0019605159759521484 nb_pixel_total : 47640 time to create 1 rle with old method : 0.05422806739807129 length of segment : 281 time for calcul the mask position with numpy : 0.002710103988647461 nb_pixel_total : 62494 time to create 1 rle with old method : 0.07763075828552246 length of segment : 245 time for calcul the mask position with numpy : 0.008466005325317383 nb_pixel_total : 160589 time to create 1 rle with new method : 0.01084280014038086 length of segment : 758 time for calcul the mask position with numpy : 0.005053520202636719 nb_pixel_total : 141032 time to create 1 rle with old method : 0.19193553924560547 length of segment : 510 time for calcul the mask position with numpy : 0.002538442611694336 nb_pixel_total : 51744 time to create 1 rle with old method : 0.05900692939758301 length of segment : 295 time for calcul the mask position with numpy : 0.0008463859558105469 nb_pixel_total : 14450 time to create 1 rle with old method : 0.016701936721801758 length of segment : 147 time for calcul the mask position with numpy : 0.003396272659301758 nb_pixel_total : 75863 time to create 1 rle with old method : 0.08352041244506836 length of segment : 569 time for calcul the mask position with numpy : 0.0010571479797363281 nb_pixel_total : 20093 time to create 1 rle with old method : 0.0230557918548584 length of segment : 186 time for calcul the mask position with numpy : 0.0010967254638671875 nb_pixel_total : 15859 time to create 1 rle with old method : 0.026673555374145508 length of segment : 179 time for calcul the mask position with numpy : 0.0016586780548095703 nb_pixel_total : 11549 time to create 1 rle with old method : 0.01320791244506836 length of segment : 323 time for calcul the mask position with numpy : 0.00025725364685058594 nb_pixel_total : 4086 time to create 1 rle with old method : 0.004807710647583008 length of segment : 86 time for calcul the mask position with numpy : 0.007700204849243164 nb_pixel_total : 151666 time to create 1 rle with new method : 0.011204719543457031 length of segment : 686 time for calcul the mask position with numpy : 0.0007112026214599609 nb_pixel_total : 6616 time to create 1 rle with old method : 0.0074269771575927734 length of segment : 153 time for calcul the mask position with numpy : 0.0008902549743652344 nb_pixel_total : 36348 time to create 1 rle with old method : 0.0417327880859375 length of segment : 255 time for calcul the mask position with numpy : 0.0032782554626464844 nb_pixel_total : 33146 time to create 1 rle with old method : 0.0459141731262207 length of segment : 486 time for calcul the mask position with numpy : 0.0028963088989257812 nb_pixel_total : 35448 time to create 1 rle with old method : 0.03974604606628418 length of segment : 625 time for calcul the mask position with numpy : 0.007276773452758789 nb_pixel_total : 220164 time to create 1 rle with new method : 0.008450984954833984 length of segment : 546 time for calcul the mask position with numpy : 0.007498025894165039 nb_pixel_total : 164709 time to create 1 rle with new method : 0.009755134582519531 length of segment : 577 time for calcul the mask position with numpy : 0.0023136138916015625 nb_pixel_total : 37152 time to create 1 rle with old method : 0.04055595397949219 length of segment : 394 time for calcul the mask position with numpy : 0.0012447834014892578 nb_pixel_total : 25157 time to create 1 rle with old method : 0.028800010681152344 length of segment : 246 time for calcul the mask position with numpy : 0.0021677017211914062 nb_pixel_total : 71934 time to create 1 rle with old method : 0.0795903205871582 length of segment : 403 time for calcul the mask position with numpy : 0.001434326171875 nb_pixel_total : 25251 time to create 1 rle with old method : 0.02838873863220215 length of segment : 263 time for calcul the mask position with numpy : 0.0020444393157958984 nb_pixel_total : 44981 time to create 1 rle with old method : 0.05167031288146973 length of segment : 301 time for calcul the mask position with numpy : 0.0005788803100585938 nb_pixel_total : 9810 time to create 1 rle with old method : 0.011577367782592773 length of segment : 110 time for calcul the mask position with numpy : 0.014287471771240234 nb_pixel_total : 360222 time to create 1 rle with new method : 0.07625007629394531 length of segment : 904 time for calcul the mask position with numpy : 0.007022380828857422 nb_pixel_total : 168533 time to create 1 rle with new method : 0.010615348815917969 length of segment : 528 time for calcul the mask position with numpy : 0.0014925003051757812 nb_pixel_total : 39415 time to create 1 rle with old method : 0.05912017822265625 length of segment : 240 time for calcul the mask position with numpy : 0.006045341491699219 nb_pixel_total : 207352 time to create 1 rle with new method : 0.010134458541870117 length of segment : 692 time for calcul the mask position with numpy : 0.0008258819580078125 nb_pixel_total : 20853 time to create 1 rle with old method : 0.023086071014404297 length of segment : 219 time for calcul the mask position with numpy : 0.009926319122314453 nb_pixel_total : 356147 time to create 1 rle with new method : 0.05457139015197754 length of segment : 699 time for calcul the mask position with numpy : 0.004364728927612305 nb_pixel_total : 106660 time to create 1 rle with old method : 0.1251237392425537 length of segment : 443 time for calcul the mask position with numpy : 0.004707813262939453 nb_pixel_total : 233505 time to create 1 rle with new method : 0.017444849014282227 length of segment : 557 time for calcul the mask position with numpy : 0.0025658607482910156 nb_pixel_total : 73458 time to create 1 rle with old method : 0.08220124244689941 length of segment : 316 time for calcul the mask position with numpy : 0.004040956497192383 nb_pixel_total : 93250 time to create 1 rle with old method : 0.10091853141784668 length of segment : 452 time for calcul the mask position with numpy : 0.0007083415985107422 nb_pixel_total : 15951 time to create 1 rle with old method : 0.018532514572143555 length of segment : 180 time for calcul the mask position with numpy : 0.0018155574798583984 nb_pixel_total : 49266 time to create 1 rle with old method : 0.054338932037353516 length of segment : 447 time for calcul the mask position with numpy : 0.0016989707946777344 nb_pixel_total : 34964 time to create 1 rle with old method : 0.03807520866394043 length of segment : 211 time for calcul the mask position with numpy : 0.010016441345214844 nb_pixel_total : 180651 time to create 1 rle with new method : 0.02341151237487793 length of segment : 1326 time for calcul the mask position with numpy : 0.0019791126251220703 nb_pixel_total : 79786 time to create 1 rle with old method : 0.09361505508422852 length of segment : 394 time for calcul the mask position with numpy : 0.0020978450775146484 nb_pixel_total : 78264 time to create 1 rle with old method : 0.0942528247833252 length of segment : 252 time for calcul the mask position with numpy : 0.0033197402954101562 nb_pixel_total : 97357 time to create 1 rle with old method : 0.11145424842834473 length of segment : 519 time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 18492 time to create 1 rle with old method : 0.021872520446777344 length of segment : 97 time for calcul the mask position with numpy : 0.002011537551879883 nb_pixel_total : 40940 time to create 1 rle with old method : 0.06759285926818848 length of segment : 279 time for calcul the mask position with numpy : 0.005562782287597656 nb_pixel_total : 187299 time to create 1 rle with new method : 0.011302947998046875 length of segment : 503 time for calcul the mask position with numpy : 0.0032036304473876953 nb_pixel_total : 113539 time to create 1 rle with old method : 0.14049220085144043 length of segment : 382 time for calcul the mask position with numpy : 0.002878427505493164 nb_pixel_total : 121749 time to create 1 rle with old method : 0.16866207122802734 length of segment : 383 time for calcul the mask position with numpy : 0.0006966590881347656 nb_pixel_total : 19847 time to create 1 rle with old method : 0.0232846736907959 length of segment : 131 time for calcul the mask position with numpy : 0.002499103546142578 nb_pixel_total : 58554 time to create 1 rle with old method : 0.0647282600402832 length of segment : 515 time for calcul the mask position with numpy : 0.004082918167114258 nb_pixel_total : 91954 time to create 1 rle with old method : 0.11606693267822266 length of segment : 543 time for calcul the mask position with numpy : 0.0036144256591796875 nb_pixel_total : 102649 time to create 1 rle with old method : 0.12528753280639648 length of segment : 468 time for calcul the mask position with numpy : 0.0010044574737548828 nb_pixel_total : 18402 time to create 1 rle with old method : 0.021337032318115234 length of segment : 287 time for calcul the mask position with numpy : 0.0034897327423095703 nb_pixel_total : 87200 time to create 1 rle with old method : 0.1020972728729248 length of segment : 553 time for calcul the mask position with numpy : 0.00038313865661621094 nb_pixel_total : 14891 time to create 1 rle with old method : 0.016892433166503906 length of segment : 125 time for calcul the mask position with numpy : 0.0025908946990966797 nb_pixel_total : 57320 time to create 1 rle with old method : 0.0715792179107666 length of segment : 449 time for calcul the mask position with numpy : 0.016164541244506836 nb_pixel_total : 759181 time to create 1 rle with new method : 0.07273364067077637 length of segment : 1085 time for calcul the mask position with numpy : 0.0018229484558105469 nb_pixel_total : 55343 time to create 1 rle with old method : 0.06159543991088867 length of segment : 416 time for calcul the mask position with numpy : 0.0014791488647460938 nb_pixel_total : 49405 time to create 1 rle with old method : 0.05701804161071777 length of segment : 142 time for calcul the mask position with numpy : 0.0007236003875732422 nb_pixel_total : 18627 time to create 1 rle with old method : 0.02112865447998047 length of segment : 176 time for calcul the mask position with numpy : 0.02752208709716797 nb_pixel_total : 809354 time to create 1 rle with new method : 0.05939793586730957 length of segment : 1133 time for calcul the mask position with numpy : 0.0005056858062744141 nb_pixel_total : 12900 time to create 1 rle with old method : 0.014679908752441406 length of segment : 156 time for calcul the mask position with numpy : 0.0019216537475585938 nb_pixel_total : 57057 time to create 1 rle with old method : 0.06351661682128906 length of segment : 340 time for calcul the mask position with numpy : 0.0009567737579345703 nb_pixel_total : 26328 time to create 1 rle with old method : 0.02904796600341797 length of segment : 241 time for calcul the mask position with numpy : 0.0011420249938964844 nb_pixel_total : 35376 time to create 1 rle with old method : 0.03895306587219238 length of segment : 239 time for calcul the mask position with numpy : 0.0005974769592285156 nb_pixel_total : 17292 time to create 1 rle with old method : 0.019679784774780273 length of segment : 148 time for calcul the mask position with numpy : 0.0004589557647705078 nb_pixel_total : 11920 time to create 1 rle with old method : 0.014090538024902344 length of segment : 190 time for calcul the mask position with numpy : 0.0011451244354248047 nb_pixel_total : 30469 time to create 1 rle with old method : 0.03316855430603027 length of segment : 407 time for calcul the mask position with numpy : 0.0025603771209716797 nb_pixel_total : 117234 time to create 1 rle with old method : 0.12622880935668945 length of segment : 277 time for calcul the mask position with numpy : 0.002634763717651367 nb_pixel_total : 95747 time to create 1 rle with old method : 0.099090576171875 length of segment : 461 time for calcul the mask position with numpy : 0.006674051284790039 nb_pixel_total : 321719 time to create 1 rle with new method : 0.012554645538330078 length of segment : 657 time for calcul the mask position with numpy : 0.00045561790466308594 nb_pixel_total : 21721 time to create 1 rle with old method : 0.025294780731201172 length of segment : 130 time for calcul the mask position with numpy : 0.00047135353088378906 nb_pixel_total : 19798 time to create 1 rle with old method : 0.02260875701904297 length of segment : 201 time for calcul the mask position with numpy : 0.001707315444946289 nb_pixel_total : 22079 time to create 1 rle with old method : 0.02501368522644043 length of segment : 185 time for calcul the mask position with numpy : 0.0010828971862792969 nb_pixel_total : 16791 time to create 1 rle with old method : 0.02083873748779297 length of segment : 183 time for calcul the mask position with numpy : 0.0014591217041015625 nb_pixel_total : 40134 time to create 1 rle with old method : 0.04555249214172363 length of segment : 241 time for calcul the mask position with numpy : 0.0023043155670166016 nb_pixel_total : 61375 time to create 1 rle with old method : 0.06712079048156738 length of segment : 357 time for calcul the mask position with numpy : 0.0006313323974609375 nb_pixel_total : 21218 time to create 1 rle with old method : 0.024770259857177734 length of segment : 156 time for calcul the mask position with numpy : 0.00115203857421875 nb_pixel_total : 23574 time to create 1 rle with old method : 0.030181169509887695 length of segment : 200 time for calcul the mask position with numpy : 0.0019867420196533203 nb_pixel_total : 37642 time to create 1 rle with old method : 0.042160749435424805 length of segment : 453 time for calcul the mask position with numpy : 0.00177764892578125 nb_pixel_total : 41056 time to create 1 rle with old method : 0.04511857032775879 length of segment : 308 time for calcul the mask position with numpy : 0.0007872581481933594 nb_pixel_total : 18378 time to create 1 rle with old method : 0.021015644073486328 length of segment : 185 time for calcul the mask position with numpy : 0.003348112106323242 nb_pixel_total : 86203 time to create 1 rle with old method : 0.09621882438659668 length of segment : 463 time for calcul the mask position with numpy : 0.024913311004638672 nb_pixel_total : 651273 time to create 1 rle with new method : 0.18372392654418945 length of segment : 1178 time for calcul the mask position with numpy : 0.0011780261993408203 nb_pixel_total : 23128 time to create 1 rle with old method : 0.026242971420288086 length of segment : 221 time for calcul the mask position with numpy : 0.010874748229980469 nb_pixel_total : 185068 time to create 1 rle with new method : 0.01889634132385254 length of segment : 1171 time for calcul the mask position with numpy : 0.0023589134216308594 nb_pixel_total : 82659 time to create 1 rle with old method : 0.11631393432617188 length of segment : 525 time for calcul the mask position with numpy : 0.0042459964752197266 nb_pixel_total : 107551 time to create 1 rle with old method : 0.12989497184753418 length of segment : 495 time for calcul the mask position with numpy : 0.008646488189697266 nb_pixel_total : 217906 time to create 1 rle with new method : 0.013521432876586914 length of segment : 867 time for calcul the mask position with numpy : 0.0022215843200683594 nb_pixel_total : 89206 time to create 1 rle with old method : 0.10261845588684082 length of segment : 448 time for calcul the mask position with numpy : 0.001104116439819336 nb_pixel_total : 27994 time to create 1 rle with old method : 0.03332853317260742 length of segment : 188 time for calcul the mask position with numpy : 0.002923727035522461 nb_pixel_total : 66682 time to create 1 rle with old method : 0.09526276588439941 length of segment : 565 time for calcul the mask position with numpy : 0.0033936500549316406 nb_pixel_total : 121362 time to create 1 rle with old method : 0.13507437705993652 length of segment : 438 time for calcul the mask position with numpy : 0.027823209762573242 nb_pixel_total : 954892 time to create 1 rle with new method : 0.06553411483764648 length of segment : 1066 time for calcul the mask position with numpy : 0.0019583702087402344 nb_pixel_total : 73546 time to create 1 rle with old method : 0.07938861846923828 length of segment : 397 time for calcul the mask position with numpy : 0.0018584728240966797 nb_pixel_total : 58853 time to create 1 rle with old method : 0.06482791900634766 length of segment : 286 time for calcul the mask position with numpy : 0.0036454200744628906 nb_pixel_total : 87906 time to create 1 rle with old method : 0.0990912914276123 length of segment : 461 time for calcul the mask position with numpy : 0.0020139217376708984 nb_pixel_total : 59372 time to create 1 rle with old method : 0.06757020950317383 length of segment : 260 time for calcul the mask position with numpy : 0.0007505416870117188 nb_pixel_total : 13223 time to create 1 rle with old method : 0.015344619750976562 length of segment : 195 time for calcul the mask position with numpy : 0.009369134902954102 nb_pixel_total : 286859 time to create 1 rle with new method : 0.014779806137084961 length of segment : 714 time for calcul the mask position with numpy : 0.003427267074584961 nb_pixel_total : 100880 time to create 1 rle with old method : 0.11205434799194336 length of segment : 510 time for calcul the mask position with numpy : 0.0010859966278076172 nb_pixel_total : 52766 time to create 1 rle with old method : 0.05934023857116699 length of segment : 225 time for calcul the mask position with numpy : 0.001028299331665039 nb_pixel_total : 23927 time to create 1 rle with old method : 0.026867151260375977 length of segment : 204 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 30527 time to create 1 rle with old method : 0.03528904914855957 length of segment : 216 time for calcul the mask position with numpy : 0.0021829605102539062 nb_pixel_total : 51319 time to create 1 rle with old method : 0.055074214935302734 length of segment : 379 time for calcul the mask position with numpy : 0.0012581348419189453 nb_pixel_total : 19354 time to create 1 rle with old method : 0.022284984588623047 length of segment : 246 time for calcul the mask position with numpy : 0.004300117492675781 nb_pixel_total : 148173 time to create 1 rle with old method : 0.16118192672729492 length of segment : 539 time for calcul the mask position with numpy : 0.002103090286254883 nb_pixel_total : 57125 time to create 1 rle with old method : 0.06275510787963867 length of segment : 499 time for calcul the mask position with numpy : 0.0006573200225830078 nb_pixel_total : 25489 time to create 1 rle with old method : 0.028947830200195312 length of segment : 232 time for calcul the mask position with numpy : 0.0024967193603515625 nb_pixel_total : 81691 time to create 1 rle with old method : 0.08980131149291992 length of segment : 291 time for calcul the mask position with numpy : 0.0025959014892578125 nb_pixel_total : 72886 time to create 1 rle with old method : 0.08224320411682129 length of segment : 423 time for calcul the mask position with numpy : 0.0004162788391113281 nb_pixel_total : 12801 time to create 1 rle with old method : 0.014508962631225586 length of segment : 216 time for calcul the mask position with numpy : 0.011081933975219727 nb_pixel_total : 227280 time to create 1 rle with new method : 0.014902591705322266 length of segment : 1327 time for calcul the mask position with numpy : 0.005843400955200195 nb_pixel_total : 134234 time to create 1 rle with old method : 0.14379310607910156 length of segment : 635 time for calcul the mask position with numpy : 0.003083467483520508 nb_pixel_total : 98644 time to create 1 rle with old method : 0.11151528358459473 length of segment : 463 time for calcul the mask position with numpy : 0.004378318786621094 nb_pixel_total : 128999 time to create 1 rle with old method : 0.14404773712158203 length of segment : 304 time for calcul the mask position with numpy : 0.007190227508544922 nb_pixel_total : 224396 time to create 1 rle with new method : 0.010000228881835938 length of segment : 662 time for calcul the mask position with numpy : 0.001764059066772461 nb_pixel_total : 45424 time to create 1 rle with old method : 0.048642635345458984 length of segment : 331 time for calcul the mask position with numpy : 0.0010404586791992188 nb_pixel_total : 22294 time to create 1 rle with old method : 0.025543212890625 length of segment : 259 time for calcul the mask position with numpy : 0.0021736621856689453 nb_pixel_total : 53921 time to create 1 rle with old method : 0.06122756004333496 length of segment : 305 time for calcul the mask position with numpy : 0.0007498264312744141 nb_pixel_total : 25389 time to create 1 rle with old method : 0.02913808822631836 length of segment : 233 time for calcul the mask position with numpy : 0.004035472869873047 nb_pixel_total : 145625 time to create 1 rle with old method : 0.15842652320861816 length of segment : 527 time for calcul the mask position with numpy : 0.0011556148529052734 nb_pixel_total : 36315 time to create 1 rle with old method : 0.04166579246520996 length of segment : 245 time for calcul the mask position with numpy : 0.002143383026123047 nb_pixel_total : 73991 time to create 1 rle with old method : 0.08260321617126465 length of segment : 520 time for calcul the mask position with numpy : 0.0019137859344482422 nb_pixel_total : 50883 time to create 1 rle with old method : 0.055349111557006836 length of segment : 250 time for calcul the mask position with numpy : 0.0027985572814941406 nb_pixel_total : 99263 time to create 1 rle with old method : 0.1086723804473877 length of segment : 524 time for calcul the mask position with numpy : 0.006970643997192383 nb_pixel_total : 196194 time to create 1 rle with new method : 0.008313179016113281 length of segment : 582 time for calcul the mask position with numpy : 0.005627155303955078 nb_pixel_total : 176474 time to create 1 rle with new method : 0.008028030395507812 length of segment : 524 time for calcul the mask position with numpy : 0.007202863693237305 nb_pixel_total : 234495 time to create 1 rle with new method : 0.012781143188476562 length of segment : 1101 time spent for convertir_results : 32.09926962852478 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 489 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 93331 save missing photos in datou_result : time spend for datou_step_exec : 145.7222809791565 time spend to save output : 5.1537089347839355 total time spend for step 1 : 150.87598991394043 step2:crop_condition Fri Mar 7 09:23:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 489 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 279 About to insert : list_path_to_insert length 279 new photo from crops ! About to upload 279 photos upload in portfolio : 3736932 init cache_photo without model_param we have 279 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741335841_1853037 we have uploaded 279 photos in the portfolio 3736932 time of upload the photos Elapsed time : 101.90882563591003 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 3736932 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741335959_1853037 we have uploaded 52 photos in the portfolio 3736932 time of upload the photos Elapsed time : 14.83301043510437 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 99 About to insert : list_path_to_insert length 99 new photo from crops ! About to upload 99 photos upload in portfolio : 3736932 init cache_photo without model_param we have 99 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741336008_1853037 we have uploaded 99 photos in the portfolio 3736932 time of upload the photos Elapsed time : 33.857479095458984 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741336046_1853037 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7641034126281738 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741336053_1853037 we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.971704721450806 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1327687728, 1327687726, 1327687723, 1327687711, 1327687709, 1327687705, 1327687703, 1327687700, 1327687697, 1327687696, 1327687690, 1327687686] Looping around the photos to save general results len do output : 444 /1341419539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341419999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341420232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687728', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687726', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687723', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687711', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687709', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687705', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687703', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687700', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687697', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687696', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687690', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687686', None, None, None, None, None, '2647412') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1344 time used for this insertion : 0.43197107315063477 save_final save missing photos in datou_result : time spend for datou_step_exec : 271.34606766700745 time spend to save output : 0.47724270820617676 total time spend for step 2 : 271.8233103752136 step3:rle_unique_nms_with_priority Fri Mar 7 09:27:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 489 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 26 nb_hashtags : 5 time to prepare the origin masks : 5.351078748703003 time for calcul the mask position with numpy : 1.0339062213897705 nb_pixel_total : 6748110 time to create 1 rle with new method : 1.3304431438446045 time for calcul the mask position with numpy : 0.034789323806762695 nb_pixel_total : 22335 time to create 1 rle with old method : 0.025880813598632812 time for calcul the mask position with numpy : 0.0350947380065918 nb_pixel_total : 71973 time to create 1 rle with old method : 0.08303618431091309 time for calcul the mask position with numpy : 0.03434491157531738 nb_pixel_total : 16052 time to create 1 rle with old method : 0.017965078353881836 time for calcul the mask position with numpy : 0.034555673599243164 nb_pixel_total : 38685 time to create 1 rle with old method : 0.04852604866027832 time for calcul the mask position with numpy : 0.034540653228759766 nb_pixel_total : 5907 time to create 1 rle with old method : 0.0068852901458740234 time for calcul the mask position with numpy : 0.036341190338134766 nb_pixel_total : 36021 time to create 1 rle with old method : 0.043183326721191406 time for calcul the mask position with numpy : 0.03463888168334961 nb_pixel_total : 58541 time to create 1 rle with old method : 0.06584525108337402 time for calcul the mask position with numpy : 0.03558969497680664 nb_pixel_total : 127917 time to create 1 rle with old method : 0.1639397144317627 time for calcul the mask position with numpy : 0.03709816932678223 nb_pixel_total : 181988 time to create 1 rle with new method : 0.7443437576293945 time for calcul the mask position with numpy : 0.03859400749206543 nb_pixel_total : 15644 time to create 1 rle with old method : 0.029937267303466797 time for calcul the mask position with numpy : 0.0374448299407959 nb_pixel_total : 170281 time to create 1 rle with new method : 1.8729805946350098 time for calcul the mask position with numpy : 0.03427910804748535 nb_pixel_total : 13990 time to create 1 rle with old method : 0.01589822769165039 time for calcul the mask position with numpy : 0.035021305084228516 nb_pixel_total : 15680 time to create 1 rle with old method : 0.018027544021606445 time for calcul the mask position with numpy : 0.034665822982788086 nb_pixel_total : 113613 time to create 1 rle with old method : 0.12683367729187012 time for calcul the mask position with numpy : 0.03451800346374512 nb_pixel_total : 111848 time to create 1 rle with old method : 0.12334227561950684 time for calcul the mask position with numpy : 0.03435850143432617 nb_pixel_total : 18435 time to create 1 rle with old method : 0.020768165588378906 time for calcul the mask position with numpy : 0.03466653823852539 nb_pixel_total : 108610 time to create 1 rle with old method : 0.11947941780090332 time for calcul the mask position with numpy : 0.03429770469665527 nb_pixel_total : 12667 time to create 1 rle with old method : 0.014223814010620117 time for calcul the mask position with numpy : 0.034440040588378906 nb_pixel_total : 38458 time to create 1 rle with old method : 0.04300570487976074 time for calcul the mask position with numpy : 0.03449296951293945 nb_pixel_total : 84 time to create 1 rle with old method : 0.0002930164337158203 time for calcul the mask position with numpy : 0.03466200828552246 nb_pixel_total : 102260 time to create 1 rle with old method : 0.11330080032348633 time for calcul the mask position with numpy : 0.0342409610748291 nb_pixel_total : 228 time to create 1 rle with old method : 0.0005376338958740234 time for calcul the mask position with numpy : 0.035117387771606445 nb_pixel_total : 41973 time to create 1 rle with old method : 0.046871185302734375 time for calcul the mask position with numpy : 0.03435373306274414 nb_pixel_total : 10011 time to create 1 rle with old method : 0.011159896850585938 time for calcul the mask position with numpy : 0.034813880920410156 nb_pixel_total : 152181 time to create 1 rle with new method : 0.7886338233947754 time for calcul the mask position with numpy : 0.03461146354675293 nb_pixel_total : 60908 time to create 1 rle with old method : 0.07034420967102051 create new chi : 8.028721332550049 time to delete rle : 0.05710196495056152 batch 1 Loaded 58 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18331 TO DO : save crop sub photo not yet done ! save time : 1.330061912536621 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 6.202772378921509 time for calcul the mask position with numpy : 0.46840596199035645 nb_pixel_total : 6593988 time to create 1 rle with new method : 0.9057133197784424 time for calcul the mask position with numpy : 0.03848409652709961 nb_pixel_total : 27850 time to create 1 rle with old method : 0.03371381759643555 time for calcul the mask position with numpy : 0.035830020904541016 nb_pixel_total : 15718 time to create 1 rle with old method : 0.018191099166870117 time for calcul the mask position with numpy : 0.040381669998168945 nb_pixel_total : 160704 time to create 1 rle with new method : 0.8718466758728027 time for calcul the mask position with numpy : 0.03501152992248535 nb_pixel_total : 110756 time to create 1 rle with old method : 0.1253194808959961 time for calcul the mask position with numpy : 0.036475419998168945 nb_pixel_total : 244019 time to create 1 rle with new method : 0.9223318099975586 time for calcul the mask position with numpy : 0.03521871566772461 nb_pixel_total : 74539 time to create 1 rle with old method : 0.9412915706634521 time for calcul the mask position with numpy : 0.03629446029663086 nb_pixel_total : 18091 time to create 1 rle with old method : 0.020149946212768555 time for calcul the mask position with numpy : 0.035317182540893555 nb_pixel_total : 124636 time to create 1 rle with old method : 0.1413440704345703 time for calcul the mask position with numpy : 0.034421443939208984 nb_pixel_total : 4465 time to create 1 rle with old method : 0.00589752197265625 time for calcul the mask position with numpy : 0.036455631256103516 nb_pixel_total : 226750 time to create 1 rle with new method : 1.3027961254119873 time for calcul the mask position with numpy : 0.038544416427612305 nb_pixel_total : 169660 time to create 1 rle with new method : 0.8565869331359863 time for calcul the mask position with numpy : 0.03476691246032715 nb_pixel_total : 31408 time to create 1 rle with old method : 0.034699201583862305 time for calcul the mask position with numpy : 0.03426718711853027 nb_pixel_total : 101 time to create 1 rle with old method : 0.00025773048400878906 time for calcul the mask position with numpy : 0.03462815284729004 nb_pixel_total : 70572 time to create 1 rle with old method : 0.077850341796875 time for calcul the mask position with numpy : 0.03435254096984863 nb_pixel_total : 4323 time to create 1 rle with old method : 0.005426168441772461 time for calcul the mask position with numpy : 0.035073280334472656 nb_pixel_total : 104462 time to create 1 rle with old method : 0.11591100692749023 time for calcul the mask position with numpy : 0.0347590446472168 nb_pixel_total : 27898 time to create 1 rle with old method : 0.030925273895263672 time for calcul the mask position with numpy : 0.03491091728210449 nb_pixel_total : 96847 time to create 1 rle with old method : 0.11259174346923828 time for calcul the mask position with numpy : 0.03634190559387207 nb_pixel_total : 107695 time to create 1 rle with old method : 0.12123942375183105 time for calcul the mask position with numpy : 0.035018205642700195 nb_pixel_total : 66355 time to create 1 rle with old method : 0.07807278633117676 time for calcul the mask position with numpy : 0.03426098823547363 nb_pixel_total : 1382 time to create 1 rle with old method : 0.0016796588897705078 time for calcul the mask position with numpy : 0.03432130813598633 nb_pixel_total : 5502 time to create 1 rle with old method : 0.006350278854370117 time for calcul the mask position with numpy : 0.03614974021911621 nb_pixel_total : 6679 time to create 1 rle with old method : 0.007512807846069336 create new chi : 8.181544303894043 time to delete rle : 0.00513768196105957 batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19502 TO DO : save crop sub photo not yet done ! save time : 4.1704607009887695 nb_obj : 29 nb_hashtags : 3 time to prepare the origin masks : 10.480071544647217 time for calcul the mask position with numpy : 0.4811370372772217 nb_pixel_total : 5428475 time to create 1 rle with new method : 1.7972302436828613 time for calcul the mask position with numpy : 0.03676247596740723 nb_pixel_total : 192562 time to create 1 rle with new method : 1.0555088520050049 time for calcul the mask position with numpy : 0.04867148399353027 nb_pixel_total : 138230 time to create 1 rle with old method : 0.20794105529785156 time for calcul the mask position with numpy : 0.05134129524230957 nb_pixel_total : 45315 time to create 1 rle with old method : 0.07140731811523438 time for calcul the mask position with numpy : 0.0413203239440918 nb_pixel_total : 34417 time to create 1 rle with old method : 0.05626273155212402 time for calcul the mask position with numpy : 0.048246145248413086 nb_pixel_total : 23544 time to create 1 rle with old method : 0.029959440231323242 time for calcul the mask position with numpy : 0.04348301887512207 nb_pixel_total : 335093 time to create 1 rle with new method : 1.4316089153289795 time for calcul the mask position with numpy : 0.039945125579833984 nb_pixel_total : 304355 time to create 1 rle with new method : 0.8539135456085205 time for calcul the mask position with numpy : 0.03394794464111328 nb_pixel_total : 15847 time to create 1 rle with old method : 0.01952981948852539 time for calcul the mask position with numpy : 0.03628087043762207 nb_pixel_total : 113090 time to create 1 rle with old method : 0.12851309776306152 time for calcul the mask position with numpy : 0.035521507263183594 nb_pixel_total : 22999 time to create 1 rle with old method : 0.02891707420349121 time for calcul the mask position with numpy : 0.03791546821594238 nb_pixel_total : 117703 time to create 1 rle with old method : 0.22406411170959473 time for calcul the mask position with numpy : 0.03523898124694824 nb_pixel_total : 691 time to create 1 rle with old method : 0.0011675357818603516 time for calcul the mask position with numpy : 0.03897261619567871 nb_pixel_total : 296170 time to create 1 rle with new method : 1.3254210948944092 time for calcul the mask position with numpy : 0.03722500801086426 nb_pixel_total : 265760 time to create 1 rle with new method : 1.054823875427246 time for calcul the mask position with numpy : 0.03530073165893555 nb_pixel_total : 66517 time to create 1 rle with old method : 0.07807731628417969 time for calcul the mask position with numpy : 0.036644935607910156 nb_pixel_total : 3078 time to create 1 rle with old method : 0.004091024398803711 time for calcul the mask position with numpy : 0.036644697189331055 nb_pixel_total : 129477 time to create 1 rle with old method : 0.1683051586151123 time for calcul the mask position with numpy : 0.03491663932800293 nb_pixel_total : 70877 time to create 1 rle with old method : 0.08351516723632812 time for calcul the mask position with numpy : 0.03909921646118164 nb_pixel_total : 251 time to create 1 rle with old method : 0.0008459091186523438 time for calcul the mask position with numpy : 0.03943204879760742 nb_pixel_total : 55157 time to create 1 rle with old method : 0.06177473068237305 time for calcul the mask position with numpy : 0.03531670570373535 nb_pixel_total : 13773 time to create 1 rle with old method : 0.02250838279724121 time for calcul the mask position with numpy : 0.041281700134277344 nb_pixel_total : 197457 time to create 1 rle with new method : 0.893946647644043 time for calcul the mask position with numpy : 0.034772634506225586 nb_pixel_total : 31670 time to create 1 rle with old method : 0.03617143630981445 time for calcul the mask position with numpy : 0.0347292423248291 nb_pixel_total : 104762 time to create 1 rle with old method : 0.11668992042541504 time for calcul the mask position with numpy : 0.03441166877746582 nb_pixel_total : 34368 time to create 1 rle with old method : 0.03818845748901367 time for calcul the mask position with numpy : 0.034820556640625 nb_pixel_total : 38 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.03511452674865723 nb_pixel_total : 65392 time to create 1 rle with old method : 0.08139848709106445 time for calcul the mask position with numpy : 0.03606986999511719 nb_pixel_total : 70607 time to create 1 rle with old method : 0.0853579044342041 time for calcul the mask position with numpy : 0.041168928146362305 nb_pixel_total : 116725 time to create 1 rle with old method : 0.15360665321350098 create new chi : 11.94831919670105 time to delete rle : 0.010963678359985352 batch 1 Loaded 66 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 28222 TO DO : save crop sub photo not yet done ! save time : 4.347450494766235 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 5.398154020309448 time for calcul the mask position with numpy : 0.497150182723999 nb_pixel_total : 5920267 time to create 1 rle with new method : 0.6751039028167725 time for calcul the mask position with numpy : 0.05930066108703613 nb_pixel_total : 55948 time to create 1 rle with old method : 0.07663226127624512 time for calcul the mask position with numpy : 0.07052183151245117 nb_pixel_total : 666242 time to create 1 rle with new method : 0.7360785007476807 time for calcul the mask position with numpy : 0.05631089210510254 nb_pixel_total : 24552 time to create 1 rle with old method : 0.02629566192626953 time for calcul the mask position with numpy : 0.06518721580505371 nb_pixel_total : 665787 time to create 1 rle with new method : 0.9509243965148926 time for calcul the mask position with numpy : 0.06005382537841797 nb_pixel_total : 106752 time to create 1 rle with old method : 0.1374645233154297 time for calcul the mask position with numpy : 0.06560587882995605 nb_pixel_total : 86713 time to create 1 rle with old method : 0.09789538383483887 time for calcul the mask position with numpy : 0.057195425033569336 nb_pixel_total : 181146 time to create 1 rle with new method : 1.4912810325622559 time for calcul the mask position with numpy : 0.05861043930053711 nb_pixel_total : 27328 time to create 1 rle with old method : 0.03179335594177246 time for calcul the mask position with numpy : 0.05836772918701172 nb_pixel_total : 42194 time to create 1 rle with old method : 0.046959877014160156 time for calcul the mask position with numpy : 0.05935382843017578 nb_pixel_total : 46774 time to create 1 rle with old method : 0.051903486251831055 time for calcul the mask position with numpy : 0.05787014961242676 nb_pixel_total : 119419 time to create 1 rle with old method : 0.1548459529876709 time for calcul the mask position with numpy : 0.05728030204772949 nb_pixel_total : 15334 time to create 1 rle with old method : 0.016801834106445312 time for calcul the mask position with numpy : 0.05933189392089844 nb_pixel_total : 7728 time to create 1 rle with old method : 0.008829355239868164 time for calcul the mask position with numpy : 0.05961465835571289 nb_pixel_total : 15726 time to create 1 rle with old method : 0.017623186111450195 time for calcul the mask position with numpy : 0.058678388595581055 nb_pixel_total : 56810 time to create 1 rle with old method : 0.08978104591369629 time for calcul the mask position with numpy : 0.05768942832946777 nb_pixel_total : 43289 time to create 1 rle with old method : 0.045929670333862305 time for calcul the mask position with numpy : 0.05738234519958496 nb_pixel_total : 12079 time to create 1 rle with old method : 0.014225959777832031 time for calcul the mask position with numpy : 0.05592966079711914 nb_pixel_total : 53754 time to create 1 rle with old method : 0.056851863861083984 time for calcul the mask position with numpy : 0.055977582931518555 nb_pixel_total : 7241 time to create 1 rle with old method : 0.007851600646972656 time for calcul the mask position with numpy : 0.0560305118560791 nb_pixel_total : 19237 time to create 1 rle with old method : 0.020567893981933594 time for calcul the mask position with numpy : 0.05718374252319336 nb_pixel_total : 107001 time to create 1 rle with old method : 0.1136782169342041 time for calcul the mask position with numpy : 0.05549931526184082 nb_pixel_total : 13079 time to create 1 rle with old method : 0.014124631881713867 create new chi : 6.838510036468506 time to delete rle : 0.006330966949462891 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++Number RLEs to save : 20995 TO DO : save crop sub photo not yet done ! save time : 1.4736535549163818 nb_obj : 40 nb_hashtags : 3 time to prepare the origin masks : 8.947589874267578 time for calcul the mask position with numpy : 0.6116230487823486 nb_pixel_total : 6381161 time to create 1 rle with new method : 0.804628849029541 time for calcul the mask position with numpy : 0.0578312873840332 nb_pixel_total : 8453 time to create 1 rle with old method : 0.010378360748291016 time for calcul the mask position with numpy : 0.05990099906921387 nb_pixel_total : 149268 time to create 1 rle with old method : 0.18407464027404785 time for calcul the mask position with numpy : 0.056900978088378906 nb_pixel_total : 149430 time to create 1 rle with old method : 0.1651601791381836 time for calcul the mask position with numpy : 0.056781768798828125 nb_pixel_total : 31107 time to create 1 rle with old method : 0.03448128700256348 time for calcul the mask position with numpy : 0.0571286678314209 nb_pixel_total : 160589 time to create 1 rle with new method : 0.505150318145752 time for calcul the mask position with numpy : 0.05897068977355957 nb_pixel_total : 84946 time to create 1 rle with old method : 0.09811878204345703 time for calcul the mask position with numpy : 0.06083989143371582 nb_pixel_total : 20093 time to create 1 rle with old method : 0.02327442169189453 time for calcul the mask position with numpy : 0.06025552749633789 nb_pixel_total : 6616 time to create 1 rle with old method : 0.010044097900390625 time for calcul the mask position with numpy : 0.05732464790344238 nb_pixel_total : 37152 time to create 1 rle with old method : 0.04401111602783203 time for calcul the mask position with numpy : 0.057074785232543945 nb_pixel_total : 4086 time to create 1 rle with old method : 0.0045871734619140625 time for calcul the mask position with numpy : 0.05705738067626953 nb_pixel_total : 441 time to create 1 rle with old method : 0.0007083415985107422 time for calcul the mask position with numpy : 0.05679821968078613 nb_pixel_total : 35427 time to create 1 rle with old method : 0.04041004180908203 time for calcul the mask position with numpy : 0.0585942268371582 nb_pixel_total : 44981 time to create 1 rle with old method : 0.0499722957611084 time for calcul the mask position with numpy : 0.05973696708679199 nb_pixel_total : 28770 time to create 1 rle with old method : 0.0319209098815918 time for calcul the mask position with numpy : 0.06023287773132324 nb_pixel_total : 9810 time to create 1 rle with old method : 0.01103830337524414 time for calcul the mask position with numpy : 0.05757641792297363 nb_pixel_total : 141032 time to create 1 rle with old method : 0.1528167724609375 time for calcul the mask position with numpy : 0.05806469917297363 nb_pixel_total : 25157 time to create 1 rle with old method : 0.02786540985107422 time for calcul the mask position with numpy : 0.05693197250366211 nb_pixel_total : 33146 time to create 1 rle with old method : 0.03728771209716797 time for calcul the mask position with numpy : 0.05820107460021973 nb_pixel_total : 29759 time to create 1 rle with old method : 0.03306388854980469 time for calcul the mask position with numpy : 0.06004834175109863 nb_pixel_total : 42 time to create 1 rle with old method : 0.0002090930938720703 time for calcul the mask position with numpy : 0.056847572326660156 nb_pixel_total : 45769 time to create 1 rle with old method : 0.050985097885131836 time for calcul the mask position with numpy : 0.05715346336364746 nb_pixel_total : 1174 time to create 1 rle with old method : 0.0017840862274169922 time for calcul the mask position with numpy : 0.05859827995300293 nb_pixel_total : 75863 time to create 1 rle with old method : 0.0851583480834961 time for calcul the mask position with numpy : 0.059651851654052734 nb_pixel_total : 62494 time to create 1 rle with old method : 0.07979249954223633 time for calcul the mask position with numpy : 0.05987668037414551 nb_pixel_total : 51744 time to create 1 rle with old method : 0.05914425849914551 time for calcul the mask position with numpy : 0.05641913414001465 nb_pixel_total : 179 time to create 1 rle with old method : 0.00036787986755371094 time for calcul the mask position with numpy : 0.057274580001831055 nb_pixel_total : 11549 time to create 1 rle with old method : 0.013059854507446289 time for calcul the mask position with numpy : 0.05762457847595215 nb_pixel_total : 47640 time to create 1 rle with old method : 0.05274653434753418 time for calcul the mask position with numpy : 0.05788397789001465 nb_pixel_total : 164704 time to create 1 rle with new method : 0.5258305072784424 time for calcul the mask position with numpy : 0.05640268325805664 nb_pixel_total : 2809 time to create 1 rle with old method : 0.003589630126953125 time for calcul the mask position with numpy : 0.05687880516052246 nb_pixel_total : 74357 time to create 1 rle with old method : 0.08225774765014648 time for calcul the mask position with numpy : 0.05675530433654785 nb_pixel_total : 278 time to create 1 rle with old method : 0.0007357597351074219 time for calcul the mask position with numpy : 0.059361934661865234 nb_pixel_total : 220164 time to create 1 rle with new method : 0.6721181869506836 time for calcul the mask position with numpy : 0.05708050727844238 nb_pixel_total : 25251 time to create 1 rle with old method : 0.02913641929626465 time for calcul the mask position with numpy : 0.05852985382080078 nb_pixel_total : 22506 time to create 1 rle with old method : 0.028367996215820312 time for calcul the mask position with numpy : 0.0601651668548584 nb_pixel_total : 198 time to create 1 rle with old method : 0.00042176246643066406 time for calcul the mask position with numpy : 0.05894303321838379 nb_pixel_total : 15859 time to create 1 rle with old method : 0.018224716186523438 time for calcul the mask position with numpy : 0.05785393714904785 nb_pixel_total : 71898 time to create 1 rle with old method : 0.085723876953125 time for calcul the mask position with numpy : 0.056220054626464844 nb_pixel_total : 145 time to create 1 rle with old method : 0.00032329559326171875 time for calcul the mask position with numpy : 0.056705474853515625 nb_pixel_total : 18353 time to create 1 rle with old method : 0.021353483200073242 create new chi : 7.155574560165405 time to delete rle : 0.005999565124511719 batch 1 Loaded 95 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 26763 TO DO : save crop sub photo not yet done ! save time : 2.0060224533081055 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 7.07798957824707 time for calcul the mask position with numpy : 1.2112700939178467 nb_pixel_total : 6269165 time to create 1 rle with new method : 0.8600361347198486 time for calcul the mask position with numpy : 0.0634312629699707 nb_pixel_total : 360222 time to create 1 rle with new method : 1.580768346786499 time for calcul the mask position with numpy : 0.059034109115600586 nb_pixel_total : 39415 time to create 1 rle with old method : 0.04525494575500488 time for calcul the mask position with numpy : 0.05799436569213867 nb_pixel_total : 106486 time to create 1 rle with old method : 0.15269231796264648 time for calcul the mask position with numpy : 0.06752228736877441 nb_pixel_total : 955 time to create 1 rle with old method : 0.001895904541015625 time for calcul the mask position with numpy : 0.05859637260437012 nb_pixel_total : 78264 time to create 1 rle with old method : 0.09279227256774902 time for calcul the mask position with numpy : 0.05747652053833008 nb_pixel_total : 350 time to create 1 rle with old method : 0.0007550716400146484 time for calcul the mask position with numpy : 0.06301641464233398 nb_pixel_total : 168533 time to create 1 rle with new method : 1.1015279293060303 time for calcul the mask position with numpy : 0.06938815116882324 nb_pixel_total : 356147 time to create 1 rle with new method : 2.5247490406036377 time for calcul the mask position with numpy : 0.05535292625427246 nb_pixel_total : 428 time to create 1 rle with old method : 0.0011515617370605469 time for calcul the mask position with numpy : 0.0554196834564209 nb_pixel_total : 180651 time to create 1 rle with new method : 1.2993183135986328 time for calcul the mask position with numpy : 0.058580875396728516 nb_pixel_total : 79786 time to create 1 rle with old method : 0.09166431427001953 time for calcul the mask position with numpy : 0.0582425594329834 nb_pixel_total : 34964 time to create 1 rle with old method : 0.039216041564941406 time for calcul the mask position with numpy : 0.05864977836608887 nb_pixel_total : 93250 time to create 1 rle with old method : 0.13387775421142578 time for calcul the mask position with numpy : 0.059563636779785156 nb_pixel_total : 97357 time to create 1 rle with old method : 0.1142730712890625 time for calcul the mask position with numpy : 0.058362722396850586 nb_pixel_total : 49266 time to create 1 rle with old method : 0.05495810508728027 time for calcul the mask position with numpy : 0.05722522735595703 nb_pixel_total : 7304 time to create 1 rle with old method : 0.009351015090942383 time for calcul the mask position with numpy : 0.060144662857055664 nb_pixel_total : 26122 time to create 1 rle with old method : 0.0445559024810791 time for calcul the mask position with numpy : 0.06133532524108887 nb_pixel_total : 207287 time to create 1 rle with new method : 0.9995200634002686 time for calcul the mask position with numpy : 0.05715680122375488 nb_pixel_total : 1036 time to create 1 rle with old method : 0.0018162727355957031 time for calcul the mask position with numpy : 0.05750083923339844 nb_pixel_total : 25690 time to create 1 rle with old method : 0.029430150985717773 time for calcul the mask position with numpy : 0.05950212478637695 nb_pixel_total : 722 time to create 1 rle with old method : 0.0010724067687988281 time for calcul the mask position with numpy : 0.05706286430358887 nb_pixel_total : 20853 time to create 1 rle with old method : 0.023624897003173828 time for calcul the mask position with numpy : 0.059969425201416016 nb_pixel_total : 73458 time to create 1 rle with old method : 0.08115673065185547 time for calcul the mask position with numpy : 0.0598142147064209 nb_pixel_total : 738 time to create 1 rle with old method : 0.0015194416046142578 time for calcul the mask position with numpy : 0.059847354888916016 nb_pixel_total : 15951 time to create 1 rle with old method : 0.01833057403564453 create new chi : 12.226022958755493 time to delete rle : 0.005785226821899414 batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 21675 TO DO : save crop sub photo not yet done ! save time : 2.206545114517212 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 8.178778648376465 time for calcul the mask position with numpy : 0.5157055854797363 nb_pixel_total : 7845623 time to create 1 rle with new method : 0.8289382457733154 time for calcul the mask position with numpy : 0.07076215744018555 nb_pixel_total : 58554 time to create 1 rle with old method : 0.06709527969360352 time for calcul the mask position with numpy : 0.0673072338104248 nb_pixel_total : 19847 time to create 1 rle with old method : 0.03156232833862305 time for calcul the mask position with numpy : 0.07042050361633301 nb_pixel_total : 10106 time to create 1 rle with old method : 0.012094259262084961 time for calcul the mask position with numpy : 0.061244964599609375 nb_pixel_total : 113539 time to create 1 rle with old method : 0.12732720375061035 time for calcul the mask position with numpy : 0.06804060935974121 nb_pixel_total : 187299 time to create 1 rle with new method : 0.49545812606811523 time for calcul the mask position with numpy : 0.06713390350341797 nb_pixel_total : 40940 time to create 1 rle with old method : 0.0590205192565918 time for calcul the mask position with numpy : 0.07066512107849121 nb_pixel_total : 18492 time to create 1 rle with old method : 0.021251201629638672 create new chi : 2.716175079345703 time to delete rle : 0.0014069080352783203 batch 1 Loaded 16 chid ids of type : 3594 +++++++++++Number RLEs to save : 6521 TO DO : save crop sub photo not yet done ! save time : 0.44884634017944336 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 11.104925394058228 time for calcul the mask position with numpy : 0.66225266456604 nb_pixel_total : 6977935 time to create 1 rle with new method : 1.4894747734069824 time for calcul the mask position with numpy : 0.060639142990112305 nb_pixel_total : 12900 time to create 1 rle with old method : 0.016982555389404297 time for calcul the mask position with numpy : 0.0497438907623291 nb_pixel_total : 58928 time to create 1 rle with old method : 0.0926656723022461 time for calcul the mask position with numpy : 0.05213499069213867 nb_pixel_total : 18627 time to create 1 rle with old method : 0.021514177322387695 time for calcul the mask position with numpy : 0.054245948791503906 nb_pixel_total : 49405 time to create 1 rle with old method : 0.10374045372009277 time for calcul the mask position with numpy : 0.07283854484558105 nb_pixel_total : 55343 time to create 1 rle with old method : 0.06415390968322754 time for calcul the mask position with numpy : 0.07329797744750977 nb_pixel_total : 759149 time to create 1 rle with new method : 0.9121754169464111 time for calcul the mask position with numpy : 0.05820512771606445 nb_pixel_total : 57320 time to create 1 rle with old method : 0.06629133224487305 time for calcul the mask position with numpy : 0.058380126953125 nb_pixel_total : 4588 time to create 1 rle with old method : 0.005191802978515625 time for calcul the mask position with numpy : 0.051787614822387695 nb_pixel_total : 87200 time to create 1 rle with old method : 0.10631990432739258 time for calcul the mask position with numpy : 0.05665874481201172 nb_pixel_total : 18402 time to create 1 rle with old method : 0.025288820266723633 time for calcul the mask position with numpy : 0.06139349937438965 nb_pixel_total : 102649 time to create 1 rle with old method : 0.2859680652618408 time for calcul the mask position with numpy : 0.07075142860412598 nb_pixel_total : 91954 time to create 1 rle with old method : 0.13133907318115234 create new chi : 4.778741121292114 time to delete rle : 0.002476215362548828 batch 1 Loaded 28 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 12216 TO DO : save crop sub photo not yet done ! save time : 0.9514498710632324 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 10.312991380691528 time for calcul the mask position with numpy : 0.8614184856414795 nb_pixel_total : 7541305 time to create 1 rle with new method : 0.7993319034576416 time for calcul the mask position with numpy : 0.06507706642150879 nb_pixel_total : 19798 time to create 1 rle with old method : 0.021457195281982422 time for calcul the mask position with numpy : 0.06220555305480957 nb_pixel_total : 21721 time to create 1 rle with old method : 0.02409505844116211 time for calcul the mask position with numpy : 0.06657290458679199 nb_pixel_total : 321719 time to create 1 rle with new method : 1.4345734119415283 time for calcul the mask position with numpy : 0.06475615501403809 nb_pixel_total : 95747 time to create 1 rle with old method : 0.10382771492004395 time for calcul the mask position with numpy : 0.06332278251647949 nb_pixel_total : 115668 time to create 1 rle with old method : 0.12766432762145996 time for calcul the mask position with numpy : 0.06727790832519531 nb_pixel_total : 30469 time to create 1 rle with old method : 0.03454113006591797 time for calcul the mask position with numpy : 0.07093524932861328 nb_pixel_total : 11920 time to create 1 rle with old method : 0.013212919235229492 time for calcul the mask position with numpy : 0.07038736343383789 nb_pixel_total : 17292 time to create 1 rle with old method : 0.020247459411621094 time for calcul the mask position with numpy : 0.06287956237792969 nb_pixel_total : 35376 time to create 1 rle with old method : 0.043604135513305664 time for calcul the mask position with numpy : 0.061751604080200195 nb_pixel_total : 26328 time to create 1 rle with old method : 0.03203010559082031 time for calcul the mask position with numpy : 0.06497621536254883 nb_pixel_total : 57057 time to create 1 rle with old method : 0.07425713539123535 create new chi : 4.384036064147949 time to delete rle : 0.002218961715698242 batch 1 Loaded 24 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8722 TO DO : save crop sub photo not yet done ! save time : 0.8311200141906738 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 6.107582092285156 time for calcul the mask position with numpy : 0.3950197696685791 nb_pixel_total : 5432471 time to create 1 rle with new method : 0.8051795959472656 time for calcul the mask position with numpy : 0.0742788314819336 nb_pixel_total : 107551 time to create 1 rle with old method : 0.5552551746368408 time for calcul the mask position with numpy : 0.07063078880310059 nb_pixel_total : 4540 time to create 1 rle with old method : 0.009293556213378906 time for calcul the mask position with numpy : 0.08060956001281738 nb_pixel_total : 82659 time to create 1 rle with old method : 0.15049195289611816 time for calcul the mask position with numpy : 0.07983708381652832 nb_pixel_total : 23574 time to create 1 rle with old method : 0.04249906539916992 time for calcul the mask position with numpy : 0.06854939460754395 nb_pixel_total : 22079 time to create 1 rle with old method : 0.04027581214904785 time for calcul the mask position with numpy : 0.07915997505187988 nb_pixel_total : 613949 time to create 1 rle with new method : 1.9361987113952637 time for calcul the mask position with numpy : 0.06463861465454102 nb_pixel_total : 217906 time to create 1 rle with new method : 1.3389642238616943 time for calcul the mask position with numpy : 0.057759761810302734 nb_pixel_total : 61375 time to create 1 rle with old method : 0.07105636596679688 time for calcul the mask position with numpy : 0.05732107162475586 nb_pixel_total : 41056 time to create 1 rle with old method : 0.045594215393066406 time for calcul the mask position with numpy : 0.05750441551208496 nb_pixel_total : 21218 time to create 1 rle with old method : 0.02403736114501953 time for calcul the mask position with numpy : 0.05822610855102539 nb_pixel_total : 23128 time to create 1 rle with old method : 0.025629758834838867 time for calcul the mask position with numpy : 0.05709099769592285 nb_pixel_total : 37642 time to create 1 rle with old method : 0.04200315475463867 time for calcul the mask position with numpy : 0.05826425552368164 nb_pixel_total : 40134 time to create 1 rle with old method : 0.044189453125 time for calcul the mask position with numpy : 0.058426856994628906 nb_pixel_total : 27994 time to create 1 rle with old method : 0.0314176082611084 time for calcul the mask position with numpy : 0.057756662368774414 nb_pixel_total : 121362 time to create 1 rle with old method : 0.13415241241455078 time for calcul the mask position with numpy : 0.05710196495056152 nb_pixel_total : 18378 time to create 1 rle with old method : 0.020296573638916016 time for calcul the mask position with numpy : 0.056967735290527344 nb_pixel_total : 16791 time to create 1 rle with old method : 0.01879596710205078 time for calcul the mask position with numpy : 0.07127070426940918 nb_pixel_total : 960351 time to create 1 rle with new method : 0.6839299201965332 time for calcul the mask position with numpy : 0.057294368743896484 nb_pixel_total : 8950 time to create 1 rle with old method : 0.011377573013305664 time for calcul the mask position with numpy : 0.05928850173950195 nb_pixel_total : 184861 time to create 1 rle with new method : 0.8137500286102295 time for calcul the mask position with numpy : 0.06194806098937988 nb_pixel_total : 73546 time to create 1 rle with old method : 0.0869300365447998 time for calcul the mask position with numpy : 0.05785560607910156 nb_pixel_total : 86203 time to create 1 rle with old method : 0.09710550308227539 time for calcul the mask position with numpy : 0.05919337272644043 nb_pixel_total : 66682 time to create 1 rle with old method : 0.10097551345825195 create new chi : 9.159493923187256 time to delete rle : 0.0055141448974609375 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 22351 TO DO : save crop sub photo not yet done ! save time : 1.795299768447876 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 5.156756401062012 time for calcul the mask position with numpy : 1.267704725265503 nb_pixel_total : 6522893 time to create 1 rle with new method : 0.9615705013275146 time for calcul the mask position with numpy : 0.06715965270996094 nb_pixel_total : 100880 time to create 1 rle with old method : 0.16044211387634277 time for calcul the mask position with numpy : 0.06295490264892578 nb_pixel_total : 72886 time to create 1 rle with old method : 0.08200263977050781 time for calcul the mask position with numpy : 0.058994293212890625 nb_pixel_total : 51319 time to create 1 rle with old method : 0.05822134017944336 time for calcul the mask position with numpy : 0.05760979652404785 nb_pixel_total : 23927 time to create 1 rle with old method : 0.027728796005249023 time for calcul the mask position with numpy : 0.05942893028259277 nb_pixel_total : 57125 time to create 1 rle with old method : 0.06720805168151855 time for calcul the mask position with numpy : 0.05796360969543457 nb_pixel_total : 148173 time to create 1 rle with old method : 0.1908257007598877 time for calcul the mask position with numpy : 0.05969977378845215 nb_pixel_total : 227280 time to create 1 rle with new method : 1.7699191570281982 time for calcul the mask position with numpy : 0.06464815139770508 nb_pixel_total : 81691 time to create 1 rle with old method : 0.10091876983642578 time for calcul the mask position with numpy : 0.057784080505371094 nb_pixel_total : 52766 time to create 1 rle with old method : 0.06269407272338867 time for calcul the mask position with numpy : 0.057474374771118164 nb_pixel_total : 25489 time to create 1 rle with old method : 0.030799150466918945 time for calcul the mask position with numpy : 0.06080746650695801 nb_pixel_total : 19354 time to create 1 rle with old method : 0.02619171142578125 time for calcul the mask position with numpy : 0.05953073501586914 nb_pixel_total : 134234 time to create 1 rle with old method : 0.1559584140777588 time for calcul the mask position with numpy : 0.058805227279663086 nb_pixel_total : 98644 time to create 1 rle with old method : 0.11399269104003906 time for calcul the mask position with numpy : 0.06034731864929199 nb_pixel_total : 286859 time to create 1 rle with new method : 0.41272521018981934 time for calcul the mask position with numpy : 0.05796098709106445 nb_pixel_total : 12801 time to create 1 rle with old method : 0.018163681030273438 time for calcul the mask position with numpy : 0.06210613250732422 nb_pixel_total : 29726 time to create 1 rle with old method : 0.03685259819030762 time for calcul the mask position with numpy : 0.058363914489746094 nb_pixel_total : 87906 time to create 1 rle with old method : 0.09688663482666016 time for calcul the mask position with numpy : 0.05840563774108887 nb_pixel_total : 128999 time to create 1 rle with old method : 0.14661407470703125 time for calcul the mask position with numpy : 0.05828142166137695 nb_pixel_total : 58853 time to create 1 rle with old method : 0.07323431968688965 time for calcul the mask position with numpy : 0.05872511863708496 nb_pixel_total : 59372 time to create 1 rle with old method : 0.06889724731445312 time for calcul the mask position with numpy : 0.05785512924194336 nb_pixel_total : 13223 time to create 1 rle with old method : 0.014892339706420898 create new chi : 7.31403112411499 time to delete rle : 0.0040247440338134766 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 19366 TO DO : save crop sub photo not yet done ! save time : 1.5170629024505615 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 5.275737524032593 time for calcul the mask position with numpy : 0.31010937690734863 nb_pixel_total : 6925997 time to create 1 rle with new method : 0.7688658237457275 time for calcul the mask position with numpy : 0.05970263481140137 nb_pixel_total : 50883 time to create 1 rle with old method : 0.06421446800231934 time for calcul the mask position with numpy : 0.06307005882263184 nb_pixel_total : 196194 time to create 1 rle with new method : 0.8192143440246582 time for calcul the mask position with numpy : 0.06192517280578613 nb_pixel_total : 145625 time to create 1 rle with old method : 0.21240234375 time for calcul the mask position with numpy : 0.06038093566894531 nb_pixel_total : 176474 time to create 1 rle with new method : 1.2750530242919922 time for calcul the mask position with numpy : 0.058699607849121094 nb_pixel_total : 581 time to create 1 rle with old method : 0.0012934207916259766 time for calcul the mask position with numpy : 0.057820796966552734 nb_pixel_total : 53921 time to create 1 rle with old method : 0.08828401565551758 time for calcul the mask position with numpy : 0.06483936309814453 nb_pixel_total : 224396 time to create 1 rle with new method : 0.764052152633667 time for calcul the mask position with numpy : 0.06262683868408203 nb_pixel_total : 234495 time to create 1 rle with new method : 0.5145766735076904 time for calcul the mask position with numpy : 0.05733466148376465 nb_pixel_total : 45424 time to create 1 rle with old method : 0.05363774299621582 time for calcul the mask position with numpy : 0.05985832214355469 nb_pixel_total : 99597 time to create 1 rle with old method : 0.11520004272460938 time for calcul the mask position with numpy : 0.05921626091003418 nb_pixel_total : 275 time to create 1 rle with old method : 0.0005788803100585938 time for calcul the mask position with numpy : 0.05835533142089844 nb_pixel_total : 56540 time to create 1 rle with old method : 0.07132196426391602 time for calcul the mask position with numpy : 0.058098793029785156 nb_pixel_total : 36315 time to create 1 rle with old method : 0.04419994354248047 time for calcul the mask position with numpy : 0.05924797058105469 nb_pixel_total : 22294 time to create 1 rle with old method : 0.025681495666503906 time for calcul the mask position with numpy : 0.05968880653381348 nb_pixel_total : 25389 time to create 1 rle with old method : 0.029254913330078125 create new chi : 6.236431360244751 time to delete rle : 0.002834796905517578 batch 1 Loaded 34 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 14457 TO DO : save crop sub photo not yet done ! save time : 1.026404857635498 map_output_result : {1327687728: (0.0, 'Should be the crop_list due to order', 0), 1327687726: (0.0, 'Should be the crop_list due to order', 0), 1327687723: (0.0, 'Should be the crop_list due to order', 0), 1327687711: (0.0, 'Should be the crop_list due to order', 0), 1327687709: (0.0, 'Should be the crop_list due to order', 0), 1327687705: (0.0, 'Should be the crop_list due to order', 0), 1327687703: (0.0, 'Should be the crop_list due to order', 0), 1327687700: (0.0, 'Should be the crop_list due to order', 0), 1327687697: (0.0, 'Should be the crop_list due to order', 0), 1327687696: (0.0, 'Should be the crop_list due to order', 0), 1327687690: (0.0, 'Should be the crop_list due to order', 0), 1327687686: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1327687728, 1327687726, 1327687723, 1327687711, 1327687709, 1327687705, 1327687703, 1327687700, 1327687697, 1327687696, 1327687690, 1327687686] Looping around the photos to save general results len do output : 12 /1327687728.Didn't retrieve data . /1327687726.Didn't retrieve data . /1327687723.Didn't retrieve data . /1327687711.Didn't retrieve data . /1327687709.Didn't retrieve data . /1327687705.Didn't retrieve data . /1327687703.Didn't retrieve data . /1327687700.Didn't retrieve data . /1327687697.Didn't retrieve data . /1327687696.Didn't retrieve data . /1327687690.Didn't retrieve data . /1327687686.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687728', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687726', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687723', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687711', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687709', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687705', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687703', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687700', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687697', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687696', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687690', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687686', None, None, None, None, None, '2647412') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.014063596725463867 save_final save missing photos in datou_result : time spend for datou_step_exec : 205.0770766735077 time spend to save output : 0.018207311630249023 total time spend for step 3 : 205.09528398513794 step4:ventilate_hashtags_in_portfolio Fri Mar 7 09:31:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21136630 get user id for portfolio 21136630 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136630 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','metal','flou','autre','carton','mal_croppe','background','pehd','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136630 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','metal','flou','autre','carton','mal_croppe','background','pehd','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136630 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','metal','flou','autre','carton','mal_croppe','background','pehd','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/21137645,21137646,21137647,21137648,21137649,21137650,21137651,21137652,21137653,21137654,21137655?tags=papier,pet_fonce,metal,flou,autre,carton,mal_croppe,background,pehd,environnement,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1327687728, 1327687726, 1327687723, 1327687711, 1327687709, 1327687705, 1327687703, 1327687700, 1327687697, 1327687696, 1327687690, 1327687686] Looping around the photos to save general results len do output : 1 /21136630. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687728', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687726', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687723', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687711', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687709', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687705', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687703', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687700', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687697', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687696', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687690', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687686', None, None, None, None, None, '2647412') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.014442920684814453 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.9978225231170654 time spend to save output : 0.014710426330566406 total time spend for step 4 : 1.0125329494476318 step5:final Fri Mar 7 09:31:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1327687728: ('0.21043726289223244',), 1327687726: ('0.21043726289223244',), 1327687723: ('0.21043726289223244',), 1327687711: ('0.21043726289223244',), 1327687709: ('0.21043726289223244',), 1327687705: ('0.21043726289223244',), 1327687703: ('0.21043726289223244',), 1327687700: ('0.21043726289223244',), 1327687697: ('0.21043726289223244',), 1327687696: ('0.21043726289223244',), 1327687690: ('0.21043726289223244',), 1327687686: ('0.21043726289223244',)} new output for save of step final : {1327687728: ('0.21043726289223244',), 1327687726: ('0.21043726289223244',), 1327687723: ('0.21043726289223244',), 1327687711: ('0.21043726289223244',), 1327687709: ('0.21043726289223244',), 1327687705: ('0.21043726289223244',), 1327687703: ('0.21043726289223244',), 1327687700: ('0.21043726289223244',), 1327687697: ('0.21043726289223244',), 1327687696: ('0.21043726289223244',), 1327687690: ('0.21043726289223244',), 1327687686: ('0.21043726289223244',)} [1327687728, 1327687726, 1327687723, 1327687711, 1327687709, 1327687705, 1327687703, 1327687700, 1327687697, 1327687696, 1327687690, 1327687686] Looping around the photos to save general results len do output : 12 /1327687728.Didn't retrieve data . /1327687726.Didn't retrieve data . /1327687723.Didn't retrieve data . /1327687711.Didn't retrieve data . /1327687709.Didn't retrieve data . /1327687705.Didn't retrieve data . /1327687703.Didn't retrieve data . /1327687700.Didn't retrieve data . /1327687697.Didn't retrieve data . /1327687696.Didn't retrieve data . /1327687690.Didn't retrieve data . /1327687686.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687728', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687726', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687723', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687711', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687709', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687705', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687703', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687700', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687697', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687696', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687690', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687686', None, None, None, None, None, '2647412') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.013341665267944336 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11124014854431152 time spend to save output : 0.014026641845703125 total time spend for step 5 : 0.12526679039001465 step6:blur_detection Fri Mar 7 09:31:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 12 time used for this insertion : 0.010332584381103516 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 12 time used for this insertion : 0.009123802185058594 save missing photos in datou_result : time spend for datou_step_exec : 0.23006844520568848 time spend to save output : 0.02371048927307129 total time spend for step 6 : 0.25377893447875977 step7:brightness Fri Mar 7 09:31:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 12 time used for this insertion : 0.009573221206665039 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 12 time used for this insertion : 0.009005069732666016 save missing photos in datou_result : time spend for datou_step_exec : 0.09151744842529297 time spend to save output : 0.02329540252685547 total time spend for step 7 : 0.11481285095214844 step8:velours_tree Fri Mar 7 09:31:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.23017358779907227 time spend to save output : 5.0067901611328125e-05 total time spend for step 8 : 0.2302236557006836 step9:send_mail_cod Fri Mar 7 09:31:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21136630_07-03-2025_09_31_05.pdf 21137645 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211376451741336265 21137646 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211376461741336267 21137647 imagette211376471741336268 21137648 imagette211376481741336268 21137649 imagette211376491741336268 21137650 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211376501741336268 21137651 imagette211376511741336269 21137652 imagette211376521741336269 21137653 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211376531741336269 21137655 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211376551741336272 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21136630 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21137645,21137646,21137647,21137648,21137649,21137650,21137651,21137652,21137653,21137654,21137655?tags=papier,pet_fonce,metal,flou,autre,carton,mal_croppe,background,pehd,environnement,pet_clair args[1327687728] : ((1327687728, -5.974261049299777, 492609224), (1327687728, -0.08071733582607635, 496442774), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687726] : ((1327687726, -5.8314790708648845, 492609224), (1327687726, 0.0800690824037758, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687723] : ((1327687723, -5.255776039828796, 492609224), (1327687723, 0.1573289289751639, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687711] : ((1327687711, -5.362075288360276, 492609224), (1327687711, 0.2622513171108674, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687709] : ((1327687709, -6.052419325849385, 492609224), (1327687709, 0.20302584152468187, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687705] : ((1327687705, -5.275646667310091, 492609224), (1327687705, 0.24369502632667187, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687703] : ((1327687703, -5.1150927229605605, 492609224), (1327687703, -0.15447552467685308, 496442774), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687700] : ((1327687700, -5.35353705133269, 492609224), (1327687700, 0.1827265064778925, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687697] : ((1327687697, -5.217502700899897, 492609224), (1327687697, 0.018683298598333904, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687696] : ((1327687696, -5.351740757250596, 492609224), (1327687696, 0.08009080296822935, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687690] : ((1327687690, -5.5022672039871185, 492609224), (1327687690, -0.1680068651439287, 496442774), '0.21043726289223244') We are sending mail with results at report@fotonower.com args[1327687686] : ((1327687686, -5.290094453895452, 492609224), (1327687686, 0.029529217692271834, 2107752395), '0.21043726289223244') We are sending mail with results at report@fotonower.com refus_total : 0.21043726289223244 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21136630 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136630_07-03-2025_09_31_05.pdf results_Auto_P21136630_07-03-2025_09_31_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136630_07-03-2025_09_31_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','21136630','results_Auto_P21136630_07-03-2025_09_31_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136630_07-03-2025_09_31_05.pdf','pdf','','1.38','0.21043726289223244') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/21136630

https://www.fotonower.com/image?json=false&list_photos_id=1327687728
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687726
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687723
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687711
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687709
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687705
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687703
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687700
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687697
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687696
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687690
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1327687686
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 21.04%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/21137645?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/21137646?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/21137650?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/21137653?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/21137655?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136630_07-03-2025_09_31_05.pdf.

Lien vers velours :https://www.fotonower.com/velours/21137645,21137646,21137647,21137648,21137649,21137650,21137651,21137652,21137653,21137654,21137655?tags=papier,pet_fonce,metal,flou,autre,carton,mal_croppe,background,pehd,environnement,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 07 Mar 2025 08:31:19 GMT Content-Length: 0 Connection: close X-Message-Id: PDIYjE-hTrulGy85p7WTrA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1327687728, 1327687726, 1327687723, 1327687711, 1327687709, 1327687705, 1327687703, 1327687700, 1327687697, 1327687696, 1327687690, 1327687686] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687728', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687726', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687723', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687711', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687709', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687705', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687703', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687700', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687697', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687696', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687690', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687686', None, None, None, None, None, '2647412') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01449131965637207 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.033406257629395 time spend to save output : 0.014913558959960938 total time spend for step 9 : 14.048319816589355 step10:split_time_score Fri Mar 7 09:31:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 09012025 21136630 Nombre de photos uploadées : 12 / 23040 (0%) 09012025 21136630 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 09012025 21136630 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 6.9141387939453125e-06 elapsed_time : order_list_meta_photo_and_scores 1.71661376953125e-05 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008308887481689453 elapsed_time : insert_dashboard_record_day_entry 0.023746728897094727 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.035256224334702845 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136549_07-03-2025_08_49_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136549 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136549 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136550 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136560 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136567 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136572 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136574 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136576 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136578 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136581 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136582 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136584 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136586 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136589 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136592 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136594 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136598 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136599 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136601 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136603 order by id desc limit 1 Qualite : 0.2611221579562976 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136604_07-03-2025_08_59_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136604 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136604 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136606 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136608 order by id desc limit 1 Qualite : 0.1896752411517101 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136611_07-03-2025_08_59_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136611 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136617 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136618 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136619 order by id desc limit 1 Qualite : 0.18365381514099943 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136620_07-03-2025_08_53_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136620 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136620 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136621 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136624 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136628 order by id desc limit 1 Qualite : 0.21043726289223244 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136630_07-03-2025_09_31_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136630 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136630 AND mptpi.`type`=3594 To do Qualite : 0.19457695855034723 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136633_07-03-2025_09_18_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136633 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136633 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136639 order by id desc limit 1 Qualite : 0.1498098851165981 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21136640_07-03-2025_09_05_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21136640 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21136640 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'09012025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1327687728, 1327687726, 1327687723, 1327687711, 1327687709, 1327687705, 1327687703, 1327687700, 1327687697, 1327687696, 1327687690, 1327687686] Looping around the photos to save general results len do output : 1 /21136630Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687728', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687726', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687723', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687711', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687709', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687705', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687703', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687700', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687697', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687696', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687690', None, None, None, None, None, '2647412') ('3318', None, None, None, None, None, None, None, '2647412') ('3318', '21136630', '1327687686', None, None, None, None, None, '2647412') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.014172554016113281 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.2645366191864 time spend to save output : 0.014426231384277344 total time spend for step 10 : 23.27896285057068 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 270.78user 186.49system 11:16.84elapsed 67%CPU (0avgtext+0avgdata 6264396maxresident)k 383488inputs+377104outputs (18503major+24041484minor)pagefaults 0swaps