python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 999069 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2580753'] with mtr_portfolio_ids : ['20492275'] and first list_photo_ids : [] new path : /proc/999069/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.7990868091583252 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Feb 12 21:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3346 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-12 21:40:33.652252: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-12 21:40:33.679362: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-12 21:40:33.681521: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1cdc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-12 21:40:33.681582: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-12 21:40:33.685957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-12 21:40:33.912539: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x350b9570 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-12 21:40:33.912602: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-12 21:40:33.913664: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 21:40:33.914103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 21:40:33.917390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 21:40:33.920262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 21:40:33.920635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 21:40:33.923318: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 21:40:33.924630: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 21:40:33.929562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 21:40:33.930624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 21:40:33.930697: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 21:40:33.931287: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-12 21:40:33.931305: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-12 21:40:33.931315: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-12 21:40:33.932223: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2894 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-12 21:40:34.210561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 21:40:34.210679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 21:40:34.210701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 21:40:34.210721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 21:40:34.210739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 21:40:34.210757: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 21:40:34.210775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 21:40:34.210793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 21:40:34.211784: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 21:40:34.212848: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 21:40:34.212884: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 21:40:34.212903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 21:40:34.212920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 21:40:34.212937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 21:40:34.212954: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 21:40:34.212971: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 21:40:34.212988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 21:40:34.213948: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 21:40:34.213987: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-12 21:40:34.213998: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-12 21:40:34.214007: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-12 21:40:34.215057: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2894 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-12 21:40:42.971494: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 21:40:43.150002: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 21:40:44.462932: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.751352: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-12 21:40:44.805885: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.805942: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.807387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.807420: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.810077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.810109: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.811204: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.811234: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.836298: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.836322: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 564.38MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.836948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.836963: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 564.38MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.838529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.838547: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 290.15MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.839191: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.839208: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 290.15MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.844492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.844510: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.845091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.845105: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-12 21:40:44.846798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.847482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.852989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.853574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.855145: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.855788: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.881657: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.882304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.882951: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.883594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.887159: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.887807: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.903036: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.903683: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.904321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.904959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.917160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.917805: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.918444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.919099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.923508: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.924154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.928876: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.929520: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.941810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.942592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.946795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.947480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.948123: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.948761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.949541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.950186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.960727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.961380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.962033: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.962680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.963343: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.963985: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.978957: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:44.979604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.006826: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.006869: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-12 21:40:45.007954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.009034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.016308: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.016958: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.017620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.018272: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.026197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.026855: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.043677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.044419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.045081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.045739: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.049829: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.050515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.051200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.051870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.052897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.063082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.063755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.072922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.073604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.074280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.074973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.075664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-12 21:40:45.076323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.33G (2499674112 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 48 Detection mask done ! Trying to reset tf kernel 999604 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1354 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2153 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0015728473663330078 nb_pixel_total : 41318 time to create 1 rle with old method : 0.04987359046936035 length of segment : 224 time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 25167 time to create 1 rle with old method : 0.028483152389526367 length of segment : 162 time for calcul the mask position with numpy : 0.0007941722869873047 nb_pixel_total : 37575 time to create 1 rle with old method : 0.04069089889526367 length of segment : 291 time for calcul the mask position with numpy : 0.004352092742919922 nb_pixel_total : 178738 time to create 1 rle with new method : 0.00940704345703125 length of segment : 271 time for calcul the mask position with numpy : 0.0006740093231201172 nb_pixel_total : 29189 time to create 1 rle with old method : 0.03375124931335449 length of segment : 247 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 8867 time to create 1 rle with old method : 0.01024317741394043 length of segment : 93 time for calcul the mask position with numpy : 0.00054168701171875 nb_pixel_total : 18904 time to create 1 rle with old method : 0.02130889892578125 length of segment : 168 time for calcul the mask position with numpy : 0.00020194053649902344 nb_pixel_total : 10321 time to create 1 rle with old method : 0.012148380279541016 length of segment : 115 time for calcul the mask position with numpy : 0.003549814224243164 nb_pixel_total : 173642 time to create 1 rle with new method : 0.013260841369628906 length of segment : 468 time for calcul the mask position with numpy : 0.0006034374237060547 nb_pixel_total : 23464 time to create 1 rle with old method : 0.027110815048217773 length of segment : 202 time for calcul the mask position with numpy : 0.0005536079406738281 nb_pixel_total : 17188 time to create 1 rle with old method : 0.019950389862060547 length of segment : 148 time for calcul the mask position with numpy : 0.0012285709381103516 nb_pixel_total : 45344 time to create 1 rle with old method : 0.05489206314086914 length of segment : 262 time for calcul the mask position with numpy : 0.0004055500030517578 nb_pixel_total : 15618 time to create 1 rle with old method : 0.019857406616210938 length of segment : 169 time for calcul the mask position with numpy : 0.0017490386962890625 nb_pixel_total : 76282 time to create 1 rle with old method : 0.09575843811035156 length of segment : 378 time for calcul the mask position with numpy : 0.0004818439483642578 nb_pixel_total : 21218 time to create 1 rle with old method : 0.02424001693725586 length of segment : 192 time for calcul the mask position with numpy : 0.0010495185852050781 nb_pixel_total : 31446 time to create 1 rle with old method : 0.0371851921081543 length of segment : 494 time for calcul the mask position with numpy : 0.0004477500915527344 nb_pixel_total : 21490 time to create 1 rle with old method : 0.025249481201171875 length of segment : 120 time for calcul the mask position with numpy : 0.0005557537078857422 nb_pixel_total : 23756 time to create 1 rle with old method : 0.028655290603637695 length of segment : 169 time for calcul the mask position with numpy : 0.0005888938903808594 nb_pixel_total : 28360 time to create 1 rle with old method : 0.033969879150390625 length of segment : 194 time for calcul the mask position with numpy : 0.000469207763671875 nb_pixel_total : 26476 time to create 1 rle with old method : 0.03324770927429199 length of segment : 167 time for calcul the mask position with numpy : 0.00031113624572753906 nb_pixel_total : 11905 time to create 1 rle with old method : 0.013920068740844727 length of segment : 107 time for calcul the mask position with numpy : 0.0009925365447998047 nb_pixel_total : 45859 time to create 1 rle with old method : 0.05727124214172363 length of segment : 263 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 11035 time to create 1 rle with old method : 0.013008594512939453 length of segment : 83 time for calcul the mask position with numpy : 0.0015017986297607422 nb_pixel_total : 64726 time to create 1 rle with old method : 0.07119512557983398 length of segment : 609 time for calcul the mask position with numpy : 0.0007593631744384766 nb_pixel_total : 29201 time to create 1 rle with old method : 0.03516554832458496 length of segment : 226 time for calcul the mask position with numpy : 0.0015463829040527344 nb_pixel_total : 30824 time to create 1 rle with old method : 0.036917686462402344 length of segment : 427 time for calcul the mask position with numpy : 0.00042510032653808594 nb_pixel_total : 18097 time to create 1 rle with old method : 0.022193431854248047 length of segment : 133 time for calcul the mask position with numpy : 0.0008857250213623047 nb_pixel_total : 43774 time to create 1 rle with old method : 0.05604815483093262 length of segment : 278 time for calcul the mask position with numpy : 0.0002911090850830078 nb_pixel_total : 9828 time to create 1 rle with old method : 0.01207590103149414 length of segment : 141 time for calcul the mask position with numpy : 0.0005252361297607422 nb_pixel_total : 31370 time to create 1 rle with old method : 0.0374913215637207 length of segment : 179 time for calcul the mask position with numpy : 0.000583648681640625 nb_pixel_total : 26952 time to create 1 rle with old method : 0.03284859657287598 length of segment : 129 time for calcul the mask position with numpy : 0.0063703060150146484 nb_pixel_total : 94556 time to create 1 rle with old method : 0.11440134048461914 length of segment : 491 time for calcul the mask position with numpy : 0.0016942024230957031 nb_pixel_total : 78835 time to create 1 rle with old method : 0.09449124336242676 length of segment : 402 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 13207 time to create 1 rle with old method : 0.014952898025512695 length of segment : 195 time for calcul the mask position with numpy : 0.0006518363952636719 nb_pixel_total : 28022 time to create 1 rle with old method : 0.03171348571777344 length of segment : 168 time for calcul the mask position with numpy : 0.0006616115570068359 nb_pixel_total : 29327 time to create 1 rle with old method : 0.032988786697387695 length of segment : 186 time for calcul the mask position with numpy : 0.0011320114135742188 nb_pixel_total : 24695 time to create 1 rle with old method : 0.028171539306640625 length of segment : 262 time for calcul the mask position with numpy : 0.0006756782531738281 nb_pixel_total : 9424 time to create 1 rle with old method : 0.01119375228881836 length of segment : 144 time for calcul the mask position with numpy : 0.0008988380432128906 nb_pixel_total : 15300 time to create 1 rle with old method : 0.021729707717895508 length of segment : 166 time for calcul the mask position with numpy : 0.0017223358154296875 nb_pixel_total : 33653 time to create 1 rle with old method : 0.03864741325378418 length of segment : 213 time for calcul the mask position with numpy : 0.0014600753784179688 nb_pixel_total : 43045 time to create 1 rle with old method : 0.059121131896972656 length of segment : 215 time for calcul the mask position with numpy : 0.0008833408355712891 nb_pixel_total : 20364 time to create 1 rle with old method : 0.023990869522094727 length of segment : 211 time for calcul the mask position with numpy : 0.0018515586853027344 nb_pixel_total : 29445 time to create 1 rle with old method : 0.032877445220947266 length of segment : 253 time for calcul the mask position with numpy : 0.0017251968383789062 nb_pixel_total : 42804 time to create 1 rle with old method : 0.05091691017150879 length of segment : 160 time for calcul the mask position with numpy : 0.0006432533264160156 nb_pixel_total : 10204 time to create 1 rle with old method : 0.012424468994140625 length of segment : 91 time for calcul the mask position with numpy : 0.0028162002563476562 nb_pixel_total : 55983 time to create 1 rle with old method : 0.06456708908081055 length of segment : 333 time for calcul the mask position with numpy : 0.0022096633911132812 nb_pixel_total : 44079 time to create 1 rle with old method : 0.0528717041015625 length of segment : 250 time for calcul the mask position with numpy : 0.002025127410888672 nb_pixel_total : 29864 time to create 1 rle with old method : 0.045060157775878906 length of segment : 247 time for calcul the mask position with numpy : 0.007295846939086914 nb_pixel_total : 120415 time to create 1 rle with old method : 0.13253092765808105 length of segment : 672 time for calcul the mask position with numpy : 0.0005741119384765625 nb_pixel_total : 4521 time to create 1 rle with old method : 0.005301237106323242 length of segment : 115 time for calcul the mask position with numpy : 0.0011334419250488281 nb_pixel_total : 22569 time to create 1 rle with old method : 0.02698826789855957 length of segment : 293 time for calcul the mask position with numpy : 0.0021207332611083984 nb_pixel_total : 37737 time to create 1 rle with old method : 0.04286527633666992 length of segment : 367 time for calcul the mask position with numpy : 0.0010142326354980469 nb_pixel_total : 17774 time to create 1 rle with old method : 0.02066326141357422 length of segment : 184 time for calcul the mask position with numpy : 0.0014636516571044922 nb_pixel_total : 19068 time to create 1 rle with old method : 0.02160358428955078 length of segment : 194 time for calcul the mask position with numpy : 0.005587339401245117 nb_pixel_total : 113364 time to create 1 rle with old method : 0.12622714042663574 length of segment : 491 time for calcul the mask position with numpy : 0.0008108615875244141 nb_pixel_total : 13469 time to create 1 rle with old method : 0.01553797721862793 length of segment : 139 time for calcul the mask position with numpy : 0.0035543441772460938 nb_pixel_total : 68263 time to create 1 rle with old method : 0.07525515556335449 length of segment : 365 time for calcul the mask position with numpy : 0.0004799365997314453 nb_pixel_total : 5940 time to create 1 rle with old method : 0.007172822952270508 length of segment : 126 time for calcul the mask position with numpy : 0.0015211105346679688 nb_pixel_total : 44803 time to create 1 rle with old method : 0.05154681205749512 length of segment : 147 time for calcul the mask position with numpy : 0.0009698867797851562 nb_pixel_total : 14222 time to create 1 rle with old method : 0.016533613204956055 length of segment : 210 time for calcul the mask position with numpy : 0.006841897964477539 nb_pixel_total : 112500 time to create 1 rle with old method : 0.12465953826904297 length of segment : 413 time for calcul the mask position with numpy : 0.0035593509674072266 nb_pixel_total : 74120 time to create 1 rle with old method : 0.08444333076477051 length of segment : 267 time for calcul the mask position with numpy : 0.002887248992919922 nb_pixel_total : 55770 time to create 1 rle with old method : 0.06293034553527832 length of segment : 315 time for calcul the mask position with numpy : 0.004297018051147461 nb_pixel_total : 35948 time to create 1 rle with old method : 0.04081392288208008 length of segment : 551 time for calcul the mask position with numpy : 0.0023980140686035156 nb_pixel_total : 51047 time to create 1 rle with old method : 0.057207584381103516 length of segment : 398 time for calcul the mask position with numpy : 0.0015094280242919922 nb_pixel_total : 32406 time to create 1 rle with old method : 0.03721451759338379 length of segment : 202 time for calcul the mask position with numpy : 0.003887176513671875 nb_pixel_total : 83437 time to create 1 rle with old method : 0.10464715957641602 length of segment : 347 time for calcul the mask position with numpy : 0.0006732940673828125 nb_pixel_total : 20395 time to create 1 rle with old method : 0.023370981216430664 length of segment : 175 time for calcul the mask position with numpy : 0.0011172294616699219 nb_pixel_total : 20300 time to create 1 rle with old method : 0.023360729217529297 length of segment : 187 time for calcul the mask position with numpy : 0.0015530586242675781 nb_pixel_total : 30827 time to create 1 rle with old method : 0.03378105163574219 length of segment : 246 time for calcul the mask position with numpy : 0.0041043758392333984 nb_pixel_total : 83081 time to create 1 rle with old method : 0.09178686141967773 length of segment : 446 time for calcul the mask position with numpy : 0.0012197494506835938 nb_pixel_total : 28174 time to create 1 rle with old method : 0.03571438789367676 length of segment : 164 time for calcul the mask position with numpy : 0.0008015632629394531 nb_pixel_total : 12476 time to create 1 rle with old method : 0.015233039855957031 length of segment : 114 time for calcul the mask position with numpy : 0.0037429332733154297 nb_pixel_total : 67627 time to create 1 rle with old method : 0.11482715606689453 length of segment : 298 time for calcul the mask position with numpy : 0.00144195556640625 nb_pixel_total : 27300 time to create 1 rle with old method : 0.041391611099243164 length of segment : 229 time for calcul the mask position with numpy : 0.001285552978515625 nb_pixel_total : 21174 time to create 1 rle with old method : 0.033944129943847656 length of segment : 183 time for calcul the mask position with numpy : 0.0036988258361816406 nb_pixel_total : 89812 time to create 1 rle with old method : 0.09913873672485352 length of segment : 364 time for calcul the mask position with numpy : 0.001569509506225586 nb_pixel_total : 40526 time to create 1 rle with old method : 0.045072317123413086 length of segment : 262 time for calcul the mask position with numpy : 0.001004934310913086 nb_pixel_total : 20726 time to create 1 rle with old method : 0.023075580596923828 length of segment : 264 time for calcul the mask position with numpy : 0.0002856254577636719 nb_pixel_total : 5132 time to create 1 rle with old method : 0.006170749664306641 length of segment : 77 time for calcul the mask position with numpy : 0.0019578933715820312 nb_pixel_total : 45154 time to create 1 rle with old method : 0.0527341365814209 length of segment : 348 time for calcul the mask position with numpy : 0.0011835098266601562 nb_pixel_total : 30296 time to create 1 rle with old method : 0.03419637680053711 length of segment : 195 time for calcul the mask position with numpy : 0.0007185935974121094 nb_pixel_total : 9500 time to create 1 rle with old method : 0.011635303497314453 length of segment : 172 time for calcul the mask position with numpy : 0.0005631446838378906 nb_pixel_total : 11650 time to create 1 rle with old method : 0.013466119766235352 length of segment : 231 time for calcul the mask position with numpy : 0.0014491081237792969 nb_pixel_total : 32564 time to create 1 rle with old method : 0.03631019592285156 length of segment : 322 time for calcul the mask position with numpy : 0.0015075206756591797 nb_pixel_total : 40283 time to create 1 rle with old method : 0.045246124267578125 length of segment : 187 time for calcul the mask position with numpy : 0.00029397010803222656 nb_pixel_total : 4034 time to create 1 rle with old method : 0.004971742630004883 length of segment : 68 time for calcul the mask position with numpy : 0.0009210109710693359 nb_pixel_total : 22538 time to create 1 rle with old method : 0.025538206100463867 length of segment : 142 time for calcul the mask position with numpy : 0.0010066032409667969 nb_pixel_total : 31327 time to create 1 rle with old method : 0.03428196907043457 length of segment : 261 time for calcul the mask position with numpy : 0.0008790493011474609 nb_pixel_total : 18829 time to create 1 rle with old method : 0.020999670028686523 length of segment : 298 time for calcul the mask position with numpy : 0.001497030258178711 nb_pixel_total : 32067 time to create 1 rle with old method : 0.035839080810546875 length of segment : 263 time for calcul the mask position with numpy : 0.0003941059112548828 nb_pixel_total : 7468 time to create 1 rle with old method : 0.008559465408325195 length of segment : 104 time for calcul the mask position with numpy : 0.003286600112915039 nb_pixel_total : 84372 time to create 1 rle with old method : 0.11907553672790527 length of segment : 851 time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 12067 time to create 1 rle with old method : 0.014225959777832031 length of segment : 162 time for calcul the mask position with numpy : 0.00406646728515625 nb_pixel_total : 120737 time to create 1 rle with old method : 0.13011384010314941 length of segment : 419 time for calcul the mask position with numpy : 0.014597177505493164 nb_pixel_total : 299603 time to create 1 rle with new method : 0.061107635498046875 length of segment : 966 time for calcul the mask position with numpy : 0.001299142837524414 nb_pixel_total : 32100 time to create 1 rle with old method : 0.034860849380493164 length of segment : 248 time for calcul the mask position with numpy : 0.0004367828369140625 nb_pixel_total : 10447 time to create 1 rle with old method : 0.012062788009643555 length of segment : 109 time for calcul the mask position with numpy : 0.001134634017944336 nb_pixel_total : 36236 time to create 1 rle with old method : 0.03974175453186035 length of segment : 311 time for calcul the mask position with numpy : 0.004781246185302734 nb_pixel_total : 119567 time to create 1 rle with old method : 0.1316661834716797 length of segment : 574 time for calcul the mask position with numpy : 0.0006163120269775391 nb_pixel_total : 18325 time to create 1 rle with old method : 0.022585391998291016 length of segment : 207 time for calcul the mask position with numpy : 0.0024406909942626953 nb_pixel_total : 60949 time to create 1 rle with old method : 0.06728672981262207 length of segment : 457 time for calcul the mask position with numpy : 0.0021927356719970703 nb_pixel_total : 36266 time to create 1 rle with old method : 0.05829286575317383 length of segment : 268 time for calcul the mask position with numpy : 0.00032067298889160156 nb_pixel_total : 3358 time to create 1 rle with old method : 0.0042552947998046875 length of segment : 54 time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 8506 time to create 1 rle with old method : 0.01027059555053711 length of segment : 140 time for calcul the mask position with numpy : 0.0004987716674804688 nb_pixel_total : 11697 time to create 1 rle with old method : 0.014071226119995117 length of segment : 96 time for calcul the mask position with numpy : 0.002112150192260742 nb_pixel_total : 44623 time to create 1 rle with old method : 0.04996943473815918 length of segment : 218 time for calcul the mask position with numpy : 0.008588790893554688 nb_pixel_total : 241372 time to create 1 rle with new method : 0.01742386817932129 length of segment : 743 time for calcul the mask position with numpy : 0.0018534660339355469 nb_pixel_total : 62514 time to create 1 rle with old method : 0.06907844543457031 length of segment : 327 time for calcul the mask position with numpy : 0.000873565673828125 nb_pixel_total : 22104 time to create 1 rle with old method : 0.02487635612487793 length of segment : 151 time for calcul the mask position with numpy : 0.006082296371459961 nb_pixel_total : 182728 time to create 1 rle with new method : 0.01582789421081543 length of segment : 543 time for calcul the mask position with numpy : 0.0007596015930175781 nb_pixel_total : 22956 time to create 1 rle with old method : 0.02611684799194336 length of segment : 152 time for calcul the mask position with numpy : 0.0020339488983154297 nb_pixel_total : 36281 time to create 1 rle with old method : 0.04130196571350098 length of segment : 308 time for calcul the mask position with numpy : 0.0007436275482177734 nb_pixel_total : 16043 time to create 1 rle with old method : 0.019136905670166016 length of segment : 127 time for calcul the mask position with numpy : 0.0028581619262695312 nb_pixel_total : 91978 time to create 1 rle with old method : 0.1115884780883789 length of segment : 378 time for calcul the mask position with numpy : 0.0010480880737304688 nb_pixel_total : 26366 time to create 1 rle with old method : 0.02933812141418457 length of segment : 227 time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 18232 time to create 1 rle with old method : 0.021444320678710938 length of segment : 123 time for calcul the mask position with numpy : 0.002056121826171875 nb_pixel_total : 59381 time to create 1 rle with old method : 0.06702947616577148 length of segment : 305 time for calcul the mask position with numpy : 0.0038602352142333984 nb_pixel_total : 124732 time to create 1 rle with old method : 0.13964605331420898 length of segment : 477 time for calcul the mask position with numpy : 0.0014452934265136719 nb_pixel_total : 51667 time to create 1 rle with old method : 0.058725595474243164 length of segment : 297 time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 12242 time to create 1 rle with old method : 0.014189720153808594 length of segment : 184 time for calcul the mask position with numpy : 0.0004260540008544922 nb_pixel_total : 8424 time to create 1 rle with old method : 0.010004997253417969 length of segment : 108 time for calcul the mask position with numpy : 0.0009098052978515625 nb_pixel_total : 23231 time to create 1 rle with old method : 0.0258634090423584 length of segment : 189 time for calcul the mask position with numpy : 0.0011985301971435547 nb_pixel_total : 25871 time to create 1 rle with old method : 0.029125213623046875 length of segment : 221 time for calcul the mask position with numpy : 0.0009663105010986328 nb_pixel_total : 28998 time to create 1 rle with old method : 0.03405141830444336 length of segment : 216 time for calcul the mask position with numpy : 0.001241922378540039 nb_pixel_total : 19169 time to create 1 rle with old method : 0.022434473037719727 length of segment : 212 time for calcul the mask position with numpy : 0.002468585968017578 nb_pixel_total : 63828 time to create 1 rle with old method : 0.07206511497497559 length of segment : 332 time for calcul the mask position with numpy : 0.0010912418365478516 nb_pixel_total : 14763 time to create 1 rle with old method : 0.017212629318237305 length of segment : 144 time for calcul the mask position with numpy : 0.001116037368774414 nb_pixel_total : 22317 time to create 1 rle with old method : 0.025533199310302734 length of segment : 200 time for calcul the mask position with numpy : 0.004242420196533203 nb_pixel_total : 71613 time to create 1 rle with old method : 0.07964634895324707 length of segment : 354 time for calcul the mask position with numpy : 0.0017898082733154297 nb_pixel_total : 23129 time to create 1 rle with old method : 0.026204347610473633 length of segment : 240 time for calcul the mask position with numpy : 0.0009944438934326172 nb_pixel_total : 22634 time to create 1 rle with old method : 0.02646040916442871 length of segment : 235 time for calcul the mask position with numpy : 0.0006210803985595703 nb_pixel_total : 9929 time to create 1 rle with old method : 0.011703968048095703 length of segment : 190 time for calcul the mask position with numpy : 0.0009617805480957031 nb_pixel_total : 20865 time to create 1 rle with old method : 0.02415633201599121 length of segment : 167 time for calcul the mask position with numpy : 0.0009682178497314453 nb_pixel_total : 13018 time to create 1 rle with old method : 0.014925003051757812 length of segment : 148 time for calcul the mask position with numpy : 0.0010836124420166016 nb_pixel_total : 15361 time to create 1 rle with old method : 0.017797470092773438 length of segment : 152 time for calcul the mask position with numpy : 0.00820302963256836 nb_pixel_total : 152473 time to create 1 rle with new method : 0.018355369567871094 length of segment : 494 time for calcul the mask position with numpy : 0.0018093585968017578 nb_pixel_total : 19935 time to create 1 rle with old method : 0.022486209869384766 length of segment : 202 time for calcul the mask position with numpy : 0.012116193771362305 nb_pixel_total : 171010 time to create 1 rle with new method : 0.03143882751464844 length of segment : 741 time for calcul the mask position with numpy : 0.002025604248046875 nb_pixel_total : 39715 time to create 1 rle with old method : 0.04523468017578125 length of segment : 292 time for calcul the mask position with numpy : 0.0006024837493896484 nb_pixel_total : 14021 time to create 1 rle with old method : 0.016199588775634766 length of segment : 150 time for calcul the mask position with numpy : 0.002004861831665039 nb_pixel_total : 30862 time to create 1 rle with old method : 0.0356292724609375 length of segment : 160 time for calcul the mask position with numpy : 0.00125885009765625 nb_pixel_total : 24154 time to create 1 rle with old method : 0.028360605239868164 length of segment : 289 time for calcul the mask position with numpy : 0.0022063255310058594 nb_pixel_total : 39591 time to create 1 rle with old method : 0.0478663444519043 length of segment : 299 time for calcul the mask position with numpy : 0.0011386871337890625 nb_pixel_total : 11663 time to create 1 rle with old method : 0.014015913009643555 length of segment : 166 time for calcul the mask position with numpy : 0.0008623600006103516 nb_pixel_total : 9705 time to create 1 rle with old method : 0.011610746383666992 length of segment : 139 time for calcul the mask position with numpy : 0.001556396484375 nb_pixel_total : 37297 time to create 1 rle with old method : 0.04227733612060547 length of segment : 178 time for calcul the mask position with numpy : 0.001386404037475586 nb_pixel_total : 21036 time to create 1 rle with old method : 0.024405717849731445 length of segment : 245 time for calcul the mask position with numpy : 0.002173185348510742 nb_pixel_total : 36217 time to create 1 rle with old method : 0.04217791557312012 length of segment : 363 time for calcul the mask position with numpy : 0.001585245132446289 nb_pixel_total : 24305 time to create 1 rle with old method : 0.028034448623657227 length of segment : 209 time for calcul the mask position with numpy : 0.0037462711334228516 nb_pixel_total : 44353 time to create 1 rle with old method : 0.051453590393066406 length of segment : 473 time spent for convertir_results : 12.785382270812988 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 151 chid ids of type : 3594 Number RLEs to save : 39422 save missing photos in datou_result : time spend for datou_step_exec : 75.70353674888611 time spend to save output : 4.514869451522827 total time spend for step 1 : 80.21840620040894 step2:crop_condition Wed Feb 12 21:41:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 151 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 119 About to insert : list_path_to_insert length 119 new photo from crops ! About to upload 119 photos upload in portfolio : 3736932 init cache_photo without model_param we have 119 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739392939_999069 we have uploaded 119 photos in the portfolio 3736932 time of upload the photos Elapsed time : 33.07310199737549 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739392977_999069 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.414012432098389 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739392991_999069 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.797433614730835 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739392995_999069 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5742037296295166 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739392997_999069 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1443445682525635 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337173767, 1337173765, 1337173739, 1337173736, 1337173735, 1337173730, 1337173708, 1337173706, 1337173704] Looping around the photos to save general results len do output : 151 /1337188860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337188999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337189023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173767', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173765', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173739', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173736', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173735', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173730', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173708', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173706', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173704', None, None, None, None, None, '2580753') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 462 time used for this insertion : 4.76035213470459 save_final save missing photos in datou_result : time spend for datou_step_exec : 87.20594692230225 time spend to save output : 4.883829832077026 total time spend for step 2 : 92.08977675437927 step3:rle_unique_nms_with_priority Wed Feb 12 21:43:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 151 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.491589546203613 time for calcul the mask position with numpy : 0.535515546798706 nb_pixel_total : 7602520 time to create 1 rle with new method : 0.5458016395568848 time for calcul the mask position with numpy : 0.06032228469848633 nb_pixel_total : 76282 time to create 1 rle with old method : 0.08588194847106934 time for calcul the mask position with numpy : 0.051380157470703125 nb_pixel_total : 6574 time to create 1 rle with old method : 0.009100675582885742 time for calcul the mask position with numpy : 0.05217313766479492 nb_pixel_total : 45344 time to create 1 rle with old method : 0.056064605712890625 time for calcul the mask position with numpy : 0.052127838134765625 nb_pixel_total : 17188 time to create 1 rle with old method : 0.019392728805541992 time for calcul the mask position with numpy : 0.05076146125793457 nb_pixel_total : 22771 time to create 1 rle with old method : 0.026654720306396484 time for calcul the mask position with numpy : 0.05028271675109863 nb_pixel_total : 173642 time to create 1 rle with new method : 0.4784994125366211 time for calcul the mask position with numpy : 0.05235719680786133 nb_pixel_total : 10321 time to create 1 rle with old method : 0.01204681396484375 time for calcul the mask position with numpy : 0.0526885986328125 nb_pixel_total : 18904 time to create 1 rle with old method : 0.021364212036132812 time for calcul the mask position with numpy : 0.05038189888000488 nb_pixel_total : 8867 time to create 1 rle with old method : 0.009808778762817383 time for calcul the mask position with numpy : 0.052332401275634766 nb_pixel_total : 29189 time to create 1 rle with old method : 0.03383493423461914 time for calcul the mask position with numpy : 0.05118918418884277 nb_pixel_total : 178738 time to create 1 rle with new method : 0.6182413101196289 time for calcul the mask position with numpy : 0.04089093208312988 nb_pixel_total : 37575 time to create 1 rle with old method : 0.05063152313232422 time for calcul the mask position with numpy : 0.04958176612854004 nb_pixel_total : 25167 time to create 1 rle with old method : 0.039542436599731445 time for calcul the mask position with numpy : 0.046187400817871094 nb_pixel_total : 41318 time to create 1 rle with old method : 0.045516252517700195 create new chi : 3.415839195251465 time to delete rle : 0.020810842514038086 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8346 TO DO : save crop sub photo not yet done ! save time : 0.5647404193878174 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 5.202207088470459 time for calcul the mask position with numpy : 1.2616829872131348 nb_pixel_total : 7975729 time to create 1 rle with new method : 0.8028132915496826 time for calcul the mask position with numpy : 0.05345559120178223 nb_pixel_total : 3463 time to create 1 rle with old method : 0.004752159118652344 time for calcul the mask position with numpy : 0.05736708641052246 nb_pixel_total : 29201 time to create 1 rle with old method : 0.03301358222961426 time for calcul the mask position with numpy : 0.05259585380554199 nb_pixel_total : 64726 time to create 1 rle with old method : 0.0705413818359375 time for calcul the mask position with numpy : 0.05538630485534668 nb_pixel_total : 11035 time to create 1 rle with old method : 0.018406152725219727 time for calcul the mask position with numpy : 0.05133771896362305 nb_pixel_total : 45859 time to create 1 rle with old method : 0.05114102363586426 time for calcul the mask position with numpy : 0.026778697967529297 nb_pixel_total : 11905 time to create 1 rle with old method : 0.013188600540161133 time for calcul the mask position with numpy : 0.02662348747253418 nb_pixel_total : 26476 time to create 1 rle with old method : 0.029775381088256836 time for calcul the mask position with numpy : 0.027560710906982422 nb_pixel_total : 28096 time to create 1 rle with old method : 0.03119969367980957 time for calcul the mask position with numpy : 0.026247739791870117 nb_pixel_total : 23756 time to create 1 rle with old method : 0.026457548141479492 time for calcul the mask position with numpy : 0.026297330856323242 nb_pixel_total : 21490 time to create 1 rle with old method : 0.025206565856933594 time for calcul the mask position with numpy : 0.030295610427856445 nb_pixel_total : 31446 time to create 1 rle with old method : 0.048864126205444336 time for calcul the mask position with numpy : 0.02741551399230957 nb_pixel_total : 21218 time to create 1 rle with old method : 0.023253440856933594 create new chi : 2.957232713699341 time to delete rle : 0.0011258125305175781 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 7629 TO DO : save crop sub photo not yet done ! save time : 0.5140087604522705 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 7.212296485900879 time for calcul the mask position with numpy : 0.3785974979400635 nb_pixel_total : 7703144 time to create 1 rle with new method : 0.671410083770752 time for calcul the mask position with numpy : 0.042914628982543945 nb_pixel_total : 10069 time to create 1 rle with old method : 0.011498689651489258 time for calcul the mask position with numpy : 0.04026913642883301 nb_pixel_total : 42804 time to create 1 rle with old method : 0.04939579963684082 time for calcul the mask position with numpy : 0.0350804328918457 nb_pixel_total : 29445 time to create 1 rle with old method : 0.033376455307006836 time for calcul the mask position with numpy : 0.025989532470703125 nb_pixel_total : 20364 time to create 1 rle with old method : 0.022264719009399414 time for calcul the mask position with numpy : 0.024860620498657227 nb_pixel_total : 33434 time to create 1 rle with old method : 0.03937530517578125 time for calcul the mask position with numpy : 0.025950193405151367 nb_pixel_total : 33653 time to create 1 rle with old method : 0.04309487342834473 time for calcul the mask position with numpy : 0.026570558547973633 nb_pixel_total : 15299 time to create 1 rle with old method : 0.017132043838500977 time for calcul the mask position with numpy : 0.026601552963256836 nb_pixel_total : 9424 time to create 1 rle with old method : 0.010712623596191406 time for calcul the mask position with numpy : 0.026546239852905273 nb_pixel_total : 24695 time to create 1 rle with old method : 0.02740192413330078 time for calcul the mask position with numpy : 0.026456117630004883 nb_pixel_total : 29327 time to create 1 rle with old method : 0.03200650215148926 time for calcul the mask position with numpy : 0.026167869567871094 nb_pixel_total : 28022 time to create 1 rle with old method : 0.03124260902404785 time for calcul the mask position with numpy : 0.026369333267211914 nb_pixel_total : 13207 time to create 1 rle with old method : 0.014826297760009766 time for calcul the mask position with numpy : 0.027004003524780273 nb_pixel_total : 78835 time to create 1 rle with old method : 0.09063029289245605 time for calcul the mask position with numpy : 0.03683805465698242 nb_pixel_total : 92657 time to create 1 rle with old method : 0.11063075065612793 time for calcul the mask position with numpy : 0.03421425819396973 nb_pixel_total : 26952 time to create 1 rle with old method : 0.034974098205566406 time for calcul the mask position with numpy : 0.03862929344177246 nb_pixel_total : 31370 time to create 1 rle with old method : 0.037187814712524414 time for calcul the mask position with numpy : 0.03454780578613281 nb_pixel_total : 9828 time to create 1 rle with old method : 0.010886192321777344 time for calcul the mask position with numpy : 0.03762316703796387 nb_pixel_total : 43774 time to create 1 rle with old method : 0.04785466194152832 time for calcul the mask position with numpy : 0.03660750389099121 nb_pixel_total : 18097 time to create 1 rle with old method : 0.02279376983642578 create new chi : 2.3863158226013184 time to delete rle : 0.003627300262451172 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 10010 TO DO : save crop sub photo not yet done ! save time : 0.9700841903686523 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 8.383350133895874 time for calcul the mask position with numpy : 0.6592700481414795 nb_pixel_total : 7239835 time to create 1 rle with new method : 0.6324501037597656 time for calcul the mask position with numpy : 0.04041314125061035 nb_pixel_total : 5707 time to create 1 rle with old method : 0.006448507308959961 time for calcul the mask position with numpy : 0.04614591598510742 nb_pixel_total : 83410 time to create 1 rle with old method : 0.08913278579711914 time for calcul the mask position with numpy : 0.03969407081604004 nb_pixel_total : 32406 time to create 1 rle with old method : 0.04076266288757324 time for calcul the mask position with numpy : 0.03359365463256836 nb_pixel_total : 51047 time to create 1 rle with old method : 0.05491518974304199 time for calcul the mask position with numpy : 0.027080774307250977 nb_pixel_total : 27534 time to create 1 rle with old method : 0.030556678771972656 time for calcul the mask position with numpy : 0.025179386138916016 nb_pixel_total : 55770 time to create 1 rle with old method : 0.060509443283081055 time for calcul the mask position with numpy : 0.027391433715820312 nb_pixel_total : 74120 time to create 1 rle with old method : 0.08103585243225098 time for calcul the mask position with numpy : 0.051688432693481445 nb_pixel_total : 112500 time to create 1 rle with old method : 0.12448859214782715 time for calcul the mask position with numpy : 0.04032015800476074 nb_pixel_total : 14222 time to create 1 rle with old method : 0.016189098358154297 time for calcul the mask position with numpy : 0.0394434928894043 nb_pixel_total : 44803 time to create 1 rle with old method : 0.047554731369018555 time for calcul the mask position with numpy : 0.03650498390197754 nb_pixel_total : 5940 time to create 1 rle with old method : 0.006903171539306641 time for calcul the mask position with numpy : 0.03536486625671387 nb_pixel_total : 68263 time to create 1 rle with old method : 0.07805299758911133 time for calcul the mask position with numpy : 0.035645484924316406 nb_pixel_total : 13469 time to create 1 rle with old method : 0.014672517776489258 time for calcul the mask position with numpy : 0.04052090644836426 nb_pixel_total : 113364 time to create 1 rle with old method : 0.148695707321167 time for calcul the mask position with numpy : 0.03577065467834473 nb_pixel_total : 19068 time to create 1 rle with old method : 0.021560192108154297 time for calcul the mask position with numpy : 0.038591623306274414 nb_pixel_total : 17774 time to create 1 rle with old method : 0.018668413162231445 time for calcul the mask position with numpy : 0.039571523666381836 nb_pixel_total : 37737 time to create 1 rle with old method : 0.04272031784057617 time for calcul the mask position with numpy : 0.04040980339050293 nb_pixel_total : 22569 time to create 1 rle with old method : 0.024085044860839844 time for calcul the mask position with numpy : 0.0412135124206543 nb_pixel_total : 4521 time to create 1 rle with old method : 0.005144834518432617 time for calcul the mask position with numpy : 0.039957523345947266 nb_pixel_total : 120415 time to create 1 rle with old method : 0.1267542839050293 time for calcul the mask position with numpy : 0.038564205169677734 nb_pixel_total : 29864 time to create 1 rle with old method : 0.03163576126098633 time for calcul the mask position with numpy : 0.03353381156921387 nb_pixel_total : 44079 time to create 1 rle with old method : 0.04684877395629883 time for calcul the mask position with numpy : 0.02378058433532715 nb_pixel_total : 55983 time to create 1 rle with old method : 0.05775642395019531 create new chi : 3.36586332321167 time to delete rle : 0.0033402442932128906 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 15266 TO DO : save crop sub photo not yet done ! save time : 2.4808757305145264 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 5.0132834911346436 time for calcul the mask position with numpy : 0.3210735321044922 nb_pixel_total : 7651226 time to create 1 rle with new method : 0.9749021530151367 time for calcul the mask position with numpy : 0.028780460357666016 nb_pixel_total : 22538 time to create 1 rle with old method : 0.03713226318359375 time for calcul the mask position with numpy : 0.02854013442993164 nb_pixel_total : 4034 time to create 1 rle with old method : 0.004656791687011719 time for calcul the mask position with numpy : 0.026543855667114258 nb_pixel_total : 40283 time to create 1 rle with old method : 0.04636216163635254 time for calcul the mask position with numpy : 0.030230045318603516 nb_pixel_total : 32564 time to create 1 rle with old method : 0.0397646427154541 time for calcul the mask position with numpy : 0.026767730712890625 nb_pixel_total : 11650 time to create 1 rle with old method : 0.01303410530090332 time for calcul the mask position with numpy : 0.02615070343017578 nb_pixel_total : 9500 time to create 1 rle with old method : 0.011391401290893555 time for calcul the mask position with numpy : 0.026753902435302734 nb_pixel_total : 30296 time to create 1 rle with old method : 0.03510236740112305 time for calcul the mask position with numpy : 0.026041746139526367 nb_pixel_total : 45154 time to create 1 rle with old method : 0.052783966064453125 time for calcul the mask position with numpy : 0.025040388107299805 nb_pixel_total : 5132 time to create 1 rle with old method : 0.00561070442199707 time for calcul the mask position with numpy : 0.0258944034576416 nb_pixel_total : 20726 time to create 1 rle with old method : 0.02691173553466797 time for calcul the mask position with numpy : 0.0327603816986084 nb_pixel_total : 40526 time to create 1 rle with old method : 0.047051191329956055 time for calcul the mask position with numpy : 0.04632997512817383 nb_pixel_total : 89812 time to create 1 rle with old method : 0.1027681827545166 time for calcul the mask position with numpy : 0.0426173210144043 nb_pixel_total : 21174 time to create 1 rle with old method : 0.02519822120666504 time for calcul the mask position with numpy : 0.04598689079284668 nb_pixel_total : 27300 time to create 1 rle with old method : 0.03404593467712402 time for calcul the mask position with numpy : 0.0462031364440918 nb_pixel_total : 67627 time to create 1 rle with old method : 0.07879853248596191 time for calcul the mask position with numpy : 0.04423856735229492 nb_pixel_total : 12476 time to create 1 rle with old method : 0.015993595123291016 time for calcul the mask position with numpy : 0.04263615608215332 nb_pixel_total : 28174 time to create 1 rle with old method : 0.03271055221557617 time for calcul the mask position with numpy : 0.031754493713378906 nb_pixel_total : 83081 time to create 1 rle with old method : 0.0936133861541748 time for calcul the mask position with numpy : 0.025873184204101562 nb_pixel_total : 30827 time to create 1 rle with old method : 0.03519606590270996 time for calcul the mask position with numpy : 0.025844573974609375 nb_pixel_total : 20300 time to create 1 rle with old method : 0.022202253341674805 create new chi : 2.7629570960998535 time to delete rle : 0.0022118091583251953 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 11158 TO DO : save crop sub photo not yet done ! save time : 0.7278950214385986 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 2.8279197216033936 time for calcul the mask position with numpy : 0.6271696090698242 nb_pixel_total : 8108270 time to create 1 rle with new method : 0.3757359981536865 time for calcul the mask position with numpy : 0.038817405700683594 nb_pixel_total : 12067 time to create 1 rle with old method : 0.013940572738647461 time for calcul the mask position with numpy : 0.034262895584106445 nb_pixel_total : 84372 time to create 1 rle with old method : 0.09448075294494629 time for calcul the mask position with numpy : 0.024205446243286133 nb_pixel_total : 7468 time to create 1 rle with old method : 0.007951498031616211 time for calcul the mask position with numpy : 0.024058103561401367 nb_pixel_total : 32067 time to create 1 rle with old method : 0.0346524715423584 time for calcul the mask position with numpy : 0.025333404541015625 nb_pixel_total : 18829 time to create 1 rle with old method : 0.02018427848815918 time for calcul the mask position with numpy : 0.023990154266357422 nb_pixel_total : 31327 time to create 1 rle with old method : 0.033646583557128906 create new chi : 1.4227774143218994 time to delete rle : 0.0009555816650390625 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 6038 TO DO : save crop sub photo not yet done ! save time : 0.39789891242980957 nb_obj : 15 nb_hashtags : 1 time to prepare the origin masks : 5.681338787078857 time for calcul the mask position with numpy : 0.7393603324890137 nb_pixel_total : 7188527 time to create 1 rle with new method : 0.8303985595703125 time for calcul the mask position with numpy : 0.0427248477935791 nb_pixel_total : 62514 time to create 1 rle with old method : 0.06982922554016113 time for calcul the mask position with numpy : 0.029784202575683594 nb_pixel_total : 241372 time to create 1 rle with new method : 0.4958975315093994 time for calcul the mask position with numpy : 0.04117631912231445 nb_pixel_total : 44623 time to create 1 rle with old method : 0.0515894889831543 time for calcul the mask position with numpy : 0.042233943939208984 nb_pixel_total : 11697 time to create 1 rle with old method : 0.013404607772827148 time for calcul the mask position with numpy : 0.043898582458496094 nb_pixel_total : 8079 time to create 1 rle with old method : 0.010456562042236328 time for calcul the mask position with numpy : 0.0456697940826416 nb_pixel_total : 3358 time to create 1 rle with old method : 0.004369497299194336 time for calcul the mask position with numpy : 0.0448155403137207 nb_pixel_total : 36266 time to create 1 rle with old method : 0.041654109954833984 time for calcul the mask position with numpy : 0.042206764221191406 nb_pixel_total : 60949 time to create 1 rle with old method : 0.06963658332824707 time for calcul the mask position with numpy : 0.04050016403198242 nb_pixel_total : 18325 time to create 1 rle with old method : 0.021311521530151367 time for calcul the mask position with numpy : 0.04436087608337402 nb_pixel_total : 119567 time to create 1 rle with old method : 0.15347075462341309 time for calcul the mask position with numpy : 0.03457021713256836 nb_pixel_total : 36236 time to create 1 rle with old method : 0.04100370407104492 time for calcul the mask position with numpy : 0.046423912048339844 nb_pixel_total : 10447 time to create 1 rle with old method : 0.01164388656616211 time for calcul the mask position with numpy : 0.0469813346862793 nb_pixel_total : 32100 time to create 1 rle with old method : 0.03850674629211426 time for calcul the mask position with numpy : 0.04541349411010742 nb_pixel_total : 299603 time to create 1 rle with new method : 0.5875816345214844 time for calcul the mask position with numpy : 0.041075706481933594 nb_pixel_total : 120737 time to create 1 rle with old method : 0.1380901336669922 create new chi : 4.055651664733887 time to delete rle : 0.002814769744873047 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 12369 TO DO : save crop sub photo not yet done ! save time : 0.7390134334564209 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.44799280166626 time for calcul the mask position with numpy : 0.8970224857330322 nb_pixel_total : 7543166 time to create 1 rle with new method : 0.4713156223297119 time for calcul the mask position with numpy : 0.03704047203063965 nb_pixel_total : 28998 time to create 1 rle with old method : 0.03964090347290039 time for calcul the mask position with numpy : 0.05216240882873535 nb_pixel_total : 25871 time to create 1 rle with old method : 0.03207230567932129 time for calcul the mask position with numpy : 0.028786182403564453 nb_pixel_total : 23231 time to create 1 rle with old method : 0.02844095230102539 time for calcul the mask position with numpy : 0.02855992317199707 nb_pixel_total : 8424 time to create 1 rle with old method : 0.009733915328979492 time for calcul the mask position with numpy : 0.027447938919067383 nb_pixel_total : 12242 time to create 1 rle with old method : 0.015066146850585938 time for calcul the mask position with numpy : 0.028181076049804688 nb_pixel_total : 51667 time to create 1 rle with old method : 0.060941219329833984 time for calcul the mask position with numpy : 0.03261899948120117 nb_pixel_total : 124732 time to create 1 rle with old method : 0.1560683250427246 time for calcul the mask position with numpy : 0.026131629943847656 nb_pixel_total : 59381 time to create 1 rle with old method : 0.06938529014587402 time for calcul the mask position with numpy : 0.02791142463684082 nb_pixel_total : 18232 time to create 1 rle with old method : 0.02078533172607422 time for calcul the mask position with numpy : 0.02699589729309082 nb_pixel_total : 26366 time to create 1 rle with old method : 0.029705047607421875 time for calcul the mask position with numpy : 0.02652573585510254 nb_pixel_total : 91978 time to create 1 rle with old method : 0.10341000556945801 time for calcul the mask position with numpy : 0.027430295944213867 nb_pixel_total : 16043 time to create 1 rle with old method : 0.018258333206176758 time for calcul the mask position with numpy : 0.025592327117919922 nb_pixel_total : 36281 time to create 1 rle with old method : 0.041655778884887695 time for calcul the mask position with numpy : 0.02712559700012207 nb_pixel_total : 22956 time to create 1 rle with old method : 0.026018142700195312 time for calcul the mask position with numpy : 0.03348946571350098 nb_pixel_total : 182728 time to create 1 rle with new method : 0.6622388362884521 time for calcul the mask position with numpy : 0.027117490768432617 nb_pixel_total : 22104 time to create 1 rle with old method : 0.024950504302978516 create new chi : 3.362060546875 time to delete rle : 0.0024542808532714844 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10172 TO DO : save crop sub photo not yet done ! save time : 0.6353223323822021 nb_obj : 26 nb_hashtags : 4 time to prepare the origin masks : 4.289449691772461 time for calcul the mask position with numpy : 0.4954986572265625 nb_pixel_total : 7329211 time to create 1 rle with new method : 0.6275105476379395 time for calcul the mask position with numpy : 0.034250497817993164 nb_pixel_total : 9929 time to create 1 rle with old method : 0.011115312576293945 time for calcul the mask position with numpy : 0.03514266014099121 nb_pixel_total : 22317 time to create 1 rle with old method : 0.02932906150817871 time for calcul the mask position with numpy : 0.03411293029785156 nb_pixel_total : 15361 time to create 1 rle with old method : 0.017591476440429688 time for calcul the mask position with numpy : 0.03424358367919922 nb_pixel_total : 20865 time to create 1 rle with old method : 0.023472309112548828 time for calcul the mask position with numpy : 0.034934282302856445 nb_pixel_total : 19935 time to create 1 rle with old method : 0.02446293830871582 time for calcul the mask position with numpy : 0.03673219680786133 nb_pixel_total : 22634 time to create 1 rle with old method : 0.02683544158935547 time for calcul the mask position with numpy : 0.03547334671020508 nb_pixel_total : 24305 time to create 1 rle with old method : 0.029536008834838867 time for calcul the mask position with numpy : 0.03556084632873535 nb_pixel_total : 23129 time to create 1 rle with old method : 0.0276949405670166 time for calcul the mask position with numpy : 0.03504633903503418 nb_pixel_total : 171010 time to create 1 rle with new method : 0.5191898345947266 time for calcul the mask position with numpy : 0.03421163558959961 nb_pixel_total : 71613 time to create 1 rle with old method : 0.07981395721435547 time for calcul the mask position with numpy : 0.03413820266723633 nb_pixel_total : 39591 time to create 1 rle with old method : 0.049628496170043945 time for calcul the mask position with numpy : 0.03404736518859863 nb_pixel_total : 19169 time to create 1 rle with old method : 0.021221399307250977 time for calcul the mask position with numpy : 0.03561544418334961 nb_pixel_total : 14763 time to create 1 rle with old method : 0.01636505126953125 time for calcul the mask position with numpy : 0.03395438194274902 nb_pixel_total : 14021 time to create 1 rle with old method : 0.016243934631347656 time for calcul the mask position with numpy : 0.034169912338256836 nb_pixel_total : 37297 time to create 1 rle with old method : 0.04057812690734863 time for calcul the mask position with numpy : 0.034497976303100586 nb_pixel_total : 151764 time to create 1 rle with new method : 0.3398020267486572 time for calcul the mask position with numpy : 0.03412890434265137 nb_pixel_total : 29379 time to create 1 rle with old method : 0.031844377517700195 time for calcul the mask position with numpy : 0.03458571434020996 nb_pixel_total : 30862 time to create 1 rle with old method : 0.03406357765197754 time for calcul the mask position with numpy : 0.03425788879394531 nb_pixel_total : 39581 time to create 1 rle with old method : 0.04307913780212402 time for calcul the mask position with numpy : 0.034288644790649414 nb_pixel_total : 21010 time to create 1 rle with old method : 0.023135662078857422 time for calcul the mask position with numpy : 0.03433561325073242 nb_pixel_total : 63828 time to create 1 rle with old method : 0.07103347778320312 time for calcul the mask position with numpy : 0.034256935119628906 nb_pixel_total : 9705 time to create 1 rle with old method : 0.010907888412475586 time for calcul the mask position with numpy : 0.03438162803649902 nb_pixel_total : 44353 time to create 1 rle with old method : 0.048619747161865234 time for calcul the mask position with numpy : 0.03436446189880371 nb_pixel_total : 24087 time to create 1 rle with old method : 0.026611328125 time for calcul the mask position with numpy : 0.03431200981140137 nb_pixel_total : 11663 time to create 1 rle with old method : 0.01277613639831543 time for calcul the mask position with numpy : 0.034149169921875 nb_pixel_total : 13018 time to create 1 rle with old method : 0.014290332794189453 create new chi : 3.702927350997925 time to delete rle : 0.0033693313598632812 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 15260 TO DO : save crop sub photo not yet done ! save time : 1.8894855976104736 map_output_result : {1337173767: (0.0, 'Should be the crop_list due to order', 0.0), 1337173765: (0.0, 'Should be the crop_list due to order', 0.0), 1337173739: (0.0, 'Should be the crop_list due to order', 0.0), 1337173736: (0.0, 'Should be the crop_list due to order', 0.0), 1337173735: (0.0, 'Should be the crop_list due to order', 0.0), 1337173730: (0.0, 'Should be the crop_list due to order', 0.0), 1337173708: (0.0, 'Should be the crop_list due to order', 0.0), 1337173706: (0.0, 'Should be the crop_list due to order', 0.0), 1337173704: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337173767, 1337173765, 1337173739, 1337173736, 1337173735, 1337173730, 1337173708, 1337173706, 1337173704] Looping around the photos to save general results len do output : 9 /1337173767.Didn't retrieve data . /1337173765.Didn't retrieve data . /1337173739.Didn't retrieve data . /1337173736.Didn't retrieve data . /1337173735.Didn't retrieve data . /1337173730.Didn't retrieve data . /1337173708.Didn't retrieve data . /1337173706.Didn't retrieve data . /1337173704.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173767', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173765', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173739', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173736', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173735', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173730', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173708', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173706', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173704', None, None, None, None, None, '2580753') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013803958892822266 save_final save missing photos in datou_result : time spend for datou_step_exec : 89.71786832809448 time spend to save output : 0.01536417007446289 total time spend for step 3 : 89.73323249816895 step4:ventilate_hashtags_in_portfolio Wed Feb 12 21:44:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20492275 get user id for portfolio 20492275 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20492275 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','flou','papier','environnement','pehd','pet_clair','metal','pet_fonce','carton','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20492275 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','flou','papier','environnement','pehd','pet_clair','metal','pet_fonce','carton','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20492275 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','flou','papier','environnement','pehd','pet_clair','metal','pet_fonce','carton','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20492363,20492364,20492365,20492366,20492367,20492368,20492369,20492370,20492371,20492372,20492373?tags=background,flou,papier,environnement,pehd,pet_clair,metal,pet_fonce,carton,mal_croppe,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337173767, 1337173765, 1337173739, 1337173736, 1337173735, 1337173730, 1337173708, 1337173706, 1337173704] Looping around the photos to save general results len do output : 1 /20492275. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173767', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173765', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173739', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173736', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173735', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173730', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173708', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173706', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173704', None, None, None, None, None, '2580753') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.017229318618774414 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9343631267547607 time spend to save output : 0.01753973960876465 total time spend for step 4 : 1.9519028663635254 step5:final Wed Feb 12 21:44:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337173767: ('0.08450108239026065',), 1337173765: ('0.08450108239026065',), 1337173739: ('0.08450108239026065',), 1337173736: ('0.08450108239026065',), 1337173735: ('0.08450108239026065',), 1337173730: ('0.08450108239026065',), 1337173708: ('0.08450108239026065',), 1337173706: ('0.08450108239026065',), 1337173704: ('0.08450108239026065',)} new output for save of step final : {1337173767: ('0.08450108239026065',), 1337173765: ('0.08450108239026065',), 1337173739: ('0.08450108239026065',), 1337173736: ('0.08450108239026065',), 1337173735: ('0.08450108239026065',), 1337173730: ('0.08450108239026065',), 1337173708: ('0.08450108239026065',), 1337173706: ('0.08450108239026065',), 1337173704: ('0.08450108239026065',)} [1337173767, 1337173765, 1337173739, 1337173736, 1337173735, 1337173730, 1337173708, 1337173706, 1337173704] Looping around the photos to save general results len do output : 9 /1337173767.Didn't retrieve data . /1337173765.Didn't retrieve data . /1337173739.Didn't retrieve data . /1337173736.Didn't retrieve data . /1337173735.Didn't retrieve data . /1337173730.Didn't retrieve data . /1337173708.Didn't retrieve data . /1337173706.Didn't retrieve data . /1337173704.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173767', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173765', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173739', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173736', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173735', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173730', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173708', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173706', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173704', None, None, None, None, None, '2580753') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014896869659423828 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1076955795288086 time spend to save output : 0.015692472457885742 total time spend for step 5 : 0.12338805198669434 step6:blur_detection Wed Feb 12 21:44:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6.jpg resize: (2160, 3840) 1337173767 -5.20131938716798 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051.jpg resize: (2160, 3840) 1337173765 -5.757874187206313 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92.jpg resize: (2160, 3840) 1337173739 -5.4426121416094855 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2.jpg resize: (2160, 3840) 1337173736 -6.108406091362024 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970.jpg resize: (2160, 3840) 1337173735 -5.975983055508235 treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782.jpg resize: (2160, 3840) 1337173730 -5.317019880430065 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e.jpg resize: (2160, 3840) 1337173708 -5.617271023802363 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1.jpg resize: (2160, 3840) 1337173706 -5.466542996197374 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3.jpg resize: (2160, 3840) 1337173704 -5.360134462475729 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273808_0.png resize: (455, 561) 1337188860 -4.131737322272607 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273809_0.png resize: (174, 244) 1337188861 -3.352556178416026 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273813_0.png resize: (350, 360) 1337188862 -3.124586680996479 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273812_0.png resize: (165, 112) 1337188863 -3.144318747090301 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273800_0.png resize: (223, 273) 1337188864 -2.639987825295314 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273802_0.png resize: (243, 258) 1337188865 -2.8419699497951 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273807_0.png resize: (111, 107) 1337188866 -2.113419945249656 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273801_0.png resize: (162, 197) 1337188867 -1.1599978535443956 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273805_0.png resize: (93, 118) 1337188868 -1.2942393064593605 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273810_0.png resize: (143, 169) 1337188869 -3.832736198897781 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273819_0.png resize: (167, 195) 1337188870 -2.2617918860986506 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273815_0.png resize: (307, 259) 1337188871 -2.3755977015968583 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273822_0.png resize: (82, 169) 1337188872 -0.6933201130251768 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273816_0.png resize: (118, 240) 1337188873 -3.7953453368398016 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273817_0.png resize: (115, 321) 1337188874 -1.9501388253440401 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273820_0.png resize: (107, 142) 1337188875 0.12331241884504365 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273824_0.png resize: (253, 193) 1337188876 -0.9951099393975199 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273825_0.png resize: (366, 338) 1337188877 -1.77378616466141 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273836_0.png resize: (262, 154) 1337188878 -4.666832394580887 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273827_0.png resize: (278, 260) 1337188879 -2.5244733038272362 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273826_0.png resize: (131, 228) 1337188880 -2.752251007728296 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273842_0.png resize: (253, 198) 1337188881 -3.198448106215524 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273835_0.png resize: (185, 226) 1337188882 -3.916042453051021 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273829_0.png resize: (155, 270) 1337188883 -2.756056250300053 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273830_0.png resize: (119, 341) 1337188884 -4.144549839754624 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273831_0.png resize: (474, 400) 1337188885 -3.273508024506546 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273843_0.png resize: (156, 389) 1337188886 -3.156242830904822 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273844_0.png resize: (89, 181) 1337188887 -3.632846137363874 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273832_0.png resize: (401, 311) 1337188888 -2.9303486961827887 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273837_0.png resize: (144, 154) 1337188889 -3.2997994218681383 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273839_0.png resize: (212, 209) 1337188891 -3.382640881458917 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273838_0.png resize: (163, 122) 1337188892 -1.3195698173825319 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273834_0.png resize: (158, 255) 1337188893 -3.32589134931449 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273841_0.png resize: (210, 136) 1337188894 -1.9064323234414038 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273864_0.png resize: (364, 210) 1337188895 -1.9360120089707615 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273856_0.png resize: (358, 265) 1337188896 -4.182887947175377 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273862_0.png resize: (310, 251) 1337188897 -2.5409314401564442 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273845_0.png resize: (329, 310) 1337188898 -3.3762798635157005 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273848_0.png resize: (470, 463) 1337188899 -4.2064912909147 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273860_0.png resize: (404, 387) 1337188900 -3.7881944941009182 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273867_0.png resize: (136, 235) 1337188901 -2.434519796667421 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273863_0.png resize: (319, 415) 1337188902 -2.656791141512978 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273853_0.png resize: (190, 215) 1337188903 -2.6121979665970767 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273847_0.png resize: (232, 223) 1337188904 -3.6117852417354612 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273866_0.png resize: (298, 387) 1337188905 -3.7496571129580065 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273858_0.png resize: (140, 379) 1337188906 -3.512652732558673 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273852_0.png resize: (184, 144) 1337188907 -2.956733443635806 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273850_0.png resize: (291, 95) 1337188908 -2.6991792510064947 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273859_0.png resize: (196, 135) 1337188909 -2.0767274626713847 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273855_0.png resize: (131, 153) 1337188910 -3.5973657493412516 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273857_0.png resize: (126, 57) 1337188911 -1.5659240038459685 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273873_0.png resize: (279, 302) 1337188912 -4.207174484308456 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273885_0.png resize: (182, 283) 1337188913 -3.6337505742313847 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273879_0.png resize: (77, 84) 1337188914 -0.5005590812842706 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273882_0.png resize: (101, 224) 1337188915 -3.7946383196819 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273878_0.png resize: (264, 135) 1337188916 -3.346927365806555 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273886_0.png resize: (58, 94) 1337188917 -3.2553464673171573 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273881_0.png resize: (195, 211) 1337188918 1.844011276413564 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273870_0.png resize: (421, 429) 1337188919 -3.461213821690785 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273877_0.png resize: (259, 249) 1337188920 -3.5276229598697557 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273880_0.png resize: (348, 238) 1337188921 -4.523950172777257 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273871_0.png resize: (164, 216) 1337188922 -3.217206721775935 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273872_0.png resize: (114, 138) 1337188923 -2.4186963221058257 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273875_0.png resize: (183, 161) 1337188924 -3.8179953585571185 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273883_0.png resize: (227, 58) 1337188925 -2.854406440049707 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273869_0.png resize: (217, 207) 1337188926 -2.4144120580981383 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273887_0.png resize: (142, 232) 1337188927 -3.127128320739319 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273868_0.png resize: (187, 164) 1337188928 -4.076016443173402 treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273889_0.png resize: (298, 92) 1337188929 -3.035417105931082 treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273888_0.png resize: (261, 175) 1337188930 -1.3822621081491062 treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273892_0.png resize: (472, 302) 1337188931 -3.7541794088616878 treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273890_0.png resize: (242, 225) 1337188932 -2.4424363314127784 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273896_0.png resize: (244, 175) 1337188933 -1.9910200151648039 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273904_0.png resize: (95, 147) 1337188934 -2.2658225966456897 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273902_0.png resize: (259, 216) 1337188935 -3.564793567939577 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273894_0.png resize: (356, 448) 1337188936 -3.981237551181721 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273900_0.png resize: (205, 145) 1337188937 -3.361843673163939 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273906_0.png resize: (189, 329) 1337188938 -3.1933123621481863 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273907_0.png resize: (719, 570) 1337188939 -1.9746702532727969 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273895_0.png resize: (804, 668) 1337188941 -2.7466532338255725 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273899_0.png resize: (488, 384) 1337188942 -1.109444565428968 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273905_0.png resize: (96, 171) 1337188943 -2.178194542952067 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273908_0.png resize: (309, 316) 1337188944 -2.695910745259943 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273898_0.png resize: (309, 204) 1337188945 -3.763739613039933 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273897_0.png resize: (109, 148) 1337188946 -0.4288209956017324 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273901_0.png resize: (347, 329) 1337188947 -1.5964647365537428 treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273903_0.png resize: (54, 94) 1337188948 -3.2795906696409176 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273920_0.png resize: (132, 126) 1337188949 -2.8731558966104003 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273917_0.png resize: (304, 316) 1337188950 -2.4278541224142676 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273910_0.png resize: (513, 556) 1337188951 -4.168992058111179 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273911_0.png resize: (152, 194) 1337188952 -3.7354480849953484 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273912_0.png resize: (308, 223) 1337188953 -3.3224332756380868 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273916_0.png resize: (121, 197) 1337188954 -2.3030906170695267 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273918_0.png resize: (365, 513) 1337188955 -3.879448093909504 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273923_0.png resize: (215, 221) 1337188956 -4.306286408496831 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273915_0.png resize: (222, 201) 1337188957 -3.389015554154357 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273921_0.png resize: (107, 99) 1337188958 -2.889052975789491 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273914_0.png resize: (352, 360) 1337188959 -4.589926595008367 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273919_0.png resize: (283, 254) 1337188960 -4.157327506099814 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273924_0.png resize: (215, 203) 1337188961 -2.721129432091674 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273932_0.png resize: (188, 85) 1337188962 -3.251405928776834 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273928_0.png resize: (200, 161) 1337188963 -3.646594273672198 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273950_0.png resize: (369, 259) 1337188964 -3.725577661389075 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273941_0.png resize: (160, 289) 1337188965 -2.4830460287833027 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273946_0.png resize: (158, 338) 1337188966 -3.3070566778800132 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273939_0.png resize: (292, 262) 1337188967 -3.34682187994461 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273938_0.png resize: (739, 369) 1337188968 -2.989053072263285 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273933_0.png resize: (167, 197) 1337188969 -3.1195160710262657 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273929_0.png resize: (354, 387) 1337188970 -2.533839866014512 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273936_0.png resize: (481, 530) 1337188971 -3.3151042511086293 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273942_0.png resize: (241, 246) 1337188972 -3.5607097211117633 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273934_0.png resize: (148, 148) 1337188973 -2.795775107850214 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273927_0.png resize: (144, 191) 1337188974 -0.9065914236565317 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273947_0.png resize: (255, 151) 1337188975 -3.201595976267796 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273948_0.png resize: (280, 278) 1337188976 -2.9138062308359403 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273937_0.png resize: (202, 167) 1337188977 -3.23510971421735 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273943_0.png resize: (299, 216) 1337188978 0.08879450576416911 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273945_0.png resize: (135, 103) 1337188979 -3.4426061495261533 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273944_0.png resize: (165, 96) 1337188980 -1.3453721555345823 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273806_0.png resize: (164, 158) 1337188982 -2.9232409607696166 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273811_0.png resize: (235, 258) 1337188983 -3.2434093337092333 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273821_0.png resize: (251, 304) 1337188984 -2.46825711376184 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273814_0.png resize: (152, 193) 1337188985 -2.4776271604028977 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273818_0.png resize: (185, 234) 1337188986 -3.4688037644592873 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273828_0.png resize: (141, 109) 1337188987 -2.568241120159265 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273833_0.png resize: (195, 107) 1337188988 -4.013632388869402 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273865_0.png resize: (198, 213) 1337188989 -2.8392457504256363 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273846_0.png resize: (249, 258) 1337188990 -3.39425930378151 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273851_0.png resize: (362, 157) 1337188991 -3.430516908838135 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273849_0.png resize: (114, 89) 1337188992 -3.134581182611753 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273876_0.png resize: (336, 445) 1337188993 -3.257129122197918 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273874_0.png resize: (229, 160) 1337188994 -2.626214426773385 treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273891_0.png resize: (104, 94) 1337188995 -2.626152423559719 treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273893_0.png resize: (161, 114) 1337188996 -3.3466646905370947 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273922_0.png resize: (188, 184) 1337188997 -2.770936669847532 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273909_0.png resize: (151, 193) 1337188998 -1.9561349613014265 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273931_0.png resize: (234, 128) 1337188999 -2.0406937816683244 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273949_0.png resize: (197, 161) 1337189000 -3.3410045642101918 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273930_0.png resize: (240, 168) 1337189001 -1.959405311080726 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273935_0.png resize: (152, 133) 1337189002 -2.205526249088088 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273925_0.png resize: (211, 150) 1337189003 -2.422304188282458 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273803_0.png resize: (260, 762) 1337189012 -1.7160010940244372 treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273804_0.png resize: (220, 173) 1337189013 -4.261471848177648 treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273823_0.png resize: (381, 336) 1337189014 -2.9563974565754547 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273854_0.png resize: (486, 353) 1337189015 -2.7472715026482826 treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273861_0.png resize: (253, 414) 1337189016 -4.217911094333608 treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273884_0.png resize: (305, 163) 1337189017 -2.5702472180035305 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273926_0.png resize: (332, 227) 1337189018 -4.536305763899003 treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273913_0.png resize: (127, 163) 1337189020 -3.838303998659668 treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273840_0.png resize: (212, 294) 1337189021 -3.41774680224179 treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273940_0.png resize: (150, 130) 1337189023 -3.4134766746702967 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 160 time used for this insertion : 0.03152108192443848 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 160 time used for this insertion : 0.051627159118652344 save missing photos in datou_result : time spend for datou_step_exec : 40.34043908119202 time spend to save output : 0.09821367263793945 total time spend for step 6 : 40.438652753829956 step7:brightness Wed Feb 12 21:45:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6.jpg treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051.jpg treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92.jpg treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2.jpg treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970.jpg treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782.jpg treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e.jpg treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1.jpg treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3.jpg treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273808_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273809_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273813_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273812_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273800_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273802_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273807_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273801_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273805_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273810_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273819_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273815_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273822_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273816_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273817_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273820_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273824_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273825_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273836_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273827_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273826_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273842_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273835_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273829_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273830_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273831_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273843_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273844_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273832_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273837_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273839_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273838_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273834_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273841_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273864_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273856_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273862_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273845_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273848_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273860_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273867_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273863_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273853_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273847_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273866_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273858_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273852_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273850_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273859_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273855_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273857_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273873_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273885_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273879_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273882_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273878_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273886_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273881_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273870_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273877_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273880_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273871_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273872_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273875_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273883_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273869_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273887_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273868_0.png treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273889_0.png treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273888_0.png treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273892_0.png treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273890_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273896_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273904_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273902_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273894_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273900_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273906_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273907_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273895_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273899_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273905_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273908_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273898_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273897_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273901_0.png treat image : temp/1739392829_999069_1337173708_6de5ec9e0dc13f89bf2d90cff4f2619e_rle_crop_3672273903_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273920_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273917_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273910_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273911_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273912_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273916_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273918_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273923_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273915_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273921_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273914_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273919_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273924_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273932_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273928_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273950_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273941_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273946_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273939_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273938_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273933_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273929_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273936_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273942_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273934_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273927_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273947_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273948_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273937_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273943_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273945_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273944_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273806_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273811_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273821_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273814_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273818_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273828_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273833_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273865_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273846_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273851_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273849_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273876_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273874_0.png treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273891_0.png treat image : temp/1739392829_999069_1337173730_128670db7191475e066aa29c65be7782_rle_crop_3672273893_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273922_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273909_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273931_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273949_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273930_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273935_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273925_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273803_0.png treat image : temp/1739392829_999069_1337173767_13cf027751cfe13b656c0ed632b123f6_rle_crop_3672273804_0.png treat image : temp/1739392829_999069_1337173765_030eea55fe45e372291f891f4cc3f051_rle_crop_3672273823_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273854_0.png treat image : temp/1739392829_999069_1337173736_41153a2e30edfbd4b77e0acb00ac5dd2_rle_crop_3672273861_0.png treat image : temp/1739392829_999069_1337173735_0e4c6c82730e40d615b6cd3ecbbcb970_rle_crop_3672273884_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273926_0.png treat image : temp/1739392829_999069_1337173706_3264929ae9945e5c1c73cf04ff2111c1_rle_crop_3672273913_0.png treat image : temp/1739392829_999069_1337173739_97cd8b54f9cb35117f7d0a81d85e5c92_rle_crop_3672273840_0.png treat image : temp/1739392829_999069_1337173704_aa8e2c41802988d1f5278b80215c26d3_rle_crop_3672273940_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 160 time used for this insertion : 0.9140424728393555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 160 time used for this insertion : 0.03769230842590332 save missing photos in datou_result : time spend for datou_step_exec : 11.370007753372192 time spend to save output : 0.958075761795044 total time spend for step 7 : 12.328083515167236 step8:velours_tree Wed Feb 12 21:45:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.6275815963745117 time spend to save output : 0.00029754638671875 total time spend for step 8 : 0.6278791427612305 step9:send_mail_cod Wed Feb 12 21:45:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20492275_12-02-2025_21_45_48.pdf 20492363 imagette204923631739393148 20492364 imagette204923641739393148 20492365 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204923651739393148 20492367 imagette204923671739393149 20492368 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204923681739393149 20492369 imagette204923691739393150 20492370 change filename to text .change filename to text .imagette204923701739393150 20492371 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204923711739393150 20492372 imagette204923721739393151 20492373 change filename to text .imagette204923731739393151 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20492275 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20492363,20492364,20492365,20492366,20492367,20492368,20492369,20492370,20492371,20492372,20492373?tags=background,flou,papier,environnement,pehd,pet_clair,metal,pet_fonce,carton,mal_croppe,autre args[1337173767] : ((1337173767, -5.20131938716798, 492609224), (1337173767, -0.10634931915043992, 496442774), '0.08450108239026065') apple ((1337173767, -5.20131938716798, 492609224), (1337173767, -0.10634931915043992, 496442774), '0.08450108239026065') We are sending mail with results at report@fotonower.com args[1337173765] : ((1337173765, -5.757874187206313, 492609224), (1337173765, 0.42856471036909405, 2107752395), '0.08450108239026065') apple ((1337173765, -5.757874187206313, 492609224), (1337173765, 0.42856471036909405, 2107752395), '0.08450108239026065') We are sending mail with results at report@fotonower.com args[1337173739] : ((1337173739, -5.4426121416094855, 492609224), (1337173739, -0.16665375881068337, 496442774), '0.08450108239026065') apple ((1337173739, -5.4426121416094855, 492609224), (1337173739, -0.16665375881068337, 496442774), '0.08450108239026065') We are sending mail with results at report@fotonower.com args[1337173736] : ((1337173736, -6.108406091362024, 492609224), (1337173736, 0.42365864886287435, 2107752395), '0.08450108239026065') apple ((1337173736, -6.108406091362024, 492609224), (1337173736, 0.42365864886287435, 2107752395), '0.08450108239026065') We are sending mail with results at report@fotonower.com args[1337173735] : ((1337173735, -5.975983055508235, 492609224), (1337173735, 0.3016353740266469, 2107752395), '0.08450108239026065') apple ((1337173735, -5.975983055508235, 492609224), (1337173735, 0.3016353740266469, 2107752395), '0.08450108239026065') We are sending mail with results at report@fotonower.com args[1337173730] : ((1337173730, -5.317019880430065, 492609224), (1337173730, 0.21886041470219425, 2107752395), '0.08450108239026065') apple ((1337173730, -5.317019880430065, 492609224), (1337173730, 0.21886041470219425, 2107752395), '0.08450108239026065') We are sending mail with results at report@fotonower.com args[1337173708] : ((1337173708, -5.617271023802363, 492609224), (1337173708, 0.4715538719595639, 2107752395), '0.08450108239026065') apple ((1337173708, -5.617271023802363, 492609224), (1337173708, 0.4715538719595639, 2107752395), '0.08450108239026065') We are sending mail with results at report@fotonower.com args[1337173706] : ((1337173706, -5.466542996197374, 492609224), (1337173706, -0.31557912294887286, 496442774), '0.08450108239026065') apple ((1337173706, -5.466542996197374, 492609224), (1337173706, -0.31557912294887286, 496442774), '0.08450108239026065') We are sending mail with results at report@fotonower.com args[1337173704] : ((1337173704, -5.360134462475729, 492609224), (1337173704, 0.04445674254015992, 2107752395), '0.08450108239026065') apple ((1337173704, -5.360134462475729, 492609224), (1337173704, 0.04445674254015992, 2107752395), '0.08450108239026065') We are sending mail with results at report@fotonower.com refus_total : 0.08450108239026065 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20492275 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20492275_12-02-2025_21_45_48.pdf results_Auto_P20492275_12-02-2025_21_45_48.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20492275_12-02-2025_21_45_48.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20492275','results_Auto_P20492275_12-02-2025_21_45_48.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20492275_12-02-2025_21_45_48.pdf','pdf','','0.55','0.08450108239026065') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20492275

https://www.fotonower.com/image?json=false&list_photos_id=1337173767
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337173765
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337173739
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337173736
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337173735
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337173730
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337173708
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337173706
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337173704
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.45%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/20492365?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20492368?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20492370?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20492371?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20492373?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20492275_12-02-2025_21_45_48.pdf.

Lien vers velours :https://www.fotonower.com/velours/20492363,20492364,20492365,20492366,20492367,20492368,20492369,20492370,20492371,20492372,20492373?tags=background,flou,papier,environnement,pehd,pet_clair,metal,pet_fonce,carton,mal_croppe,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 12 Feb 2025 20:45:55 GMT Content-Length: 0 Connection: close X-Message-Id: VpBmoMXcQ3KX6MMBq-_X2A Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337173767, 1337173765, 1337173739, 1337173736, 1337173735, 1337173730, 1337173708, 1337173706, 1337173704] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173767', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173765', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173739', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173736', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173735', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173730', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173708', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173706', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173704', None, None, None, None, None, '2580753') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.015593528747558594 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.799110651016235 time spend to save output : 0.015850067138671875 total time spend for step 9 : 6.814960718154907 step10:split_time_score Wed Feb 12 21:45:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12022025 20492275 Nombre de photos uploadées : 9 / 23040 (0%) 12022025 20492275 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 12022025 20492275 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006761550903320312 elapsed_time : insert_dashboard_record_day_entry 0.023792266845703125 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.02047947237886069 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20471726_12-02-2025_10_46_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20471726 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20471726 AND mptpi.`type`=3726 To do Qualite : 0.03158201757242585 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20474345_12-02-2025_11_56_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20474345 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20474345 AND mptpi.`type`=3726 To do Qualite : 0.0216452411024878 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20475364_12-02-2025_12_30_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20475364 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20475364 AND mptpi.`type`=3726 To do Qualite : 0.04464546711733325 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20475366_12-02-2025_15_00_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20475366 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20475366 AND mptpi.`type`=3726 To do Qualite : 0.031042830209226376 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20477525_12-02-2025_14_18_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20477525 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20477525 AND mptpi.`type`=3726 To do Qualite : 0.05679139878552165 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20477527_12-02-2025_16_24_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20477527 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20477527 AND mptpi.`type`=3726 To do Qualite : 0.01387528648259037 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20481816_12-02-2025_17_06_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20481816 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20481816 AND mptpi.`type`=3726 To do Qualite : 0.09220499507030178 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20481817_12-02-2025_18_28_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20481817 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20481817 AND mptpi.`type`=3594 To do Qualite : 0.050326244265650695 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20485438_12-02-2025_18_40_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20485438 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20485438 AND mptpi.`type`=3726 To do Qualite : 0.03747686185675338 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20485442_12-02-2025_18_56_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20485442 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20485442 AND mptpi.`type`=3726 To do Qualite : 0.08450108239026065 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20492275_12-02-2025_21_45_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20492275 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20492275 AND mptpi.`type`=3594 To do Qualite : 0.00951973884625577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20492276_12-02-2025_21_37_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20492276 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20492276 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12022025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337173767, 1337173765, 1337173739, 1337173736, 1337173735, 1337173730, 1337173708, 1337173706, 1337173704] Looping around the photos to save general results len do output : 1 /20492275Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173767', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173765', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173739', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173736', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173735', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173730', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173708', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173706', None, None, None, None, None, '2580753') ('3318', None, None, None, None, None, None, None, '2580753') ('3318', '20492275', '1337173704', None, None, None, None, None, '2580753') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013933658599853516 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.989260196685791 time spend to save output : 0.014149904251098633 total time spend for step 10 : 1.0034101009368896 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 145.63user 116.91system 5:31.70elapsed 79%CPU (0avgtext+0avgdata 5347020maxresident)k 1072776inputs+105968outputs (13645major+15935305minor)pagefaults 0swaps