python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4049133 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2877957'] with mtr_portfolio_ids : ['23063143'] and first list_photo_ids : [] new path : /proc/4049133/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 2.1806602478027344 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri May 16 13:30:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10440 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-16 13:30:35.045256: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-16 13:30:35.075100: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-16 13:30:35.076553: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdcd8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-16 13:30:35.076580: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-16 13:30:35.080048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-16 13:30:35.227550: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x397fe820 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-16 13:30:35.227621: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-16 13:30:35.229000: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 13:30:35.229499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 13:30:35.232886: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 13:30:35.236248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 13:30:35.236752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 13:30:35.239810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 13:30:35.241280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 13:30:35.247426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 13:30:35.249110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 13:30:35.249201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 13:30:35.250028: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 13:30:35.250046: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 13:30:35.250056: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 13:30:35.251513: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-16 13:30:35.535006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 13:30:35.535152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 13:30:35.535178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 13:30:35.535204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 13:30:35.535227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 13:30:35.535251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 13:30:35.535274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 13:30:35.535298: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 13:30:35.536683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 13:30:35.538040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 13:30:35.538074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 13:30:35.538089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 13:30:35.538103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 13:30:35.538116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 13:30:35.538130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 13:30:35.538143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 13:30:35.538157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 13:30:35.539404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 13:30:35.539448: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 13:30:35.539457: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 13:30:35.539465: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 13:30:35.540726: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-16 13:30:45.821695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 13:30:46.006523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 Detection mask done ! Trying to reset tf kernel 4050084 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5083 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10372 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010497570037841797 nb_pixel_total : 28977 time to create 1 rle with old method : 0.03456473350524902 length of segment : 225 time for calcul the mask position with numpy : 0.0015532970428466797 nb_pixel_total : 72117 time to create 1 rle with old method : 0.08761215209960938 length of segment : 156 time for calcul the mask position with numpy : 0.0011930465698242188 nb_pixel_total : 42518 time to create 1 rle with old method : 0.05225491523742676 length of segment : 144 time for calcul the mask position with numpy : 0.0006465911865234375 nb_pixel_total : 24742 time to create 1 rle with old method : 0.029700279235839844 length of segment : 156 time for calcul the mask position with numpy : 0.0006785392761230469 nb_pixel_total : 29366 time to create 1 rle with old method : 0.03488421440124512 length of segment : 209 time for calcul the mask position with numpy : 0.0007848739624023438 nb_pixel_total : 13143 time to create 1 rle with old method : 0.015637874603271484 length of segment : 139 time for calcul the mask position with numpy : 0.0007390975952148438 nb_pixel_total : 23075 time to create 1 rle with old method : 0.028052091598510742 length of segment : 202 time for calcul the mask position with numpy : 0.0013768672943115234 nb_pixel_total : 44613 time to create 1 rle with old method : 0.05179309844970703 length of segment : 400 time for calcul the mask position with numpy : 0.0004734992980957031 nb_pixel_total : 19752 time to create 1 rle with old method : 0.025025367736816406 length of segment : 168 time for calcul the mask position with numpy : 0.0005376338958740234 nb_pixel_total : 16472 time to create 1 rle with old method : 0.0198976993560791 length of segment : 159 time for calcul the mask position with numpy : 0.0008757114410400391 nb_pixel_total : 23370 time to create 1 rle with old method : 0.02821946144104004 length of segment : 129 time for calcul the mask position with numpy : 0.001293182373046875 nb_pixel_total : 30742 time to create 1 rle with old method : 0.035663604736328125 length of segment : 369 time for calcul the mask position with numpy : 0.0005335807800292969 nb_pixel_total : 21404 time to create 1 rle with old method : 0.02641749382019043 length of segment : 100 time for calcul the mask position with numpy : 0.000591278076171875 nb_pixel_total : 23754 time to create 1 rle with old method : 0.031534671783447266 length of segment : 173 time for calcul the mask position with numpy : 0.0004203319549560547 nb_pixel_total : 19034 time to create 1 rle with old method : 0.026942968368530273 length of segment : 131 time for calcul the mask position with numpy : 0.0010454654693603516 nb_pixel_total : 34013 time to create 1 rle with old method : 0.04015469551086426 length of segment : 214 time for calcul the mask position with numpy : 0.0009768009185791016 nb_pixel_total : 28818 time to create 1 rle with old method : 0.032839298248291016 length of segment : 247 time for calcul the mask position with numpy : 0.000423431396484375 nb_pixel_total : 13320 time to create 1 rle with old method : 0.022363901138305664 length of segment : 121 time for calcul the mask position with numpy : 0.0006868839263916016 nb_pixel_total : 24433 time to create 1 rle with old method : 0.041513919830322266 length of segment : 194 time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 12116 time to create 1 rle with old method : 0.014166831970214844 length of segment : 187 time for calcul the mask position with numpy : 0.003028392791748047 nb_pixel_total : 101893 time to create 1 rle with old method : 0.11929106712341309 length of segment : 281 time for calcul the mask position with numpy : 0.0005943775177001953 nb_pixel_total : 31738 time to create 1 rle with old method : 0.03668475151062012 length of segment : 190 time for calcul the mask position with numpy : 0.0019216537475585938 nb_pixel_total : 88429 time to create 1 rle with old method : 0.10193753242492676 length of segment : 278 time for calcul the mask position with numpy : 0.0003752708435058594 nb_pixel_total : 20095 time to create 1 rle with old method : 0.023668527603149414 length of segment : 134 time for calcul the mask position with numpy : 0.00027370452880859375 nb_pixel_total : 13113 time to create 1 rle with old method : 0.015258550643920898 length of segment : 159 time for calcul the mask position with numpy : 0.00401759147644043 nb_pixel_total : 146651 time to create 1 rle with old method : 0.17590761184692383 length of segment : 523 time for calcul the mask position with numpy : 0.00020956993103027344 nb_pixel_total : 5208 time to create 1 rle with old method : 0.00632023811340332 length of segment : 84 time for calcul the mask position with numpy : 0.005711555480957031 nb_pixel_total : 152819 time to create 1 rle with new method : 0.017383813858032227 length of segment : 707 time for calcul the mask position with numpy : 0.0007834434509277344 nb_pixel_total : 20495 time to create 1 rle with old method : 0.023707151412963867 length of segment : 165 time for calcul the mask position with numpy : 0.0007631778717041016 nb_pixel_total : 29858 time to create 1 rle with old method : 0.034966230392456055 length of segment : 241 time for calcul the mask position with numpy : 0.0008451938629150391 nb_pixel_total : 35758 time to create 1 rle with old method : 0.044118642807006836 length of segment : 214 time for calcul the mask position with numpy : 0.0016138553619384766 nb_pixel_total : 49760 time to create 1 rle with old method : 0.0634317398071289 length of segment : 458 time for calcul the mask position with numpy : 0.0012254714965820312 nb_pixel_total : 25073 time to create 1 rle with old method : 0.029311656951904297 length of segment : 198 time for calcul the mask position with numpy : 0.0006549358367919922 nb_pixel_total : 22038 time to create 1 rle with old method : 0.025819063186645508 length of segment : 260 time for calcul the mask position with numpy : 0.002410888671875 nb_pixel_total : 125037 time to create 1 rle with old method : 0.14828753471374512 length of segment : 277 time for calcul the mask position with numpy : 0.0007243156433105469 nb_pixel_total : 31665 time to create 1 rle with old method : 0.03665900230407715 length of segment : 278 time for calcul the mask position with numpy : 0.0015137195587158203 nb_pixel_total : 93002 time to create 1 rle with old method : 0.1058802604675293 length of segment : 413 time for calcul the mask position with numpy : 0.0007030963897705078 nb_pixel_total : 42289 time to create 1 rle with old method : 0.06762552261352539 length of segment : 228 time for calcul the mask position with numpy : 0.0006554126739501953 nb_pixel_total : 17314 time to create 1 rle with old method : 0.020067691802978516 length of segment : 229 time for calcul the mask position with numpy : 0.001127481460571289 nb_pixel_total : 39304 time to create 1 rle with old method : 0.04653596878051758 length of segment : 183 time for calcul the mask position with numpy : 0.0003452301025390625 nb_pixel_total : 9828 time to create 1 rle with old method : 0.011861085891723633 length of segment : 142 time for calcul the mask position with numpy : 0.0020911693572998047 nb_pixel_total : 68267 time to create 1 rle with old method : 0.07838010787963867 length of segment : 301 time for calcul the mask position with numpy : 0.0006415843963623047 nb_pixel_total : 28369 time to create 1 rle with old method : 0.03408408164978027 length of segment : 205 time for calcul the mask position with numpy : 0.0007741451263427734 nb_pixel_total : 22400 time to create 1 rle with old method : 0.026317834854125977 length of segment : 176 time for calcul the mask position with numpy : 0.0008738040924072266 nb_pixel_total : 24733 time to create 1 rle with old method : 0.02942943572998047 length of segment : 198 time for calcul the mask position with numpy : 0.001809835433959961 nb_pixel_total : 41822 time to create 1 rle with old method : 0.05181241035461426 length of segment : 321 time for calcul the mask position with numpy : 0.0018553733825683594 nb_pixel_total : 68938 time to create 1 rle with old method : 0.08076095581054688 length of segment : 393 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 11811 time to create 1 rle with old method : 0.012827873229980469 length of segment : 184 time for calcul the mask position with numpy : 0.0005512237548828125 nb_pixel_total : 11985 time to create 1 rle with old method : 0.014052867889404297 length of segment : 149 time for calcul the mask position with numpy : 0.0008599758148193359 nb_pixel_total : 16160 time to create 1 rle with old method : 0.019649267196655273 length of segment : 164 time for calcul the mask position with numpy : 0.0008511543273925781 nb_pixel_total : 23503 time to create 1 rle with old method : 0.028142690658569336 length of segment : 157 time for calcul the mask position with numpy : 0.0003910064697265625 nb_pixel_total : 8914 time to create 1 rle with old method : 0.010431289672851562 length of segment : 84 time for calcul the mask position with numpy : 0.0007185935974121094 nb_pixel_total : 17833 time to create 1 rle with old method : 0.02341294288635254 length of segment : 152 time for calcul the mask position with numpy : 0.0011086463928222656 nb_pixel_total : 27350 time to create 1 rle with old method : 0.03149843215942383 length of segment : 239 time for calcul the mask position with numpy : 0.0006978511810302734 nb_pixel_total : 15418 time to create 1 rle with old method : 0.0184633731842041 length of segment : 171 time for calcul the mask position with numpy : 0.0005781650543212891 nb_pixel_total : 14280 time to create 1 rle with old method : 0.017020225524902344 length of segment : 120 time for calcul the mask position with numpy : 0.0005776882171630859 nb_pixel_total : 9535 time to create 1 rle with old method : 0.011362075805664062 length of segment : 175 time for calcul the mask position with numpy : 0.00032448768615722656 nb_pixel_total : 7428 time to create 1 rle with old method : 0.009030580520629883 length of segment : 75 time for calcul the mask position with numpy : 0.00041556358337402344 nb_pixel_total : 13078 time to create 1 rle with old method : 0.015793800354003906 length of segment : 122 time for calcul the mask position with numpy : 0.003404855728149414 nb_pixel_total : 31166 time to create 1 rle with old method : 0.040727853775024414 length of segment : 422 time for calcul the mask position with numpy : 0.000286102294921875 nb_pixel_total : 5668 time to create 1 rle with old method : 0.006773710250854492 length of segment : 75 time for calcul the mask position with numpy : 0.0020301342010498047 nb_pixel_total : 50352 time to create 1 rle with old method : 0.05740475654602051 length of segment : 328 time for calcul the mask position with numpy : 0.0013399124145507812 nb_pixel_total : 12327 time to create 1 rle with old method : 0.020316362380981445 length of segment : 277 time for calcul the mask position with numpy : 0.325298547744751 nb_pixel_total : 794862 time to create 1 rle with new method : 0.09611868858337402 length of segment : 1202 time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 44442 time to create 1 rle with old method : 0.04931211471557617 length of segment : 442 time for calcul the mask position with numpy : 0.0011813640594482422 nb_pixel_total : 67029 time to create 1 rle with old method : 0.07662248611450195 length of segment : 428 time for calcul the mask position with numpy : 0.001294851303100586 nb_pixel_total : 42348 time to create 1 rle with old method : 0.04732251167297363 length of segment : 372 time for calcul the mask position with numpy : 0.0011301040649414062 nb_pixel_total : 64738 time to create 1 rle with old method : 0.07369661331176758 length of segment : 457 time for calcul the mask position with numpy : 0.0005342960357666016 nb_pixel_total : 11839 time to create 1 rle with old method : 0.013219833374023438 length of segment : 147 time for calcul the mask position with numpy : 0.000988006591796875 nb_pixel_total : 19194 time to create 1 rle with old method : 0.02216935157775879 length of segment : 292 time for calcul the mask position with numpy : 0.0007996559143066406 nb_pixel_total : 23911 time to create 1 rle with old method : 0.027709007263183594 length of segment : 153 time for calcul the mask position with numpy : 0.002628803253173828 nb_pixel_total : 71089 time to create 1 rle with old method : 0.0819544792175293 length of segment : 409 time for calcul the mask position with numpy : 0.0007543563842773438 nb_pixel_total : 13704 time to create 1 rle with old method : 0.016178369522094727 length of segment : 171 time for calcul the mask position with numpy : 0.0009319782257080078 nb_pixel_total : 15058 time to create 1 rle with old method : 0.018102407455444336 length of segment : 157 time for calcul the mask position with numpy : 0.002691984176635742 nb_pixel_total : 90084 time to create 1 rle with old method : 0.11796689033508301 length of segment : 302 time for calcul the mask position with numpy : 0.0023894309997558594 nb_pixel_total : 53776 time to create 1 rle with old method : 0.06571316719055176 length of segment : 460 time for calcul the mask position with numpy : 0.0024323463439941406 nb_pixel_total : 67999 time to create 1 rle with old method : 0.07949280738830566 length of segment : 288 time for calcul the mask position with numpy : 0.0009582042694091797 nb_pixel_total : 26707 time to create 1 rle with old method : 0.031016111373901367 length of segment : 258 time for calcul the mask position with numpy : 0.0014047622680664062 nb_pixel_total : 40017 time to create 1 rle with old method : 0.04619860649108887 length of segment : 266 time for calcul the mask position with numpy : 0.0028755664825439453 nb_pixel_total : 83342 time to create 1 rle with old method : 0.09507584571838379 length of segment : 652 time for calcul the mask position with numpy : 0.0020134449005126953 nb_pixel_total : 57341 time to create 1 rle with old method : 0.0655832290649414 length of segment : 345 time for calcul the mask position with numpy : 0.0007870197296142578 nb_pixel_total : 22906 time to create 1 rle with old method : 0.02666926383972168 length of segment : 161 time for calcul the mask position with numpy : 0.0002949237823486328 nb_pixel_total : 8079 time to create 1 rle with old method : 0.0098876953125 length of segment : 73 time for calcul the mask position with numpy : 0.0006289482116699219 nb_pixel_total : 21798 time to create 1 rle with old method : 0.02535843849182129 length of segment : 166 time for calcul the mask position with numpy : 0.0014383792877197266 nb_pixel_total : 52945 time to create 1 rle with old method : 0.08017444610595703 length of segment : 236 time for calcul the mask position with numpy : 0.0012967586517333984 nb_pixel_total : 55328 time to create 1 rle with old method : 0.08429145812988281 length of segment : 273 time for calcul the mask position with numpy : 0.0003418922424316406 nb_pixel_total : 13321 time to create 1 rle with old method : 0.015593767166137695 length of segment : 221 time for calcul the mask position with numpy : 0.00030994415283203125 nb_pixel_total : 7597 time to create 1 rle with old method : 0.009626626968383789 length of segment : 81 time for calcul the mask position with numpy : 0.0011196136474609375 nb_pixel_total : 16580 time to create 1 rle with old method : 0.01978015899658203 length of segment : 472 time for calcul the mask position with numpy : 0.0034227371215820312 nb_pixel_total : 135356 time to create 1 rle with old method : 0.15356087684631348 length of segment : 262 time for calcul the mask position with numpy : 0.0004565715789794922 nb_pixel_total : 8618 time to create 1 rle with old method : 0.010068416595458984 length of segment : 140 time for calcul the mask position with numpy : 0.00464320182800293 nb_pixel_total : 167605 time to create 1 rle with new method : 0.008766651153564453 length of segment : 684 time for calcul the mask position with numpy : 0.004019260406494141 nb_pixel_total : 158770 time to create 1 rle with new method : 0.0054166316986083984 length of segment : 463 time for calcul the mask position with numpy : 0.006105899810791016 nb_pixel_total : 212166 time to create 1 rle with new method : 0.009562253952026367 length of segment : 605 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 8012 time to create 1 rle with old method : 0.009718894958496094 length of segment : 62 time for calcul the mask position with numpy : 0.0021114349365234375 nb_pixel_total : 84724 time to create 1 rle with old method : 0.09904742240905762 length of segment : 259 time for calcul the mask position with numpy : 0.0009033679962158203 nb_pixel_total : 26735 time to create 1 rle with old method : 0.03139758110046387 length of segment : 199 time for calcul the mask position with numpy : 0.001336812973022461 nb_pixel_total : 29729 time to create 1 rle with old method : 0.04173874855041504 length of segment : 270 time for calcul the mask position with numpy : 0.003416776657104492 nb_pixel_total : 84419 time to create 1 rle with old method : 0.09617400169372559 length of segment : 370 time for calcul the mask position with numpy : 0.0035409927368164062 nb_pixel_total : 90945 time to create 1 rle with old method : 0.11123442649841309 length of segment : 248 time for calcul the mask position with numpy : 0.003046274185180664 nb_pixel_total : 49487 time to create 1 rle with old method : 0.07369852066040039 length of segment : 318 time for calcul the mask position with numpy : 0.0070612430572509766 nb_pixel_total : 181936 time to create 1 rle with new method : 0.009158849716186523 length of segment : 775 time for calcul the mask position with numpy : 0.0016961097717285156 nb_pixel_total : 45913 time to create 1 rle with old method : 0.051602840423583984 length of segment : 284 time for calcul the mask position with numpy : 0.0018048286437988281 nb_pixel_total : 41149 time to create 1 rle with old method : 0.0523679256439209 length of segment : 363 time for calcul the mask position with numpy : 0.0013954639434814453 nb_pixel_total : 36412 time to create 1 rle with old method : 0.04325151443481445 length of segment : 160 time for calcul the mask position with numpy : 0.003326416015625 nb_pixel_total : 78589 time to create 1 rle with old method : 0.09278607368469238 length of segment : 636 time for calcul the mask position with numpy : 0.0031049251556396484 nb_pixel_total : 58473 time to create 1 rle with old method : 0.06632637977600098 length of segment : 500 time for calcul the mask position with numpy : 0.0011210441589355469 nb_pixel_total : 22220 time to create 1 rle with old method : 0.025832176208496094 length of segment : 225 time for calcul the mask position with numpy : 0.0013070106506347656 nb_pixel_total : 30636 time to create 1 rle with old method : 0.035512447357177734 length of segment : 257 time for calcul the mask position with numpy : 0.0009410381317138672 nb_pixel_total : 21894 time to create 1 rle with old method : 0.025925636291503906 length of segment : 188 time for calcul the mask position with numpy : 0.0006272792816162109 nb_pixel_total : 14547 time to create 1 rle with old method : 0.016809940338134766 length of segment : 181 time for calcul the mask position with numpy : 0.0029053688049316406 nb_pixel_total : 47801 time to create 1 rle with old method : 0.06041860580444336 length of segment : 443 time for calcul the mask position with numpy : 0.002837657928466797 nb_pixel_total : 102444 time to create 1 rle with old method : 0.1347031593322754 length of segment : 274 time for calcul the mask position with numpy : 0.0006361007690429688 nb_pixel_total : 19587 time to create 1 rle with old method : 0.024665117263793945 length of segment : 138 time for calcul the mask position with numpy : 0.001299142837524414 nb_pixel_total : 28671 time to create 1 rle with old method : 0.03452801704406738 length of segment : 197 time for calcul the mask position with numpy : 0.0048711299896240234 nb_pixel_total : 146960 time to create 1 rle with old method : 0.16507577896118164 length of segment : 467 time for calcul the mask position with numpy : 0.0017118453979492188 nb_pixel_total : 48692 time to create 1 rle with old method : 0.06158781051635742 length of segment : 209 time for calcul the mask position with numpy : 0.00220489501953125 nb_pixel_total : 51862 time to create 1 rle with old method : 0.07889223098754883 length of segment : 191 time for calcul the mask position with numpy : 0.0012118816375732422 nb_pixel_total : 25408 time to create 1 rle with old method : 0.02962779998779297 length of segment : 143 time for calcul the mask position with numpy : 0.0009107589721679688 nb_pixel_total : 18612 time to create 1 rle with old method : 0.021883726119995117 length of segment : 131 time for calcul the mask position with numpy : 0.0012848377227783203 nb_pixel_total : 34241 time to create 1 rle with old method : 0.03960895538330078 length of segment : 164 time for calcul the mask position with numpy : 0.0014529228210449219 nb_pixel_total : 37455 time to create 1 rle with old method : 0.04419851303100586 length of segment : 268 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 10412 time to create 1 rle with old method : 0.013901710510253906 length of segment : 152 time for calcul the mask position with numpy : 0.002796649932861328 nb_pixel_total : 38062 time to create 1 rle with old method : 0.04552865028381348 length of segment : 295 time for calcul the mask position with numpy : 0.0008022785186767578 nb_pixel_total : 16516 time to create 1 rle with old method : 0.02431511878967285 length of segment : 196 time for calcul the mask position with numpy : 0.0004057884216308594 nb_pixel_total : 10205 time to create 1 rle with old method : 0.012451410293579102 length of segment : 94 time for calcul the mask position with numpy : 0.0016279220581054688 nb_pixel_total : 40675 time to create 1 rle with old method : 0.04840517044067383 length of segment : 368 time for calcul the mask position with numpy : 0.00032973289489746094 nb_pixel_total : 6258 time to create 1 rle with old method : 0.0075681209564208984 length of segment : 97 time for calcul the mask position with numpy : 0.0006864070892333984 nb_pixel_total : 16768 time to create 1 rle with old method : 0.019317150115966797 length of segment : 269 time for calcul the mask position with numpy : 0.0005199909210205078 nb_pixel_total : 10047 time to create 1 rle with old method : 0.01194143295288086 length of segment : 122 time for calcul the mask position with numpy : 0.0009942054748535156 nb_pixel_total : 24286 time to create 1 rle with old method : 0.02797555923461914 length of segment : 237 time for calcul the mask position with numpy : 0.0006470680236816406 nb_pixel_total : 13398 time to create 1 rle with old method : 0.016153573989868164 length of segment : 218 time for calcul the mask position with numpy : 0.0009400844573974609 nb_pixel_total : 27380 time to create 1 rle with old method : 0.032128334045410156 length of segment : 127 time for calcul the mask position with numpy : 0.0007257461547851562 nb_pixel_total : 19485 time to create 1 rle with old method : 0.022336244583129883 length of segment : 168 time for calcul the mask position with numpy : 0.0007660388946533203 nb_pixel_total : 19134 time to create 1 rle with old method : 0.022396564483642578 length of segment : 141 time for calcul the mask position with numpy : 0.0005567073822021484 nb_pixel_total : 14792 time to create 1 rle with old method : 0.017847776412963867 length of segment : 86 time for calcul the mask position with numpy : 0.0007336139678955078 nb_pixel_total : 17891 time to create 1 rle with old method : 0.020940780639648438 length of segment : 237 time for calcul the mask position with numpy : 0.000499725341796875 nb_pixel_total : 13036 time to create 1 rle with old method : 0.02105545997619629 length of segment : 105 time for calcul the mask position with numpy : 0.0007946491241455078 nb_pixel_total : 17116 time to create 1 rle with old method : 0.0285031795501709 length of segment : 154 time for calcul the mask position with numpy : 0.0007607936859130859 nb_pixel_total : 18887 time to create 1 rle with old method : 0.02436065673828125 length of segment : 178 time for calcul the mask position with numpy : 0.0007197856903076172 nb_pixel_total : 17079 time to create 1 rle with old method : 0.019797801971435547 length of segment : 195 time for calcul the mask position with numpy : 0.0011365413665771484 nb_pixel_total : 24619 time to create 1 rle with old method : 0.028279542922973633 length of segment : 241 time for calcul the mask position with numpy : 0.0011758804321289062 nb_pixel_total : 21887 time to create 1 rle with old method : 0.02567148208618164 length of segment : 176 time for calcul the mask position with numpy : 0.0014660358428955078 nb_pixel_total : 46462 time to create 1 rle with old method : 0.05340576171875 length of segment : 254 time for calcul the mask position with numpy : 0.00648188591003418 nb_pixel_total : 225157 time to create 1 rle with new method : 0.009849786758422852 length of segment : 603 time for calcul the mask position with numpy : 0.00484466552734375 nb_pixel_total : 133542 time to create 1 rle with old method : 0.18963122367858887 length of segment : 567 time for calcul the mask position with numpy : 0.0014748573303222656 nb_pixel_total : 34976 time to create 1 rle with old method : 0.03992438316345215 length of segment : 358 time for calcul the mask position with numpy : 0.001055002212524414 nb_pixel_total : 25093 time to create 1 rle with old method : 0.02935338020324707 length of segment : 204 time for calcul the mask position with numpy : 0.0011777877807617188 nb_pixel_total : 36202 time to create 1 rle with old method : 0.04415082931518555 length of segment : 223 time for calcul the mask position with numpy : 0.0006093978881835938 nb_pixel_total : 11559 time to create 1 rle with old method : 0.013640165328979492 length of segment : 143 time for calcul the mask position with numpy : 0.0020563602447509766 nb_pixel_total : 58068 time to create 1 rle with old method : 0.06805968284606934 length of segment : 299 time for calcul the mask position with numpy : 0.0025794506072998047 nb_pixel_total : 69840 time to create 1 rle with old method : 0.08313298225402832 length of segment : 270 time for calcul the mask position with numpy : 0.004914283752441406 nb_pixel_total : 183403 time to create 1 rle with new method : 0.007397890090942383 length of segment : 609 time for calcul the mask position with numpy : 0.0005986690521240234 nb_pixel_total : 24669 time to create 1 rle with old method : 0.03293943405151367 length of segment : 237 time for calcul the mask position with numpy : 0.0011334419250488281 nb_pixel_total : 19874 time to create 1 rle with old method : 0.0336916446685791 length of segment : 170 time for calcul the mask position with numpy : 0.0006518363952636719 nb_pixel_total : 11983 time to create 1 rle with old method : 0.014248132705688477 length of segment : 215 time for calcul the mask position with numpy : 0.0006897449493408203 nb_pixel_total : 22593 time to create 1 rle with old method : 0.03371143341064453 length of segment : 184 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 19740 time to create 1 rle with old method : 0.023247718811035156 length of segment : 159 time for calcul the mask position with numpy : 0.00044226646423339844 nb_pixel_total : 12810 time to create 1 rle with old method : 0.015236377716064453 length of segment : 91 time for calcul the mask position with numpy : 0.0006787776947021484 nb_pixel_total : 16290 time to create 1 rle with old method : 0.019331693649291992 length of segment : 129 time for calcul the mask position with numpy : 0.001191854476928711 nb_pixel_total : 27312 time to create 1 rle with old method : 0.03153514862060547 length of segment : 264 time for calcul the mask position with numpy : 0.0035941600799560547 nb_pixel_total : 59314 time to create 1 rle with old method : 0.0679469108581543 length of segment : 330 time for calcul the mask position with numpy : 0.003186464309692383 nb_pixel_total : 82188 time to create 1 rle with old method : 0.09486913681030273 length of segment : 287 time for calcul the mask position with numpy : 0.007414102554321289 nb_pixel_total : 173812 time to create 1 rle with new method : 0.010936737060546875 length of segment : 697 time for calcul the mask position with numpy : 0.0006058216094970703 nb_pixel_total : 11600 time to create 1 rle with old method : 0.013493537902832031 length of segment : 122 time for calcul the mask position with numpy : 0.000629425048828125 nb_pixel_total : 12126 time to create 1 rle with old method : 0.014244794845581055 length of segment : 177 time for calcul the mask position with numpy : 0.0026879310607910156 nb_pixel_total : 65525 time to create 1 rle with old method : 0.07622194290161133 length of segment : 510 time for calcul the mask position with numpy : 0.001085519790649414 nb_pixel_total : 26454 time to create 1 rle with old method : 0.030739307403564453 length of segment : 158 time for calcul the mask position with numpy : 0.0020151138305664062 nb_pixel_total : 37075 time to create 1 rle with old method : 0.043238162994384766 length of segment : 291 time for calcul the mask position with numpy : 0.0015888214111328125 nb_pixel_total : 38841 time to create 1 rle with old method : 0.04496002197265625 length of segment : 190 time spent for convertir_results : 14.469679117202759 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 170 chid ids of type : 3594 Number RLEs to save : 44108 save missing photos in datou_result : time spend for datou_step_exec : 95.71790194511414 time spend to save output : 2.936638593673706 total time spend for step 1 : 98.65454053878784 step2:crop_condition Fri May 16 13:32:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 170 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 110 About to insert : list_path_to_insert length 110 new photo from crops ! About to upload 110 photos upload in portfolio : 3736932 init cache_photo without model_param we have 110 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747395152_4049133 we have uploaded 110 photos in the portfolio 3736932 time of upload the photos Elapsed time : 31.62155556678772 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747395188_4049133 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.00422477722168 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3736932 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747395209_4049133 we have uploaded 42 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.496140241622925 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747395221_4049133 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8316469192504883 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358892023, 1358891685, 1358891612, 1358891573, 1358891530, 1358891502, 1358891368, 1358891234, 1358891098, 1358890977, 1358890968, 1358890964] Looping around the photos to save general results len do output : 170 /1358935116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358935583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358892023', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891685', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891612', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891573', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891530', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891502', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891368', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891234', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891098', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890977', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890968', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890964', None, None, None, None, None, '2877957') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 522 time used for this insertion : 0.07964396476745605 save_final save missing photos in datou_result : time spend for datou_step_exec : 90.84684348106384 time spend to save output : 0.08465337753295898 total time spend for step 2 : 90.9314968585968 step3:rle_unique_nms_with_priority Fri May 16 13:33:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 170 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.042470455169678 time for calcul the mask position with numpy : 0.647749662399292 nb_pixel_total : 6636195 time to create 1 rle with new method : 0.8544003963470459 time for calcul the mask position with numpy : 0.023041486740112305 nb_pixel_total : 23754 time to create 1 rle with old method : 0.029280424118041992 time for calcul the mask position with numpy : 0.021703004837036133 nb_pixel_total : 21404 time to create 1 rle with old method : 0.024607181549072266 time for calcul the mask position with numpy : 0.020959854125976562 nb_pixel_total : 30742 time to create 1 rle with old method : 0.042597055435180664 time for calcul the mask position with numpy : 0.023105382919311523 nb_pixel_total : 23370 time to create 1 rle with old method : 0.034470558166503906 time for calcul the mask position with numpy : 0.020943164825439453 nb_pixel_total : 16472 time to create 1 rle with old method : 0.018507719039916992 time for calcul the mask position with numpy : 0.020695209503173828 nb_pixel_total : 19752 time to create 1 rle with old method : 0.021770238876342773 time for calcul the mask position with numpy : 0.02170419692993164 nb_pixel_total : 44613 time to create 1 rle with old method : 0.04771065711975098 time for calcul the mask position with numpy : 0.02230691909790039 nb_pixel_total : 23075 time to create 1 rle with old method : 0.024797677993774414 time for calcul the mask position with numpy : 0.02251601219177246 nb_pixel_total : 13143 time to create 1 rle with old method : 0.014460086822509766 time for calcul the mask position with numpy : 0.023386478424072266 nb_pixel_total : 29366 time to create 1 rle with old method : 0.03308272361755371 time for calcul the mask position with numpy : 0.033338308334350586 nb_pixel_total : 24742 time to create 1 rle with old method : 0.03338336944580078 time for calcul the mask position with numpy : 0.025420188903808594 nb_pixel_total : 42518 time to create 1 rle with old method : 0.06551480293273926 time for calcul the mask position with numpy : 0.024988174438476562 nb_pixel_total : 72117 time to create 1 rle with old method : 0.0799863338470459 time for calcul the mask position with numpy : 0.0219879150390625 nb_pixel_total : 28977 time to create 1 rle with old method : 0.0317997932434082 create new chi : 2.368665933609009 time to delete rle : 0.027583837509155273 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 7618 TO DO : save crop sub photo not yet done ! save time : 0.6195700168609619 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 6.974604845046997 time for calcul the mask position with numpy : 0.6271588802337646 nb_pixel_total : 6052519 time to create 1 rle with new method : 0.7618920803070068 time for calcul the mask position with numpy : 0.023677349090576172 nb_pixel_total : 125037 time to create 1 rle with old method : 0.1487717628479004 time for calcul the mask position with numpy : 0.023027420043945312 nb_pixel_total : 22038 time to create 1 rle with old method : 0.024533748626708984 time for calcul the mask position with numpy : 0.022805213928222656 nb_pixel_total : 25073 time to create 1 rle with old method : 0.027890920639038086 time for calcul the mask position with numpy : 0.022176504135131836 nb_pixel_total : 49760 time to create 1 rle with old method : 0.053495168685913086 time for calcul the mask position with numpy : 0.02232646942138672 nb_pixel_total : 35758 time to create 1 rle with old method : 0.039279937744140625 time for calcul the mask position with numpy : 0.02169656753540039 nb_pixel_total : 29858 time to create 1 rle with old method : 0.03287148475646973 time for calcul the mask position with numpy : 0.020906448364257812 nb_pixel_total : 20495 time to create 1 rle with old method : 0.022791147232055664 time for calcul the mask position with numpy : 0.03452038764953613 nb_pixel_total : 152819 time to create 1 rle with new method : 0.7452094554901123 time for calcul the mask position with numpy : 0.03695106506347656 nb_pixel_total : 5208 time to create 1 rle with old method : 0.005959033966064453 time for calcul the mask position with numpy : 0.038163185119628906 nb_pixel_total : 146651 time to create 1 rle with old method : 0.1659998893737793 time for calcul the mask position with numpy : 0.032059431076049805 nb_pixel_total : 11135 time to create 1 rle with old method : 0.01280355453491211 time for calcul the mask position with numpy : 0.03415632247924805 nb_pixel_total : 20095 time to create 1 rle with old method : 0.024013996124267578 time for calcul the mask position with numpy : 0.028583765029907227 nb_pixel_total : 88429 time to create 1 rle with old method : 0.1071009635925293 time for calcul the mask position with numpy : 0.03177523612976074 nb_pixel_total : 31738 time to create 1 rle with old method : 0.03895306587219238 time for calcul the mask position with numpy : 0.030099153518676758 nb_pixel_total : 101893 time to create 1 rle with old method : 0.13532328605651855 time for calcul the mask position with numpy : 0.02318096160888672 nb_pixel_total : 12116 time to create 1 rle with old method : 0.014982461929321289 time for calcul the mask position with numpy : 0.022632360458374023 nb_pixel_total : 24433 time to create 1 rle with old method : 0.03110671043395996 time for calcul the mask position with numpy : 0.021220684051513672 nb_pixel_total : 13320 time to create 1 rle with old method : 0.01509857177734375 time for calcul the mask position with numpy : 0.021074771881103516 nb_pixel_total : 28818 time to create 1 rle with old method : 0.03513526916503906 time for calcul the mask position with numpy : 0.022252559661865234 nb_pixel_total : 34013 time to create 1 rle with old method : 0.0376584529876709 time for calcul the mask position with numpy : 0.022053003311157227 nb_pixel_total : 19034 time to create 1 rle with old method : 0.02199387550354004 create new chi : 3.7520740032196045 time to delete rle : 0.0016584396362304688 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 12565 TO DO : save crop sub photo not yet done ! save time : 0.8453435897827148 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 4.699427604675293 time for calcul the mask position with numpy : 0.682370662689209 nb_pixel_total : 6562309 time to create 1 rle with new method : 0.5776364803314209 time for calcul the mask position with numpy : 0.021463632583618164 nb_pixel_total : 68938 time to create 1 rle with old method : 0.08242392539978027 time for calcul the mask position with numpy : 0.045801401138305664 nb_pixel_total : 41822 time to create 1 rle with old method : 0.0662989616394043 time for calcul the mask position with numpy : 0.022408485412597656 nb_pixel_total : 24733 time to create 1 rle with old method : 0.02735590934753418 time for calcul the mask position with numpy : 0.02345132827758789 nb_pixel_total : 22400 time to create 1 rle with old method : 0.024568796157836914 time for calcul the mask position with numpy : 0.02129340171813965 nb_pixel_total : 28369 time to create 1 rle with old method : 0.031584978103637695 time for calcul the mask position with numpy : 0.021511077880859375 nb_pixel_total : 68267 time to create 1 rle with old method : 0.07540225982666016 time for calcul the mask position with numpy : 0.02277207374572754 nb_pixel_total : 9828 time to create 1 rle with old method : 0.01091623306274414 time for calcul the mask position with numpy : 0.022321224212646484 nb_pixel_total : 39304 time to create 1 rle with old method : 0.04334712028503418 time for calcul the mask position with numpy : 0.021210908889770508 nb_pixel_total : 17314 time to create 1 rle with old method : 0.01924276351928711 time for calcul the mask position with numpy : 0.026017427444458008 nb_pixel_total : 42289 time to create 1 rle with old method : 0.04748058319091797 time for calcul the mask position with numpy : 0.0221712589263916 nb_pixel_total : 93002 time to create 1 rle with old method : 0.10475826263427734 time for calcul the mask position with numpy : 0.02377033233642578 nb_pixel_total : 31665 time to create 1 rle with old method : 0.03624129295349121 create new chi : 2.164487600326538 time to delete rle : 0.0011708736419677734 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8294 TO DO : save crop sub photo not yet done ! save time : 0.5705149173736572 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 7.102025747299194 time for calcul the mask position with numpy : 0.5550689697265625 nb_pixel_total : 5891780 time to create 1 rle with new method : 0.710627555847168 time for calcul the mask position with numpy : 0.021169662475585938 nb_pixel_total : 42348 time to create 1 rle with old method : 0.04699301719665527 time for calcul the mask position with numpy : 0.02001214027404785 nb_pixel_total : 44442 time to create 1 rle with old method : 0.04836273193359375 time for calcul the mask position with numpy : 0.02506709098815918 nb_pixel_total : 794862 time to create 1 rle with new method : 0.7137517929077148 time for calcul the mask position with numpy : 0.020359039306640625 nb_pixel_total : 12327 time to create 1 rle with old method : 0.01352834701538086 time for calcul the mask position with numpy : 0.020435094833374023 nb_pixel_total : 50352 time to create 1 rle with old method : 0.05534100532531738 time for calcul the mask position with numpy : 0.02083754539489746 nb_pixel_total : 5668 time to create 1 rle with old method : 0.006262302398681641 time for calcul the mask position with numpy : 0.020428895950317383 nb_pixel_total : 31166 time to create 1 rle with old method : 0.03391885757446289 time for calcul the mask position with numpy : 0.019458770751953125 nb_pixel_total : 13078 time to create 1 rle with old method : 0.014085769653320312 time for calcul the mask position with numpy : 0.020426034927368164 nb_pixel_total : 7428 time to create 1 rle with old method : 0.007958412170410156 time for calcul the mask position with numpy : 0.020381450653076172 nb_pixel_total : 9535 time to create 1 rle with old method : 0.010326147079467773 time for calcul the mask position with numpy : 0.02035236358642578 nb_pixel_total : 14280 time to create 1 rle with old method : 0.01573491096496582 time for calcul the mask position with numpy : 0.021008014678955078 nb_pixel_total : 15418 time to create 1 rle with old method : 0.01649641990661621 time for calcul the mask position with numpy : 0.021108627319335938 nb_pixel_total : 27350 time to create 1 rle with old method : 0.0291597843170166 time for calcul the mask position with numpy : 0.020287275314331055 nb_pixel_total : 17833 time to create 1 rle with old method : 0.018948078155517578 time for calcul the mask position with numpy : 0.020473957061767578 nb_pixel_total : 8914 time to create 1 rle with old method : 0.009784221649169922 time for calcul the mask position with numpy : 0.02009892463684082 nb_pixel_total : 23503 time to create 1 rle with old method : 0.025786161422729492 time for calcul the mask position with numpy : 0.020457744598388672 nb_pixel_total : 16160 time to create 1 rle with old method : 0.01742696762084961 time for calcul the mask position with numpy : 0.021111488342285156 nb_pixel_total : 11985 time to create 1 rle with old method : 0.012861251831054688 time for calcul the mask position with numpy : 0.020457983016967773 nb_pixel_total : 11811 time to create 1 rle with old method : 0.012917757034301758 create new chi : 2.8334553241729736 time to delete rle : 0.0017545223236083984 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 11980 TO DO : save crop sub photo not yet done ! save time : 0.7665989398956299 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 6.864791393280029 time for calcul the mask position with numpy : 0.5697348117828369 nb_pixel_total : 6453471 time to create 1 rle with new method : 0.933495044708252 time for calcul the mask position with numpy : 0.023224353790283203 nb_pixel_total : 22906 time to create 1 rle with old method : 0.028031110763549805 time for calcul the mask position with numpy : 0.0253140926361084 nb_pixel_total : 57341 time to create 1 rle with old method : 0.06959939002990723 time for calcul the mask position with numpy : 0.022981882095336914 nb_pixel_total : 83342 time to create 1 rle with old method : 0.09801506996154785 time for calcul the mask position with numpy : 0.02865910530090332 nb_pixel_total : 40017 time to create 1 rle with old method : 0.05659675598144531 time for calcul the mask position with numpy : 0.030896663665771484 nb_pixel_total : 26509 time to create 1 rle with old method : 0.032678842544555664 time for calcul the mask position with numpy : 0.026605606079101562 nb_pixel_total : 67999 time to create 1 rle with old method : 0.0771489143371582 time for calcul the mask position with numpy : 0.024518728256225586 nb_pixel_total : 53776 time to create 1 rle with old method : 0.06068253517150879 time for calcul the mask position with numpy : 0.022988080978393555 nb_pixel_total : 90084 time to create 1 rle with old method : 0.10487651824951172 time for calcul the mask position with numpy : 0.026186227798461914 nb_pixel_total : 15058 time to create 1 rle with old method : 0.024715185165405273 time for calcul the mask position with numpy : 0.02559804916381836 nb_pixel_total : 13704 time to create 1 rle with old method : 0.015468835830688477 time for calcul the mask position with numpy : 0.02304387092590332 nb_pixel_total : 71089 time to create 1 rle with old method : 0.08329367637634277 time for calcul the mask position with numpy : 0.029052734375 nb_pixel_total : 23911 time to create 1 rle with old method : 0.031974077224731445 time for calcul the mask position with numpy : 0.02782297134399414 nb_pixel_total : 19194 time to create 1 rle with old method : 0.024626493453979492 time for calcul the mask position with numpy : 0.02316761016845703 nb_pixel_total : 11839 time to create 1 rle with old method : 0.013417482376098633 create new chi : 2.6318178176879883 time to delete rle : 0.002936840057373047 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10258 TO DO : save crop sub photo not yet done ! save time : 0.6989259719848633 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.320164203643799 time for calcul the mask position with numpy : 0.6863691806793213 nb_pixel_total : 6874592 time to create 1 rle with new method : 1.0440850257873535 time for calcul the mask position with numpy : 0.036136627197265625 nb_pixel_total : 16580 time to create 1 rle with old method : 0.018800020217895508 time for calcul the mask position with numpy : 0.036226749420166016 nb_pixel_total : 7597 time to create 1 rle with old method : 0.008730888366699219 time for calcul the mask position with numpy : 0.03915047645568848 nb_pixel_total : 13321 time to create 1 rle with old method : 0.015393495559692383 time for calcul the mask position with numpy : 0.03789091110229492 nb_pixel_total : 55328 time to create 1 rle with old method : 0.0620577335357666 time for calcul the mask position with numpy : 0.033837080001831055 nb_pixel_total : 52945 time to create 1 rle with old method : 0.061528682708740234 time for calcul the mask position with numpy : 0.02560901641845703 nb_pixel_total : 21798 time to create 1 rle with old method : 0.02539372444152832 time for calcul the mask position with numpy : 0.024784326553344727 nb_pixel_total : 8079 time to create 1 rle with old method : 0.009253501892089844 create new chi : 2.2108209133148193 time to delete rle : 0.0011730194091796875 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 5204 TO DO : save crop sub photo not yet done ! save time : 0.3716869354248047 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.1169557571411133 time for calcul the mask position with numpy : 0.7231874465942383 nb_pixel_total : 6248254 time to create 1 rle with new method : 1.0616748332977295 time for calcul the mask position with numpy : 0.022214889526367188 nb_pixel_total : 26735 time to create 1 rle with old method : 0.03688812255859375 time for calcul the mask position with numpy : 0.02352619171142578 nb_pixel_total : 84724 time to create 1 rle with old method : 0.0966641902923584 time for calcul the mask position with numpy : 0.022310733795166016 nb_pixel_total : 8012 time to create 1 rle with old method : 0.009003162384033203 time for calcul the mask position with numpy : 0.022337913513183594 nb_pixel_total : 212166 time to create 1 rle with new method : 0.4941980838775635 time for calcul the mask position with numpy : 0.025913238525390625 nb_pixel_total : 158770 time to create 1 rle with new method : 0.7021744251251221 time for calcul the mask position with numpy : 0.022705793380737305 nb_pixel_total : 167605 time to create 1 rle with new method : 0.5195579528808594 time for calcul the mask position with numpy : 0.031922340393066406 nb_pixel_total : 8618 time to create 1 rle with old method : 0.010080099105834961 time for calcul the mask position with numpy : 0.03009200096130371 nb_pixel_total : 135356 time to create 1 rle with old method : 0.1483008861541748 create new chi : 4.120704889297485 time to delete rle : 0.0011157989501953125 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7508 TO DO : save crop sub photo not yet done ! save time : 0.5115101337432861 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 8.733288049697876 time for calcul the mask position with numpy : 0.613741397857666 nb_pixel_total : 5817917 time to create 1 rle with new method : 0.8022146224975586 time for calcul the mask position with numpy : 0.024824142456054688 nb_pixel_total : 51819 time to create 1 rle with old method : 0.05719494819641113 time for calcul the mask position with numpy : 0.035503387451171875 nb_pixel_total : 48692 time to create 1 rle with old method : 0.05902552604675293 time for calcul the mask position with numpy : 0.039424896240234375 nb_pixel_total : 146960 time to create 1 rle with old method : 0.16757965087890625 time for calcul the mask position with numpy : 0.04075145721435547 nb_pixel_total : 28671 time to create 1 rle with old method : 0.03753471374511719 time for calcul the mask position with numpy : 0.03348731994628906 nb_pixel_total : 19587 time to create 1 rle with old method : 0.025410175323486328 time for calcul the mask position with numpy : 0.04042530059814453 nb_pixel_total : 102444 time to create 1 rle with old method : 0.11187958717346191 time for calcul the mask position with numpy : 0.03307700157165527 nb_pixel_total : 47801 time to create 1 rle with old method : 0.0599665641784668 time for calcul the mask position with numpy : 0.04037761688232422 nb_pixel_total : 14547 time to create 1 rle with old method : 0.023871660232543945 time for calcul the mask position with numpy : 0.0536646842956543 nb_pixel_total : 21894 time to create 1 rle with old method : 0.03199005126953125 time for calcul the mask position with numpy : 0.05366039276123047 nb_pixel_total : 30636 time to create 1 rle with old method : 0.04059600830078125 time for calcul the mask position with numpy : 0.03656196594238281 nb_pixel_total : 22220 time to create 1 rle with old method : 0.024845600128173828 time for calcul the mask position with numpy : 0.021704912185668945 nb_pixel_total : 58473 time to create 1 rle with old method : 0.0654759407043457 time for calcul the mask position with numpy : 0.02228236198425293 nb_pixel_total : 78589 time to create 1 rle with old method : 0.08997702598571777 time for calcul the mask position with numpy : 0.022234439849853516 nb_pixel_total : 36412 time to create 1 rle with old method : 0.040839433670043945 time for calcul the mask position with numpy : 0.02186441421508789 nb_pixel_total : 41149 time to create 1 rle with old method : 0.04521012306213379 time for calcul the mask position with numpy : 0.022498130798339844 nb_pixel_total : 45913 time to create 1 rle with old method : 0.05093193054199219 time for calcul the mask position with numpy : 0.0214235782623291 nb_pixel_total : 181936 time to create 1 rle with new method : 0.7857046127319336 time for calcul the mask position with numpy : 0.02362203598022461 nb_pixel_total : 49487 time to create 1 rle with old method : 0.05219006538391113 time for calcul the mask position with numpy : 0.021493196487426758 nb_pixel_total : 90945 time to create 1 rle with old method : 0.09753704071044922 time for calcul the mask position with numpy : 0.021855831146240234 nb_pixel_total : 84419 time to create 1 rle with old method : 0.0893716812133789 time for calcul the mask position with numpy : 0.021070480346679688 nb_pixel_total : 29729 time to create 1 rle with old method : 0.036065101623535156 create new chi : 4.122309923171997 time to delete rle : 0.004271030426025391 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 15529 TO DO : save crop sub photo not yet done ! save time : 1.0005652904510498 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.9512763023376465 time for calcul the mask position with numpy : 0.5952639579772949 nb_pixel_total : 6701032 time to create 1 rle with new method : 0.7086246013641357 time for calcul the mask position with numpy : 0.03780770301818848 nb_pixel_total : 19485 time to create 1 rle with old method : 0.031339406967163086 time for calcul the mask position with numpy : 0.039203643798828125 nb_pixel_total : 27380 time to create 1 rle with old method : 0.030365705490112305 time for calcul the mask position with numpy : 0.03344225883483887 nb_pixel_total : 13398 time to create 1 rle with old method : 0.014812946319580078 time for calcul the mask position with numpy : 0.03279519081115723 nb_pixel_total : 24286 time to create 1 rle with old method : 0.026004314422607422 time for calcul the mask position with numpy : 0.03269338607788086 nb_pixel_total : 10047 time to create 1 rle with old method : 0.011260271072387695 time for calcul the mask position with numpy : 0.03262519836425781 nb_pixel_total : 16768 time to create 1 rle with old method : 0.018526792526245117 time for calcul the mask position with numpy : 0.033304452896118164 nb_pixel_total : 6258 time to create 1 rle with old method : 0.007040739059448242 time for calcul the mask position with numpy : 0.03385591506958008 nb_pixel_total : 40675 time to create 1 rle with old method : 0.04503321647644043 time for calcul the mask position with numpy : 0.03762626647949219 nb_pixel_total : 10205 time to create 1 rle with old method : 0.01204538345336914 time for calcul the mask position with numpy : 0.035500526428222656 nb_pixel_total : 16516 time to create 1 rle with old method : 0.019150733947753906 time for calcul the mask position with numpy : 0.03662252426147461 nb_pixel_total : 38062 time to create 1 rle with old method : 0.04310178756713867 time for calcul the mask position with numpy : 0.03540825843811035 nb_pixel_total : 10412 time to create 1 rle with old method : 0.011757850646972656 time for calcul the mask position with numpy : 0.03486442565917969 nb_pixel_total : 37455 time to create 1 rle with old method : 0.04324483871459961 time for calcul the mask position with numpy : 0.035269737243652344 nb_pixel_total : 34241 time to create 1 rle with old method : 0.04147171974182129 time for calcul the mask position with numpy : 0.03476095199584961 nb_pixel_total : 18612 time to create 1 rle with old method : 0.021419286727905273 time for calcul the mask position with numpy : 0.03821706771850586 nb_pixel_total : 25408 time to create 1 rle with old method : 0.028882741928100586 create new chi : 2.31437087059021 time to delete rle : 0.00186920166015625 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8258 TO DO : save crop sub photo not yet done ! save time : 0.5623729228973389 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.406267166137695 time for calcul the mask position with numpy : 0.6822221279144287 nb_pixel_total : 6839337 time to create 1 rle with new method : 0.8633904457092285 time for calcul the mask position with numpy : 0.03523540496826172 nb_pixel_total : 46462 time to create 1 rle with old method : 0.05257582664489746 time for calcul the mask position with numpy : 0.03509211540222168 nb_pixel_total : 21887 time to create 1 rle with old method : 0.024925708770751953 time for calcul the mask position with numpy : 0.03701353073120117 nb_pixel_total : 24619 time to create 1 rle with old method : 0.0306851863861084 time for calcul the mask position with numpy : 0.034139394760131836 nb_pixel_total : 17079 time to create 1 rle with old method : 0.019239187240600586 time for calcul the mask position with numpy : 0.034244537353515625 nb_pixel_total : 18887 time to create 1 rle with old method : 0.021109819412231445 time for calcul the mask position with numpy : 0.03367733955383301 nb_pixel_total : 17116 time to create 1 rle with old method : 0.0191500186920166 time for calcul the mask position with numpy : 0.03951406478881836 nb_pixel_total : 13036 time to create 1 rle with old method : 0.020876169204711914 time for calcul the mask position with numpy : 0.03886055946350098 nb_pixel_total : 17891 time to create 1 rle with old method : 0.020330190658569336 time for calcul the mask position with numpy : 0.021926403045654297 nb_pixel_total : 14792 time to create 1 rle with old method : 0.016902446746826172 time for calcul the mask position with numpy : 0.022829294204711914 nb_pixel_total : 19134 time to create 1 rle with old method : 0.021348237991333008 create new chi : 2.165724992752075 time to delete rle : 0.0009853839874267578 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 5694 TO DO : save crop sub photo not yet done ! save time : 0.40851306915283203 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 8.019015789031982 time for calcul the mask position with numpy : 1.6759202480316162 nb_pixel_total : 6175154 time to create 1 rle with new method : 0.9811739921569824 time for calcul the mask position with numpy : 0.03674912452697754 nb_pixel_total : 12810 time to create 1 rle with old method : 0.014464855194091797 time for calcul the mask position with numpy : 0.0349118709564209 nb_pixel_total : 19740 time to create 1 rle with old method : 0.03862786293029785 time for calcul the mask position with numpy : 0.04081892967224121 nb_pixel_total : 22593 time to create 1 rle with old method : 0.025728702545166016 time for calcul the mask position with numpy : 0.03577995300292969 nb_pixel_total : 11983 time to create 1 rle with old method : 0.01354217529296875 time for calcul the mask position with numpy : 0.03442883491516113 nb_pixel_total : 19874 time to create 1 rle with old method : 0.02250528335571289 time for calcul the mask position with numpy : 0.035764217376708984 nb_pixel_total : 10246 time to create 1 rle with old method : 0.01157832145690918 time for calcul the mask position with numpy : 0.03577876091003418 nb_pixel_total : 183403 time to create 1 rle with new method : 0.8453123569488525 time for calcul the mask position with numpy : 0.022948026657104492 nb_pixel_total : 69840 time to create 1 rle with old method : 0.07754015922546387 time for calcul the mask position with numpy : 0.02103447914123535 nb_pixel_total : 58068 time to create 1 rle with old method : 0.06911110877990723 time for calcul the mask position with numpy : 0.022028684616088867 nb_pixel_total : 11559 time to create 1 rle with old method : 0.013000249862670898 time for calcul the mask position with numpy : 0.03302788734436035 nb_pixel_total : 36202 time to create 1 rle with old method : 0.040513038635253906 time for calcul the mask position with numpy : 0.04033684730529785 nb_pixel_total : 25093 time to create 1 rle with old method : 0.02789592742919922 time for calcul the mask position with numpy : 0.03750014305114746 nb_pixel_total : 34976 time to create 1 rle with old method : 0.039698123931884766 time for calcul the mask position with numpy : 0.03745388984680176 nb_pixel_total : 133542 time to create 1 rle with old method : 0.15691924095153809 time for calcul the mask position with numpy : 0.03924083709716797 nb_pixel_total : 225157 time to create 1 rle with new method : 0.6685690879821777 create new chi : 5.331833362579346 time to delete rle : 0.0031671524047851562 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 10657 TO DO : save crop sub photo not yet done ! save time : 0.6757047176361084 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 4.596008777618408 time for calcul the mask position with numpy : 0.7979898452758789 nb_pixel_total : 6499703 time to create 1 rle with new method : 0.7294900417327881 time for calcul the mask position with numpy : 0.03506588935852051 nb_pixel_total : 38841 time to create 1 rle with old method : 0.042499542236328125 time for calcul the mask position with numpy : 0.03439497947692871 nb_pixel_total : 37075 time to create 1 rle with old method : 0.041947364807128906 time for calcul the mask position with numpy : 0.03481340408325195 nb_pixel_total : 26454 time to create 1 rle with old method : 0.029994726181030273 time for calcul the mask position with numpy : 0.03334212303161621 nb_pixel_total : 65525 time to create 1 rle with old method : 0.07371401786804199 time for calcul the mask position with numpy : 0.02168416976928711 nb_pixel_total : 12126 time to create 1 rle with old method : 0.013211965560913086 time for calcul the mask position with numpy : 0.02046060562133789 nb_pixel_total : 11600 time to create 1 rle with old method : 0.012671709060668945 time for calcul the mask position with numpy : 0.02292919158935547 nb_pixel_total : 173812 time to create 1 rle with new method : 0.897749662399292 time for calcul the mask position with numpy : 0.03438758850097656 nb_pixel_total : 82188 time to create 1 rle with old method : 0.09590840339660645 time for calcul the mask position with numpy : 0.03838920593261719 nb_pixel_total : 59314 time to create 1 rle with old method : 0.06353640556335449 time for calcul the mask position with numpy : 0.03419661521911621 nb_pixel_total : 27312 time to create 1 rle with old method : 0.030308008193969727 time for calcul the mask position with numpy : 0.03550553321838379 nb_pixel_total : 16290 time to create 1 rle with old method : 0.02025580406188965 create new chi : 3.2596704959869385 time to delete rle : 0.0016067028045654297 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8470 TO DO : save crop sub photo not yet done ! save time : 0.5594604015350342 map_output_result : {1358892023: (0.0, 'Should be the crop_list due to order', 0), 1358891685: (0.0, 'Should be the crop_list due to order', 0), 1358891612: (0.0, 'Should be the crop_list due to order', 0), 1358891573: (0.0, 'Should be the crop_list due to order', 0), 1358891530: (0.0, 'Should be the crop_list due to order', 0), 1358891502: (0.0, 'Should be the crop_list due to order', 0), 1358891368: (0.0, 'Should be the crop_list due to order', 0), 1358891234: (0.0, 'Should be the crop_list due to order', 0), 1358891098: (0.0, 'Should be the crop_list due to order', 0), 1358890977: (0.0, 'Should be the crop_list due to order', 0), 1358890968: (0.0, 'Should be the crop_list due to order', 0), 1358890964: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358892023, 1358891685, 1358891612, 1358891573, 1358891530, 1358891502, 1358891368, 1358891234, 1358891098, 1358890977, 1358890968, 1358890964] Looping around the photos to save general results len do output : 12 /1358892023.Didn't retrieve data . /1358891685.Didn't retrieve data . /1358891612.Didn't retrieve data . /1358891573.Didn't retrieve data . /1358891530.Didn't retrieve data . /1358891502.Didn't retrieve data . /1358891368.Didn't retrieve data . /1358891234.Didn't retrieve data . /1358891098.Didn't retrieve data . /1358890977.Didn't retrieve data . /1358890968.Didn't retrieve data . /1358890964.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358892023', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891685', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891612', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891573', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891530', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891502', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891368', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891234', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891098', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890977', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890968', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890964', None, None, None, None, None, '2877957') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.013739347457885742 save_final save missing photos in datou_result : time spend for datou_step_exec : 118.23260951042175 time spend to save output : 0.014560699462890625 total time spend for step 3 : 118.24717020988464 step4:ventilate_hashtags_in_portfolio Fri May 16 13:35:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23063143 get user id for portfolio 23063143 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23063143 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','environnement','pet_fonce','flou','pet_clair','autre','background','carton','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23063143 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','environnement','pet_fonce','flou','pet_clair','autre','background','carton','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23063143 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','environnement','pet_fonce','flou','pet_clair','autre','background','carton','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23063284,23063285,23063286,23063287,23063288,23063289,23063290,23063291,23063292,23063293,23063294?tags=papier,pehd,environnement,pet_fonce,flou,pet_clair,autre,background,carton,mal_croppe,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358892023, 1358891685, 1358891612, 1358891573, 1358891530, 1358891502, 1358891368, 1358891234, 1358891098, 1358890977, 1358890968, 1358890964] Looping around the photos to save general results len do output : 1 /23063143. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358892023', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891685', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891612', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891573', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891530', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891502', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891368', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891234', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891098', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890977', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890968', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890964', None, None, None, None, None, '2877957') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.017824649810791016 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6396863460540771 time spend to save output : 0.018122434616088867 total time spend for step 4 : 1.657808780670166 step5:final Fri May 16 13:35:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358892023: ('0.09279373231738683',), 1358891685: ('0.09279373231738683',), 1358891612: ('0.09279373231738683',), 1358891573: ('0.09279373231738683',), 1358891530: ('0.09279373231738683',), 1358891502: ('0.09279373231738683',), 1358891368: ('0.09279373231738683',), 1358891234: ('0.09279373231738683',), 1358891098: ('0.09279373231738683',), 1358890977: ('0.09279373231738683',), 1358890968: ('0.09279373231738683',), 1358890964: ('0.09279373231738683',)} new output for save of step final : {1358892023: ('0.09279373231738683',), 1358891685: ('0.09279373231738683',), 1358891612: ('0.09279373231738683',), 1358891573: ('0.09279373231738683',), 1358891530: ('0.09279373231738683',), 1358891502: ('0.09279373231738683',), 1358891368: ('0.09279373231738683',), 1358891234: ('0.09279373231738683',), 1358891098: ('0.09279373231738683',), 1358890977: ('0.09279373231738683',), 1358890968: ('0.09279373231738683',), 1358890964: ('0.09279373231738683',)} [1358892023, 1358891685, 1358891612, 1358891573, 1358891530, 1358891502, 1358891368, 1358891234, 1358891098, 1358890977, 1358890968, 1358890964] Looping around the photos to save general results len do output : 12 /1358892023.Didn't retrieve data . /1358891685.Didn't retrieve data . /1358891612.Didn't retrieve data . /1358891573.Didn't retrieve data . /1358891530.Didn't retrieve data . /1358891502.Didn't retrieve data . /1358891368.Didn't retrieve data . /1358891234.Didn't retrieve data . /1358891098.Didn't retrieve data . /1358890977.Didn't retrieve data . /1358890968.Didn't retrieve data . /1358890964.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358892023', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891685', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891612', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891573', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891530', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891502', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891368', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891234', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891098', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890977', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890968', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890964', None, None, None, None, None, '2877957') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.016025543212890625 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12405824661254883 time spend to save output : 0.01667952537536621 total time spend for step 5 : 0.14073777198791504 step6:blur_detection Fri May 16 13:35:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7.jpg resize: (2160, 3264) 1358892023 -0.40992817426470957 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c.jpg resize: (2160, 3264) 1358891685 -5.167261416962957 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b.jpg resize: (2160, 3264) 1358891612 -0.8702937041342296 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd.jpg resize: (2160, 3264) 1358891573 -4.232287617954681 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96.jpg resize: (2160, 3264) 1358891530 -4.667658181168906 treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3.jpg resize: (2160, 3264) 1358891502 -0.20337341611959697 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf.jpg resize: (2160, 3264) 1358891368 -3.5298426565382637 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae.jpg resize: (2160, 3264) 1358891234 -2.9107556990692838 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a.jpg resize: (2160, 3264) 1358891098 -2.6811834344988172 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299.jpg resize: (2160, 3264) 1358890977 -2.5123017219258568 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77.jpg resize: (2160, 3264) 1358890968 -1.0282871988734674 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d.jpg resize: (2160, 3264) 1358890964 -5.456980187737371 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578171_0.png resize: (166, 165) 1358935116 -0.9464819433614426 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578170_0.png resize: (390, 246) 1358935118 -0.45244328992635546 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578175_0.png resize: (76, 427) 1358935119 -1.0356087995683538 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578163_0.png resize: (218, 255) 1358935120 -0.4408141801353376 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578192_0.png resize: (241, 172) 1358935123 -1.4708438740019394 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578185_0.png resize: (230, 559) 1358935124 -2.919716810869401 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578184_0.png resize: (190, 248) 1358935125 -2.451857043828609 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578181_0.png resize: (187, 172) 1358935127 -1.9653841878548581 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578194_0.png resize: (275, 412) 1358935128 -2.3864370493681557 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578187_0.png resize: (159, 115) 1358935129 -1.619731516083827 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578182_0.png resize: (181, 82) 1358935131 -0.8631462809232603 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578188_0.png resize: (523, 377) 1358935132 -0.14902345954027274 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578179_0.png resize: (246, 188) 1358935133 -3.5791965782197837 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578178_0.png resize: (214, 233) 1358935135 -0.8009384446561935 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578196_0.png resize: (232, 187) 1358935136 -4.950802841453553 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578180_0.png resize: (121, 145) 1358935137 -3.01034951902718 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578189_0.png resize: (84, 99) 1358935139 -2.8905769750913475 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578195_0.png resize: (198, 189) 1358935140 -4.248925354746374 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578190_0.png resize: (578, 617) 1358935141 -2.920886896422632 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578186_0.png resize: (132, 196) 1358935143 -2.4553403544891896 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578177_0.png resize: (131, 196) 1358935144 -4.10046586547428 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578206_0.png resize: (160, 190) 1358935145 -1.4491945067477285 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578199_0.png resize: (394, 392) 1358935147 -0.9382516066003568 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578198_0.png resize: (277, 186) 1358935148 -1.6376847809665434 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578204_0.png resize: (293, 327) 1358935149 -0.5584368333532624 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578208_0.png resize: (268, 243) 1358935151 -0.3375382973792634 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578203_0.png resize: (140, 97) 1358935152 -0.7800128207717756 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578201_0.png resize: (229, 105) 1358935153 0.32883833724100303 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578205_0.png resize: (205, 179) 1358935155 -0.9869690921531428 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578200_0.png resize: (217, 308) 1358935156 0.13709600598763236 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578207_0.png resize: (198, 166) 1358935157 0.7551343758621312 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578218_0.png resize: (117, 171) 1358935159 -1.6412945943225943 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578219_0.png resize: (158, 111) 1358935160 -2.649959570181647 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578212_0.png resize: (164, 166) 1358935161 -2.4115501671119586 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578224_0.png resize: (306, 244) 1358935163 -3.681123971770074 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578223_0.png resize: (75, 98) 1358935164 -0.639062435010259 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578221_0.png resize: (109, 160) 1358935165 -2.0974846657231643 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578215_0.png resize: (149, 173) 1358935168 -1.6389727700736767 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578225_0.png resize: (201, 297) 1358935169 -2.4207944162347714 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578213_0.png resize: (157, 193) 1358935170 -2.13876873333005 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578211_0.png resize: (149, 109) 1358935172 -1.341178388322445 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578222_0.png resize: (320, 358) 1358935173 -2.029312165867653 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578210_0.png resize: (184, 99) 1358935174 -2.405347220156183 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578230_0.png resize: (303, 325) 1358935175 -2.3491045538467406 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578214_0.png resize: (83, 147) 1358935177 -3.5466170792585254 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578235_0.png resize: (171, 139) 1358935178 -2.5330886492395743 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578243_0.png resize: (327, 275) 1358935179 -4.174290686204696 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578236_0.png resize: (155, 220) 1358935181 -3.2490121492675295 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578233_0.png resize: (153, 197) 1358935182 -3.4314457984827444 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578231_0.png resize: (147, 113) 1358935183 -0.20967716735688946 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578237_0.png resize: (268, 495) 1358935185 -4.437326219110224 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578232_0.png resize: (292, 132) 1358935186 -4.043913246151937 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578241_0.png resize: (199, 349) 1358935187 -2.174171729089572 treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578251_0.png resize: (392, 114) 1358935189 -3.003528600707165 treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578250_0.png resize: (77, 154) 1358935190 -1.753640823068351 treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578245_0.png resize: (72, 158) 1358935191 -0.8563760166048937 treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578249_0.png resize: (208, 78) 1358935193 1.6263115743486842 treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578246_0.png resize: (166, 177) 1358935194 0.16161442598983966 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578256_0.png resize: (605, 453) 1358935195 -0.9578505956423381 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578254_0.png resize: (684, 393) 1358935197 -2.5162682786125425 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578257_0.png resize: (62, 157) 1358935199 -1.7732581068890718 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578255_0.png resize: (399, 579) 1358935200 -3.5061377576344115 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578259_0.png resize: (197, 195) 1358935201 -2.1318157993546385 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578253_0.png resize: (140, 118) 1358935203 -3.5228611127431724 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578263_0.png resize: (317, 210) 1358935204 -1.6206868145832505 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578273_0.png resize: (181, 121) 1358935206 -1.067866937194937 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578272_0.png resize: (174, 199) 1358935207 -1.8249313950806225 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578267_0.png resize: (157, 410) 1358935208 -1.7962936364719269 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578266_0.png resize: (225, 281) 1358935210 -2.126396735599908 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578271_0.png resize: (257, 182) 1358935211 0.518658858522332 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578260_0.png resize: (269, 173) 1358935212 -0.07494428813343028 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578264_0.png resize: (668, 420) 1358935214 -2.2214011188324623 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578280_0.png resize: (191, 352) 1358935215 -4.686071260174444 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578261_0.png resize: (364, 426) 1358935216 -1.3557133762682771 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578293_0.png resize: (202, 174) 1358935217 -2.36832427016521 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578285_0.png resize: (151, 119) 1358935219 -1.8457699966282592 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578291_0.png resize: (269, 128) 1358935220 -1.3769389564110734 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578286_0.png resize: (295, 459) 1358935222 -1.2865898122902293 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578296_0.png resize: (168, 148) 1358935223 -0.5407298793926525 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578287_0.png resize: (196, 116) 1358935224 -1.7396520577033054 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578292_0.png resize: (122, 145) 1358935226 -2.0743796197539064 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578290_0.png resize: (90, 95) 1358935227 -1.0370396205415506 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578288_0.png resize: (84, 154) 1358935228 -0.9144183966335535 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578283_0.png resize: (160, 296) 1358935230 -3.2300398529928103 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578294_0.png resize: (158, 117) 1358935231 -2.131855810913223 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578302_0.png resize: (172, 165) 1358935232 -1.6892290293291337 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578303_0.png resize: (185, 148) 1358935234 -2.294120257363399 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578300_0.png resize: (105, 180) 1358935235 -1.168561427938797 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578299_0.png resize: (194, 130) 1358935236 -2.1715681279571895 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578297_0.png resize: (140, 200) 1358935238 -0.7718435294727919 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578298_0.png resize: (86, 252) 1358935239 -2.3600433737928403 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578304_0.png resize: (241, 205) 1358935240 -0.83297530465014 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578316_0.png resize: (237, 150) 1358935242 -1.13593519678886 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578315_0.png resize: (476, 490) 1358935243 -0.8670909796727996 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578311_0.png resize: (183, 309) 1358935244 -0.8775282640737742 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578321_0.png resize: (91, 210) 1358935246 0.062370381140002394 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578313_0.png resize: (270, 332) 1358935247 -1.776955311155818 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578310_0.png resize: (197, 226) 1358935248 -1.9144689809422732 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578320_0.png resize: (156, 233) 1358935249 -1.3647255660628712 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578309_0.png resize: (348, 179) 1358935251 -0.5374780843587326 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578312_0.png resize: (143, 133) 1358935252 -1.0304669893932121 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578317_0.png resize: (160, 242) 1358935253 -1.4524015619978898 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578319_0.png resize: (184, 167) 1358935255 -0.016346244019373485 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578318_0.png resize: (150, 132) 1358935256 -2.0942099233425964 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578322_0.png resize: (129, 172) 1358935257 -1.5579141845120523 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578330_0.png resize: (158, 223) 1358935259 -2.0440225829044953 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578331_0.png resize: (273, 306) 1358935260 -1.638064839159639 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578323_0.png resize: (264, 162) 1358935261 -3.541004224261285 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578332_0.png resize: (181, 341) 1358935263 -3.8054272889638314 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578328_0.png resize: (177, 83) 1358935265 -3.2210148469676505 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578167_0.png resize: (204, 201) 1358935323 -0.7714517905804 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578172_0.png resize: (158, 177) 1358935324 -1.0495039207693115 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578176_0.png resize: (166, 177) 1358935326 -0.7090596444005304 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578166_0.png resize: (152, 201) 1358935327 1.1007632918327686 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578191_0.png resize: (162, 170) 1358935328 -1.1690143456440014 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578220_0.png resize: (75, 136) 1358935330 -2.843160174338078 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578217_0.png resize: (171, 123) 1358935331 -3.1598048642183607 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578228_0.png resize: (293, 328) 1358935333 -2.5667832752652506 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578234_0.png resize: (276, 361) 1358935335 -2.463410372568605 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578270_0.png resize: (225, 154) 1358935336 -1.5117672832565556 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578274_0.png resize: (432, 220) 1358935338 -0.8138861995782422 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578279_0.png resize: (194, 313) 1358935339 -0.3517493557079887 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578268_0.png resize: (600, 261) 1358935340 -0.7407504734146114 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578284_0.png resize: (198, 318) 1358935342 -1.8310027455044577 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578301_0.png resize: (148, 163) 1358935343 -0.10993601516640487 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578327_0.png resize: (120, 133) 1358935345 -2.0668485275884305 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578169_0.png resize: (201, 178) 1358935505 -3.5407446436308914 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578165_0.png resize: (138, 429) 1358935507 -3.2641094312285617 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578164_0.png resize: (155, 601) 1358935508 -0.7075692109184327 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578168_0.png resize: (138, 118) 1358935509 -1.4942520921465723 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578174_0.png resize: (369, 213) 1358935510 -1.4254219819231781 treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578173_0.png resize: (129, 243) 1358935512 -0.2894698968206345 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578193_0.png resize: (213, 229) 1358935513 -3.4503772149579217 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578183_0.png resize: (277, 543) 1358935514 -3.430378051150021 treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578197_0.png resize: (275, 547) 1358935516 -1.4742012317168416 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578209_0.png resize: (348, 246) 1358935518 -1.419394566796817 treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578202_0.png resize: (181, 296) 1358935519 -1.1648338038045136 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578229_0.png resize: (212, 261) 1358935521 -2.665223948244131 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578226_0.png resize: (1113, 964) 1358935522 -5.0286155777298935 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578227_0.png resize: (422, 174) 1358935523 -2.6819137331770686 treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578216_0.png resize: (235, 149) 1358935525 -2.627497715435033 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578239_0.png resize: (265, 395) 1358935526 -3.010891569241161 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578242_0.png resize: (489, 278) 1358935527 -3.8759964494317654 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578238_0.png resize: (456, 180) 1358935529 -2.5420675334560694 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578240_0.png resize: (232, 155) 1358935530 -2.7533493699517098 treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578247_0.png resize: (236, 308) 1358935532 -3.322319114259595 treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578248_0.png resize: (272, 264) 1358935534 -1.5338621085623723 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578252_0.png resize: (261, 767) 1358935535 -0.5950749859123585 treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578258_0.png resize: (194, 607) 1358935536 -2.6683781049004205 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578265_0.png resize: (282, 210) 1358935538 -2.4209682528185046 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578278_0.png resize: (467, 434) 1358935539 -2.469419384596768 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578276_0.png resize: (135, 166) 1358935540 -0.5035199881961538 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578275_0.png resize: (267, 476) 1358935542 -3.1052425190130593 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578269_0.png resize: (408, 289) 1358935543 -2.348170573255443 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578262_0.png resize: (218, 515) 1358935544 -0.589384514615247 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578282_0.png resize: (118, 234) 1358935546 -1.4558074452843284 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578281_0.png resize: (140, 240) 1358935547 -0.25848244159608086 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578289_0.png resize: (221, 288) 1358935548 -2.507921951703905 treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578295_0.png resize: (124, 299) 1358935550 -2.403411580664229 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578305_0.png resize: (176, 195) 1358935551 -1.7059457124352289 treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578306_0.png resize: (251, 231) 1358935552 -2.3360329176437444 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578307_0.png resize: (536, 618) 1358935554 -0.5741749445685025 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578308_0.png resize: (563, 473) 1358935555 -0.48077254637803685 treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578314_0.png resize: (268, 342) 1358935556 -0.2920057252838564 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578326_0.png resize: (696, 407) 1358935558 -1.4716543875818227 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578324_0.png resize: (327, 396) 1358935559 -2.7754831284559343 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578325_0.png resize: (268, 497) 1358935560 -3.0891666238370115 treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578329_0.png resize: (477, 235) 1358935562 -4.550858311099363 treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578244_0.png resize: (159, 179) 1358935581 -3.265325404370592 treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578277_0.png resize: (196, 202) 1358935583 -2.130142806999345 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 182 time used for this insertion : 0.021927595138549805 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 182 time used for this insertion : 0.03447532653808594 save missing photos in datou_result : time spend for datou_step_exec : 49.23660922050476 time spend to save output : 0.06266117095947266 total time spend for step 6 : 49.29927039146423 step7:brightness Fri May 16 13:36:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7.jpg treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c.jpg treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b.jpg treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd.jpg treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96.jpg treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3.jpg treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf.jpg treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae.jpg treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a.jpg treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299.jpg treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77.jpg treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d.jpg treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578171_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578170_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578175_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578163_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578192_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578185_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578184_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578181_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578194_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578187_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578182_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578188_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578179_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578178_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578196_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578180_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578189_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578195_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578190_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578186_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578177_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578206_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578199_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578198_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578204_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578208_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578203_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578201_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578205_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578200_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578207_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578218_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578219_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578212_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578224_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578223_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578221_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578215_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578225_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578213_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578211_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578222_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578210_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578230_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578214_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578235_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578243_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578236_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578233_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578231_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578237_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578232_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578241_0.png treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578251_0.png treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578250_0.png treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578245_0.png treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578249_0.png treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578246_0.png treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578256_0.png treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578254_0.png treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578257_0.png treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578255_0.png treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578259_0.png treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578253_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578263_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578273_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578272_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578267_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578266_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578271_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578260_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578264_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578280_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578261_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578293_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578285_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578291_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578286_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578296_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578287_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578292_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578290_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578288_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578283_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578294_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578302_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578303_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578300_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578299_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578297_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578298_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578304_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578316_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578315_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578311_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578321_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578313_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578310_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578320_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578309_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578312_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578317_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578319_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578318_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578322_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578330_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578331_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578323_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578332_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578328_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578167_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578172_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578176_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578166_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578191_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578220_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578217_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578228_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578234_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578270_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578274_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578279_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578268_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578284_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578301_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578327_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578169_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578165_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578164_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578168_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578174_0.png treat image : temp/1747395030_4049133_1358892023_7492befe766bc57e1af7bd9967fd04d7_rle_crop_3801578173_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578193_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578183_0.png treat image : temp/1747395030_4049133_1358891685_15558ead8706fb82b9225cc52ecf312c_rle_crop_3801578197_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578209_0.png treat image : temp/1747395030_4049133_1358891612_df6df146a2feb1551b09b0962c2ba69b_rle_crop_3801578202_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578229_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578226_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578227_0.png treat image : temp/1747395030_4049133_1358891573_de57faf1294456af138843d1082097fd_rle_crop_3801578216_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578239_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578242_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578238_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578240_0.png treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578247_0.png treat image : temp/1747395030_4049133_1358891502_c8f9a5dd6033226dcfe1c61ca12376c3_rle_crop_3801578248_0.png treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578252_0.png treat image : temp/1747395030_4049133_1358891368_e0600665a5aac1dc7d747c4cf3ff59bf_rle_crop_3801578258_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578265_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578278_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578276_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578275_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578269_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578262_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578282_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578281_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578289_0.png treat image : temp/1747395030_4049133_1358891098_79178bfb8e44bab585c20c5198e54a3a_rle_crop_3801578295_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578305_0.png treat image : temp/1747395030_4049133_1358890977_08715e2d434b997999239f7254d18299_rle_crop_3801578306_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578307_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578308_0.png treat image : temp/1747395030_4049133_1358890968_1a85823a7faaf1f27f1811b1c3538f77_rle_crop_3801578314_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578326_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578324_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578325_0.png treat image : temp/1747395030_4049133_1358890964_e814ed051fa3c6e73a77dcc7fe18676d_rle_crop_3801578329_0.png treat image : temp/1747395030_4049133_1358891530_4798172182b547a33f68cbaa75fe2c96_rle_crop_3801578244_0.png treat image : temp/1747395030_4049133_1358891234_0c3e574ad61204891eaba786fabcedae_rle_crop_3801578277_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 182 time used for this insertion : 0.02346062660217285 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 182 time used for this insertion : 0.03431534767150879 save missing photos in datou_result : time spend for datou_step_exec : 12.334489822387695 time spend to save output : 0.06248593330383301 total time spend for step 7 : 12.396975755691528 step8:velours_tree Fri May 16 13:36:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3979361057281494 time spend to save output : 6.413459777832031e-05 total time spend for step 8 : 0.39800024032592773 step9:send_mail_cod Fri May 16 13:36:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23063143_16-05-2025_13_36_43.pdf 23063284 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230632841747395403 23063285 imagette230632851747395405 23063287 imagette230632871747395405 23063288 imagette230632881747395405 23063289 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230632891747395405 23063290 change filename to text .change filename to text .imagette230632901747395406 23063291 imagette230632911747395407 23063292 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230632921747395407 23063293 imagette230632931747395408 23063294 imagette230632941747395408 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23063143 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23063284,23063285,23063286,23063287,23063288,23063289,23063290,23063291,23063292,23063293,23063294?tags=papier,pehd,environnement,pet_fonce,flou,pet_clair,autre,background,carton,mal_croppe,metal args[1358892023] : ((1358892023, -0.40992817426470957, 492688767), (1358892023, 0.2566240911109808, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358891685] : ((1358891685, -5.167261416962957, 492609224), (1358891685, 0.1473098329496343, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358891612] : ((1358891612, -0.8702937041342296, 492688767), (1358891612, -0.030910414867064428, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358891573] : ((1358891573, -4.232287617954681, 492609224), (1358891573, 0.10010366319457957, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358891530] : ((1358891530, -4.667658181168906, 492609224), (1358891530, 0.0035980840122039177, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358891502] : ((1358891502, -0.20337341611959697, 492688767), (1358891502, -0.1713093276981583, 496442774), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358891368] : ((1358891368, -3.5298426565382637, 492609224), (1358891368, 0.07051775507839185, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358891234] : ((1358891234, -2.9107556990692838, 492609224), (1358891234, 0.33266381997936173, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358891098] : ((1358891098, -2.6811834344988172, 492609224), (1358891098, 0.17249160816461664, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358890977] : ((1358890977, -2.5123017219258568, 492609224), (1358890977, 0.06178485478434886, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358890968] : ((1358890968, -1.0282871988734674, 492688767), (1358890968, 0.3880395836006526, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com args[1358890964] : ((1358890964, -5.456980187737371, 492609224), (1358890964, 0.09175946767857772, 2107752395), '0.09279373231738683') We are sending mail with results at report@fotonower.com refus_total : 0.09279373231738683 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23063143 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23063143_16-05-2025_13_36_43.pdf results_Auto_P23063143_16-05-2025_13_36_43.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23063143_16-05-2025_13_36_43.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23063143','results_Auto_P23063143_16-05-2025_13_36_43.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23063143_16-05-2025_13_36_43.pdf','pdf','','0.66','0.09279373231738683') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23063143

https://www.fotonower.com/image?json=false&list_photos_id=1358892023
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358891685
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358891612
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358891573
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358891530
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358891502
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358891368
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358891234
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358891098
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358890977
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358890968
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358890964
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.28%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23063284?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23063289?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23063290?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23063292?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23063143_16-05-2025_13_36_43.pdf.

Lien vers velours :https://www.fotonower.com/velours/23063284,23063285,23063286,23063287,23063288,23063289,23063290,23063291,23063292,23063293,23063294?tags=papier,pehd,environnement,pet_fonce,flou,pet_clair,autre,background,carton,mal_croppe,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 16 May 2025 11:36:52 GMT Content-Length: 0 Connection: close X-Message-Id: 0DcaTdJtR_uzg-Ea8f8dUg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358892023, 1358891685, 1358891612, 1358891573, 1358891530, 1358891502, 1358891368, 1358891234, 1358891098, 1358890977, 1358890968, 1358890964] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358892023', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891685', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891612', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891573', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891530', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891502', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891368', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891234', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891098', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890977', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890968', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890964', None, None, None, None, None, '2877957') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01346445083618164 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.251482248306274 time spend to save output : 0.013686656951904297 total time spend for step 9 : 8.265168905258179 step10:split_time_score Fri May 16 13:36:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16052025 23063143 Nombre de photos uploadées : 12 / 23040 (0%) 16052025 23063143 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 16052025 23063143 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006253719329833984 elapsed_time : insert_dashboard_record_day_entry 0.022395849227905273 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14479838468426087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23051725_16-05-2025_08_40_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23051725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23051725 AND mptpi.`type`=3594 To do Qualite : 0.13390745090474465 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23054180_16-05-2025_09_19_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23054180 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23055818 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054189 order by id desc limit 1 Qualite : 0.15347928196928026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23054191_16-05-2025_09_14_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23054191 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23063142 order by id desc limit 1 Qualite : 0.09279373231738683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23063143_16-05-2025_13_36_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23063143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23063143 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16052025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358892023, 1358891685, 1358891612, 1358891573, 1358891530, 1358891502, 1358891368, 1358891234, 1358891098, 1358890977, 1358890968, 1358890964] Looping around the photos to save general results len do output : 1 /23063143Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358892023', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891685', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891612', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891573', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891530', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891502', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891368', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891234', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358891098', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890977', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890968', None, None, None, None, None, '2877957') ('3318', None, None, None, None, None, None, None, '2877957') ('3318', '23063143', '1358890964', None, None, None, None, None, '2877957') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.017946481704711914 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.6052029132843018 time spend to save output : 0.018167734146118164 total time spend for step 10 : 3.62337064743042 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 160.65user 165.36system 6:31.18elapsed 83%CPU (0avgtext+0avgdata 6059160maxresident)k 710680inputs+101936outputs (16231major+16216926minor)pagefaults 0swaps