python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2771976 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2909112'] with mtr_portfolio_ids : ['23170112'] and first list_photo_ids : [] new path : /proc/2771976/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 14 ; length of list_pids : 14 ; length of list_args : 14 time to download the photos : 4.305048942565918 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 20 15:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10440 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-20 15:20:34.806455: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-20 15:20:34.831173: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-20 15:20:34.832771: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb30c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-20 15:20:34.832793: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-20 15:20:34.836056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-20 15:20:34.981498: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x16674860 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-20 15:20:34.981545: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-20 15:20:34.982326: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 15:20:34.982687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 15:20:34.984751: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 15:20:34.986849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 15:20:34.987187: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 15:20:34.989453: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 15:20:34.990547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 15:20:34.995005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 15:20:34.996518: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 15:20:34.996604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 15:20:34.997365: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 15:20:34.997381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 15:20:34.997390: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 15:20:34.998698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-20 15:20:35.295599: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 15:20:35.295686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 15:20:35.295704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 15:20:35.295719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 15:20:35.295733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 15:20:35.295747: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 15:20:35.295761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 15:20:35.295775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 15:20:35.297234: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 15:20:35.298751: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 15:20:35.298815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 15:20:35.298834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 15:20:35.298851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 15:20:35.298868: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 15:20:35.298885: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 15:20:35.298939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 15:20:35.298962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 15:20:35.300492: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 15:20:35.300530: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 15:20:35.300539: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 15:20:35.300547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 15:20:35.301960: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-20 15:20:48.738363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 15:20:48.921480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 Detection mask done ! Trying to reset tf kernel 2772883 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5083 tf kernel not reseted sub process len(results) : 14 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 14 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10372 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010557174682617188 nb_pixel_total : 27595 time to create 1 rle with old method : 0.033800601959228516 length of segment : 149 time for calcul the mask position with numpy : 0.0017850399017333984 nb_pixel_total : 67001 time to create 1 rle with old method : 0.07486152648925781 length of segment : 237 time for calcul the mask position with numpy : 0.0025091171264648438 nb_pixel_total : 90785 time to create 1 rle with old method : 0.10030174255371094 length of segment : 374 time for calcul the mask position with numpy : 0.00023436546325683594 nb_pixel_total : 8997 time to create 1 rle with old method : 0.010345220565795898 length of segment : 154 time for calcul the mask position with numpy : 0.0003249645233154297 nb_pixel_total : 15877 time to create 1 rle with old method : 0.01832103729248047 length of segment : 160 time for calcul the mask position with numpy : 0.000331878662109375 nb_pixel_total : 13856 time to create 1 rle with old method : 0.016173362731933594 length of segment : 137 time for calcul the mask position with numpy : 0.0005595684051513672 nb_pixel_total : 30025 time to create 1 rle with old method : 0.03417706489562988 length of segment : 287 time for calcul the mask position with numpy : 0.0006251335144042969 nb_pixel_total : 21534 time to create 1 rle with old method : 0.0244901180267334 length of segment : 267 time for calcul the mask position with numpy : 0.0015254020690917969 nb_pixel_total : 68933 time to create 1 rle with old method : 0.07736635208129883 length of segment : 305 time for calcul the mask position with numpy : 0.0004990100860595703 nb_pixel_total : 20662 time to create 1 rle with old method : 0.023564577102661133 length of segment : 303 time for calcul the mask position with numpy : 0.0017993450164794922 nb_pixel_total : 93682 time to create 1 rle with old method : 0.13305211067199707 length of segment : 459 time for calcul the mask position with numpy : 0.0014655590057373047 nb_pixel_total : 46221 time to create 1 rle with old method : 0.05187058448791504 length of segment : 540 time for calcul the mask position with numpy : 0.0004649162292480469 nb_pixel_total : 18794 time to create 1 rle with old method : 0.0263822078704834 length of segment : 118 time for calcul the mask position with numpy : 0.004298686981201172 nb_pixel_total : 96433 time to create 1 rle with old method : 0.11069059371948242 length of segment : 649 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 5438 time to create 1 rle with old method : 0.006340742111206055 length of segment : 98 time for calcul the mask position with numpy : 0.0009112358093261719 nb_pixel_total : 21170 time to create 1 rle with old method : 0.031363725662231445 length of segment : 184 time for calcul the mask position with numpy : 0.002208709716796875 nb_pixel_total : 45459 time to create 1 rle with old method : 0.054662227630615234 length of segment : 308 time for calcul the mask position with numpy : 0.0007250308990478516 nb_pixel_total : 11777 time to create 1 rle with old method : 0.015076875686645508 length of segment : 103 time for calcul the mask position with numpy : 0.004202842712402344 nb_pixel_total : 61090 time to create 1 rle with old method : 0.09683537483215332 length of segment : 497 time for calcul the mask position with numpy : 0.0024111270904541016 nb_pixel_total : 57014 time to create 1 rle with old method : 0.06833028793334961 length of segment : 262 time for calcul the mask position with numpy : 0.0014085769653320312 nb_pixel_total : 68046 time to create 1 rle with old method : 0.07900285720825195 length of segment : 422 time for calcul the mask position with numpy : 0.0025691986083984375 nb_pixel_total : 64317 time to create 1 rle with old method : 0.07706904411315918 length of segment : 365 time for calcul the mask position with numpy : 0.0013113021850585938 nb_pixel_total : 69952 time to create 1 rle with old method : 0.08257508277893066 length of segment : 312 time for calcul the mask position with numpy : 0.0004661083221435547 nb_pixel_total : 6003 time to create 1 rle with old method : 0.007607221603393555 length of segment : 114 time for calcul the mask position with numpy : 0.0006716251373291016 nb_pixel_total : 18805 time to create 1 rle with old method : 0.021930932998657227 length of segment : 179 time for calcul the mask position with numpy : 0.002552032470703125 nb_pixel_total : 80302 time to create 1 rle with old method : 0.09719705581665039 length of segment : 247 time for calcul the mask position with numpy : 0.003709077835083008 nb_pixel_total : 149505 time to create 1 rle with old method : 0.17393183708190918 length of segment : 423 time for calcul the mask position with numpy : 0.0016286373138427734 nb_pixel_total : 81474 time to create 1 rle with old method : 0.0941462516784668 length of segment : 411 time for calcul the mask position with numpy : 0.001737356185913086 nb_pixel_total : 85023 time to create 1 rle with old method : 0.12401223182678223 length of segment : 386 time for calcul the mask position with numpy : 0.0022132396697998047 nb_pixel_total : 105989 time to create 1 rle with old method : 0.14052987098693848 length of segment : 543 time for calcul the mask position with numpy : 0.0008828639984130859 nb_pixel_total : 21844 time to create 1 rle with old method : 0.024950504302978516 length of segment : 169 time for calcul the mask position with numpy : 0.0001628398895263672 nb_pixel_total : 3076 time to create 1 rle with old method : 0.003727436065673828 length of segment : 93 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 3885 time to create 1 rle with old method : 0.004601240158081055 length of segment : 83 time for calcul the mask position with numpy : 0.0019478797912597656 nb_pixel_total : 97318 time to create 1 rle with old method : 0.11093282699584961 length of segment : 513 time for calcul the mask position with numpy : 0.0005102157592773438 nb_pixel_total : 10996 time to create 1 rle with old method : 0.013229131698608398 length of segment : 94 time for calcul the mask position with numpy : 0.0018930435180664062 nb_pixel_total : 52837 time to create 1 rle with old method : 0.06571197509765625 length of segment : 416 time for calcul the mask position with numpy : 0.0007417201995849609 nb_pixel_total : 39069 time to create 1 rle with old method : 0.04536771774291992 length of segment : 226 time for calcul the mask position with numpy : 0.0004982948303222656 nb_pixel_total : 27379 time to create 1 rle with old method : 0.03166317939758301 length of segment : 276 time for calcul the mask position with numpy : 0.0032660961151123047 nb_pixel_total : 153133 time to create 1 rle with new method : 0.007288217544555664 length of segment : 376 time for calcul the mask position with numpy : 0.0005426406860351562 nb_pixel_total : 25177 time to create 1 rle with old method : 0.028409481048583984 length of segment : 265 time for calcul the mask position with numpy : 0.0021593570709228516 nb_pixel_total : 113456 time to create 1 rle with old method : 0.13567733764648438 length of segment : 580 time for calcul the mask position with numpy : 0.0015192031860351562 nb_pixel_total : 37159 time to create 1 rle with old method : 0.04327654838562012 length of segment : 497 time for calcul the mask position with numpy : 0.002640962600708008 nb_pixel_total : 141688 time to create 1 rle with old method : 0.16498780250549316 length of segment : 573 time for calcul the mask position with numpy : 0.0012063980102539062 nb_pixel_total : 48695 time to create 1 rle with old method : 0.06236863136291504 length of segment : 416 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 14595 time to create 1 rle with old method : 0.01949286460876465 length of segment : 144 time for calcul the mask position with numpy : 0.0003159046173095703 nb_pixel_total : 15826 time to create 1 rle with old method : 0.018527984619140625 length of segment : 151 time for calcul the mask position with numpy : 0.003259420394897461 nb_pixel_total : 88201 time to create 1 rle with old method : 0.15172243118286133 length of segment : 323 time for calcul the mask position with numpy : 0.0008635520935058594 nb_pixel_total : 17103 time to create 1 rle with old method : 0.06923794746398926 length of segment : 146 time for calcul the mask position with numpy : 0.001337289810180664 nb_pixel_total : 25476 time to create 1 rle with old method : 0.04657554626464844 length of segment : 329 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 9999 time to create 1 rle with old method : 0.011884212493896484 length of segment : 77 time for calcul the mask position with numpy : 0.0017886161804199219 nb_pixel_total : 33116 time to create 1 rle with old method : 0.03760337829589844 length of segment : 261 time for calcul the mask position with numpy : 0.001310110092163086 nb_pixel_total : 30657 time to create 1 rle with old method : 0.034963130950927734 length of segment : 224 time for calcul the mask position with numpy : 0.7409086227416992 nb_pixel_total : 389825 time to create 1 rle with new method : 0.027938365936279297 length of segment : 849 time for calcul the mask position with numpy : 0.0008473396301269531 nb_pixel_total : 17718 time to create 1 rle with old method : 0.021366596221923828 length of segment : 160 time for calcul the mask position with numpy : 0.0014483928680419922 nb_pixel_total : 49044 time to create 1 rle with old method : 0.06304192543029785 length of segment : 189 time for calcul the mask position with numpy : 0.004355192184448242 nb_pixel_total : 111484 time to create 1 rle with old method : 0.13168978691101074 length of segment : 449 time for calcul the mask position with numpy : 0.0025751590728759766 nb_pixel_total : 61097 time to create 1 rle with old method : 0.07726907730102539 length of segment : 444 time for calcul the mask position with numpy : 0.0014107227325439453 nb_pixel_total : 28491 time to create 1 rle with old method : 0.03239321708679199 length of segment : 247 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 21114 time to create 1 rle with old method : 0.024397850036621094 length of segment : 269 time for calcul the mask position with numpy : 0.002482891082763672 nb_pixel_total : 59661 time to create 1 rle with old method : 0.0688028335571289 length of segment : 258 time for calcul the mask position with numpy : 0.002513408660888672 nb_pixel_total : 64734 time to create 1 rle with old method : 0.07383346557617188 length of segment : 353 time for calcul the mask position with numpy : 0.001260995864868164 nb_pixel_total : 20548 time to create 1 rle with old method : 0.033203125 length of segment : 270 time for calcul the mask position with numpy : 0.005218505859375 nb_pixel_total : 134825 time to create 1 rle with old method : 0.15372824668884277 length of segment : 679 time for calcul the mask position with numpy : 0.006139039993286133 nb_pixel_total : 177829 time to create 1 rle with new method : 0.01823568344116211 length of segment : 597 time for calcul the mask position with numpy : 0.0031671524047851562 nb_pixel_total : 117401 time to create 1 rle with old method : 0.1319718360900879 length of segment : 373 time for calcul the mask position with numpy : 0.001110076904296875 nb_pixel_total : 20252 time to create 1 rle with old method : 0.023334264755249023 length of segment : 240 time for calcul the mask position with numpy : 0.0012900829315185547 nb_pixel_total : 42345 time to create 1 rle with old method : 0.05147528648376465 length of segment : 223 time for calcul the mask position with numpy : 0.0007722377777099609 nb_pixel_total : 25657 time to create 1 rle with old method : 0.029622316360473633 length of segment : 239 time for calcul the mask position with numpy : 0.0007047653198242188 nb_pixel_total : 23596 time to create 1 rle with old method : 0.028148174285888672 length of segment : 201 time for calcul the mask position with numpy : 0.0015413761138916016 nb_pixel_total : 58700 time to create 1 rle with old method : 0.0659935474395752 length of segment : 440 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 18881 time to create 1 rle with old method : 0.021703481674194336 length of segment : 183 time for calcul the mask position with numpy : 0.0009038448333740234 nb_pixel_total : 18268 time to create 1 rle with old method : 0.021443605422973633 length of segment : 156 time for calcul the mask position with numpy : 0.0015461444854736328 nb_pixel_total : 44021 time to create 1 rle with old method : 0.050322532653808594 length of segment : 294 time for calcul the mask position with numpy : 0.0047359466552734375 nb_pixel_total : 166870 time to create 1 rle with new method : 0.00906682014465332 length of segment : 611 time for calcul the mask position with numpy : 0.00057220458984375 nb_pixel_total : 9615 time to create 1 rle with old method : 0.011907815933227539 length of segment : 118 time for calcul the mask position with numpy : 0.0020723342895507812 nb_pixel_total : 60689 time to create 1 rle with old method : 0.06911802291870117 length of segment : 281 time for calcul the mask position with numpy : 0.005661725997924805 nb_pixel_total : 121054 time to create 1 rle with old method : 0.13903093338012695 length of segment : 647 time for calcul the mask position with numpy : 0.0024585723876953125 nb_pixel_total : 69462 time to create 1 rle with old method : 0.0785672664642334 length of segment : 309 time for calcul the mask position with numpy : 0.000675201416015625 nb_pixel_total : 11737 time to create 1 rle with old method : 0.013336896896362305 length of segment : 170 time for calcul the mask position with numpy : 0.0006003379821777344 nb_pixel_total : 13866 time to create 1 rle with old method : 0.01927971839904785 length of segment : 136 time for calcul the mask position with numpy : 0.007861614227294922 nb_pixel_total : 205460 time to create 1 rle with new method : 0.015137195587158203 length of segment : 683 time for calcul the mask position with numpy : 0.0006933212280273438 nb_pixel_total : 14086 time to create 1 rle with old method : 0.01995062828063965 length of segment : 163 time for calcul the mask position with numpy : 0.0015430450439453125 nb_pixel_total : 37347 time to create 1 rle with old method : 0.05495762825012207 length of segment : 242 time for calcul the mask position with numpy : 0.001146078109741211 nb_pixel_total : 41971 time to create 1 rle with old method : 0.050557851791381836 length of segment : 390 time for calcul the mask position with numpy : 0.0027322769165039062 nb_pixel_total : 95887 time to create 1 rle with old method : 0.11631536483764648 length of segment : 313 time for calcul the mask position with numpy : 0.0025725364685058594 nb_pixel_total : 69360 time to create 1 rle with old method : 0.09969162940979004 length of segment : 340 time for calcul the mask position with numpy : 0.0005967617034912109 nb_pixel_total : 21307 time to create 1 rle with old method : 0.02472090721130371 length of segment : 154 time for calcul the mask position with numpy : 0.002620220184326172 nb_pixel_total : 62256 time to create 1 rle with old method : 0.07133007049560547 length of segment : 587 time for calcul the mask position with numpy : 0.001580953598022461 nb_pixel_total : 51385 time to create 1 rle with old method : 0.06020498275756836 length of segment : 292 time for calcul the mask position with numpy : 0.002169370651245117 nb_pixel_total : 72870 time to create 1 rle with old method : 0.08181405067443848 length of segment : 372 time for calcul the mask position with numpy : 0.0054645538330078125 nb_pixel_total : 209533 time to create 1 rle with new method : 0.013026237487792969 length of segment : 650 time for calcul the mask position with numpy : 0.002634286880493164 nb_pixel_total : 83497 time to create 1 rle with old method : 0.09344601631164551 length of segment : 492 time for calcul the mask position with numpy : 0.003992557525634766 nb_pixel_total : 113081 time to create 1 rle with old method : 0.12889599800109863 length of segment : 510 time for calcul the mask position with numpy : 0.003230571746826172 nb_pixel_total : 79634 time to create 1 rle with old method : 0.10574030876159668 length of segment : 508 time for calcul the mask position with numpy : 0.0009596347808837891 nb_pixel_total : 17327 time to create 1 rle with old method : 0.029262304306030273 length of segment : 220 time for calcul the mask position with numpy : 0.001394510269165039 nb_pixel_total : 20306 time to create 1 rle with old method : 0.03190422058105469 length of segment : 268 time for calcul the mask position with numpy : 0.0017940998077392578 nb_pixel_total : 52078 time to create 1 rle with old method : 0.0793311595916748 length of segment : 364 time for calcul the mask position with numpy : 0.004031181335449219 nb_pixel_total : 80304 time to create 1 rle with old method : 0.0916740894317627 length of segment : 274 time for calcul the mask position with numpy : 0.004456758499145508 nb_pixel_total : 161711 time to create 1 rle with new method : 0.009216785430908203 length of segment : 509 time for calcul the mask position with numpy : 0.004042387008666992 nb_pixel_total : 92585 time to create 1 rle with old method : 0.1068415641784668 length of segment : 384 time for calcul the mask position with numpy : 0.0016155242919921875 nb_pixel_total : 52404 time to create 1 rle with old method : 0.06154012680053711 length of segment : 298 time for calcul the mask position with numpy : 0.003347158432006836 nb_pixel_total : 104299 time to create 1 rle with old method : 0.11713290214538574 length of segment : 320 time for calcul the mask position with numpy : 0.007275581359863281 nb_pixel_total : 156704 time to create 1 rle with new method : 0.011464118957519531 length of segment : 711 time for calcul the mask position with numpy : 0.002111673355102539 nb_pixel_total : 50193 time to create 1 rle with old method : 0.05896162986755371 length of segment : 444 time for calcul the mask position with numpy : 0.00464630126953125 nb_pixel_total : 140256 time to create 1 rle with old method : 0.16550254821777344 length of segment : 551 time for calcul the mask position with numpy : 0.0005044937133789062 nb_pixel_total : 14370 time to create 1 rle with old method : 0.016803264617919922 length of segment : 98 time for calcul the mask position with numpy : 0.001317739486694336 nb_pixel_total : 26108 time to create 1 rle with old method : 0.030353307723999023 length of segment : 247 time for calcul the mask position with numpy : 0.0006546974182128906 nb_pixel_total : 20360 time to create 1 rle with old method : 0.023783206939697266 length of segment : 191 time for calcul the mask position with numpy : 0.0009238719940185547 nb_pixel_total : 28750 time to create 1 rle with old method : 0.033518075942993164 length of segment : 197 time for calcul the mask position with numpy : 0.0018656253814697266 nb_pixel_total : 75927 time to create 1 rle with old method : 0.09503412246704102 length of segment : 237 time for calcul the mask position with numpy : 0.0008029937744140625 nb_pixel_total : 23035 time to create 1 rle with old method : 0.026732683181762695 length of segment : 404 time for calcul the mask position with numpy : 0.003638744354248047 nb_pixel_total : 174373 time to create 1 rle with new method : 0.0061664581298828125 length of segment : 494 time for calcul the mask position with numpy : 0.001214742660522461 nb_pixel_total : 37209 time to create 1 rle with old method : 0.042519330978393555 length of segment : 288 time for calcul the mask position with numpy : 0.004846096038818359 nb_pixel_total : 168908 time to create 1 rle with new method : 0.007837533950805664 length of segment : 569 time for calcul the mask position with numpy : 0.0003654956817626953 nb_pixel_total : 11347 time to create 1 rle with old method : 0.012958049774169922 length of segment : 128 time for calcul the mask position with numpy : 0.0032453536987304688 nb_pixel_total : 99181 time to create 1 rle with old method : 0.11418461799621582 length of segment : 269 time for calcul the mask position with numpy : 0.00609135627746582 nb_pixel_total : 143136 time to create 1 rle with old method : 0.16175222396850586 length of segment : 861 time for calcul the mask position with numpy : 0.00032210350036621094 nb_pixel_total : 6032 time to create 1 rle with old method : 0.007398128509521484 length of segment : 87 time for calcul the mask position with numpy : 0.0021796226501464844 nb_pixel_total : 49244 time to create 1 rle with old method : 0.060865163803100586 length of segment : 257 time for calcul the mask position with numpy : 0.0004222393035888672 nb_pixel_total : 9379 time to create 1 rle with old method : 0.010987520217895508 length of segment : 75 time for calcul the mask position with numpy : 0.0009226799011230469 nb_pixel_total : 17988 time to create 1 rle with old method : 0.023100852966308594 length of segment : 164 time for calcul the mask position with numpy : 0.0011348724365234375 nb_pixel_total : 22771 time to create 1 rle with old method : 0.027083396911621094 length of segment : 156 time for calcul the mask position with numpy : 0.006333589553833008 nb_pixel_total : 91895 time to create 1 rle with old method : 0.10675883293151855 length of segment : 849 time for calcul the mask position with numpy : 0.003786325454711914 nb_pixel_total : 103580 time to create 1 rle with old method : 0.12022137641906738 length of segment : 520 time for calcul the mask position with numpy : 0.0005540847778320312 nb_pixel_total : 8636 time to create 1 rle with old method : 0.010190486907958984 length of segment : 114 time for calcul the mask position with numpy : 0.00022840499877929688 nb_pixel_total : 4785 time to create 1 rle with old method : 0.005948543548583984 length of segment : 75 time for calcul the mask position with numpy : 0.0007281303405761719 nb_pixel_total : 17072 time to create 1 rle with old method : 0.019827842712402344 length of segment : 122 time for calcul the mask position with numpy : 0.0011222362518310547 nb_pixel_total : 14161 time to create 1 rle with old method : 0.017122268676757812 length of segment : 120 time for calcul the mask position with numpy : 0.0005910396575927734 nb_pixel_total : 9780 time to create 1 rle with old method : 0.01411747932434082 length of segment : 99 time for calcul the mask position with numpy : 0.0011723041534423828 nb_pixel_total : 22417 time to create 1 rle with old method : 0.03629660606384277 length of segment : 224 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 6195 time to create 1 rle with old method : 0.007605552673339844 length of segment : 148 time for calcul the mask position with numpy : 0.007464170455932617 nb_pixel_total : 196369 time to create 1 rle with new method : 0.013646841049194336 length of segment : 553 time for calcul the mask position with numpy : 0.0011794567108154297 nb_pixel_total : 18960 time to create 1 rle with old method : 0.0216064453125 length of segment : 362 time for calcul the mask position with numpy : 0.0013937950134277344 nb_pixel_total : 43974 time to create 1 rle with old method : 0.05100440979003906 length of segment : 391 time for calcul the mask position with numpy : 0.004669666290283203 nb_pixel_total : 117525 time to create 1 rle with old method : 0.1603703498840332 length of segment : 345 time for calcul the mask position with numpy : 0.0027794837951660156 nb_pixel_total : 102270 time to create 1 rle with old method : 0.11643576622009277 length of segment : 402 time for calcul the mask position with numpy : 0.005187273025512695 nb_pixel_total : 85859 time to create 1 rle with old method : 0.09736752510070801 length of segment : 321 time for calcul the mask position with numpy : 0.0025780200958251953 nb_pixel_total : 58848 time to create 1 rle with old method : 0.066497802734375 length of segment : 382 time for calcul the mask position with numpy : 0.006258964538574219 nb_pixel_total : 145281 time to create 1 rle with old method : 0.18006181716918945 length of segment : 393 time for calcul the mask position with numpy : 0.0051500797271728516 nb_pixel_total : 95467 time to create 1 rle with old method : 0.14984512329101562 length of segment : 349 time for calcul the mask position with numpy : 0.0017299652099609375 nb_pixel_total : 49106 time to create 1 rle with old method : 0.0579378604888916 length of segment : 194 time for calcul the mask position with numpy : 0.001543283462524414 nb_pixel_total : 45239 time to create 1 rle with old method : 0.05283522605895996 length of segment : 200 time for calcul the mask position with numpy : 0.0028226375579833984 nb_pixel_total : 38892 time to create 1 rle with old method : 0.045439720153808594 length of segment : 294 time for calcul the mask position with numpy : 0.005518674850463867 nb_pixel_total : 126089 time to create 1 rle with old method : 0.14434528350830078 length of segment : 447 time for calcul the mask position with numpy : 0.0003800392150878906 nb_pixel_total : 8831 time to create 1 rle with old method : 0.011402368545532227 length of segment : 99 time for calcul the mask position with numpy : 0.000985860824584961 nb_pixel_total : 19803 time to create 1 rle with old method : 0.023181676864624023 length of segment : 130 time for calcul the mask position with numpy : 0.0020227432250976562 nb_pixel_total : 41565 time to create 1 rle with old method : 0.05639505386352539 length of segment : 238 time for calcul the mask position with numpy : 0.001577138900756836 nb_pixel_total : 32299 time to create 1 rle with old method : 0.037422895431518555 length of segment : 231 time for calcul the mask position with numpy : 0.000637054443359375 nb_pixel_total : 9514 time to create 1 rle with old method : 0.011240482330322266 length of segment : 106 time for calcul the mask position with numpy : 0.0034351348876953125 nb_pixel_total : 66016 time to create 1 rle with old method : 0.07397770881652832 length of segment : 634 time for calcul the mask position with numpy : 0.005329132080078125 nb_pixel_total : 133610 time to create 1 rle with old method : 0.16468501091003418 length of segment : 450 time for calcul the mask position with numpy : 0.0014302730560302734 nb_pixel_total : 43945 time to create 1 rle with old method : 0.05008888244628906 length of segment : 205 time for calcul the mask position with numpy : 0.0010938644409179688 nb_pixel_total : 30284 time to create 1 rle with old method : 0.03470921516418457 length of segment : 201 time for calcul the mask position with numpy : 0.0009481906890869141 nb_pixel_total : 18488 time to create 1 rle with old method : 0.021182775497436523 length of segment : 176 time for calcul the mask position with numpy : 0.0028641223907470703 nb_pixel_total : 72840 time to create 1 rle with old method : 0.08213162422180176 length of segment : 337 time for calcul the mask position with numpy : 0.0010242462158203125 nb_pixel_total : 24859 time to create 1 rle with old method : 0.02828192710876465 length of segment : 186 time for calcul the mask position with numpy : 0.0004718303680419922 nb_pixel_total : 7764 time to create 1 rle with old method : 0.009282827377319336 length of segment : 103 time for calcul the mask position with numpy : 0.0022974014282226562 nb_pixel_total : 59107 time to create 1 rle with old method : 0.12359237670898438 length of segment : 305 time for calcul the mask position with numpy : 0.0007281303405761719 nb_pixel_total : 19041 time to create 1 rle with old method : 0.021825551986694336 length of segment : 197 time for calcul the mask position with numpy : 0.0033071041107177734 nb_pixel_total : 56412 time to create 1 rle with old method : 0.0718698501586914 length of segment : 415 time for calcul the mask position with numpy : 0.002822399139404297 nb_pixel_total : 59853 time to create 1 rle with old method : 0.06768178939819336 length of segment : 295 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 18812 time to create 1 rle with old method : 0.021795988082885742 length of segment : 126 time for calcul the mask position with numpy : 0.001050710678100586 nb_pixel_total : 20364 time to create 1 rle with old method : 0.023349285125732422 length of segment : 247 time for calcul the mask position with numpy : 0.0023419857025146484 nb_pixel_total : 68148 time to create 1 rle with old method : 0.08201003074645996 length of segment : 318 time for calcul the mask position with numpy : 0.007208347320556641 nb_pixel_total : 195089 time to create 1 rle with new method : 0.014552116394042969 length of segment : 834 time for calcul the mask position with numpy : 0.00426936149597168 nb_pixel_total : 164315 time to create 1 rle with new method : 0.010550737380981445 length of segment : 521 time for calcul the mask position with numpy : 0.0047528743743896484 nb_pixel_total : 182039 time to create 1 rle with new method : 0.007811307907104492 length of segment : 416 time for calcul the mask position with numpy : 0.003720998764038086 nb_pixel_total : 69165 time to create 1 rle with old method : 0.08488583564758301 length of segment : 480 time for calcul the mask position with numpy : 0.0012712478637695312 nb_pixel_total : 35457 time to create 1 rle with old method : 0.04027438163757324 length of segment : 227 time for calcul the mask position with numpy : 0.0008754730224609375 nb_pixel_total : 17757 time to create 1 rle with old method : 0.02095317840576172 length of segment : 156 time for calcul the mask position with numpy : 0.001251220703125 nb_pixel_total : 28825 time to create 1 rle with old method : 0.034448862075805664 length of segment : 206 time for calcul the mask position with numpy : 0.0021440982818603516 nb_pixel_total : 41036 time to create 1 rle with old method : 0.05161786079406738 length of segment : 223 time for calcul the mask position with numpy : 0.0011742115020751953 nb_pixel_total : 51245 time to create 1 rle with old method : 0.06210684776306152 length of segment : 258 time for calcul the mask position with numpy : 0.0005044937133789062 nb_pixel_total : 13897 time to create 1 rle with old method : 0.01871776580810547 length of segment : 120 time for calcul the mask position with numpy : 0.0009114742279052734 nb_pixel_total : 30903 time to create 1 rle with old method : 0.03617429733276367 length of segment : 198 time for calcul the mask position with numpy : 0.0006434917449951172 nb_pixel_total : 13431 time to create 1 rle with old method : 0.016884803771972656 length of segment : 144 time for calcul the mask position with numpy : 0.0056040287017822266 nb_pixel_total : 106478 time to create 1 rle with old method : 0.12578439712524414 length of segment : 882 time for calcul the mask position with numpy : 0.0039048194885253906 nb_pixel_total : 125230 time to create 1 rle with old method : 0.15230679512023926 length of segment : 515 time for calcul the mask position with numpy : 0.002495288848876953 nb_pixel_total : 57248 time to create 1 rle with old method : 0.07099580764770508 length of segment : 330 time for calcul the mask position with numpy : 0.0023322105407714844 nb_pixel_total : 59995 time to create 1 rle with old method : 0.07795929908752441 length of segment : 323 time for calcul the mask position with numpy : 0.0031380653381347656 nb_pixel_total : 60343 time to create 1 rle with old method : 0.0724489688873291 length of segment : 619 time for calcul the mask position with numpy : 0.003827333450317383 nb_pixel_total : 125493 time to create 1 rle with old method : 0.14183807373046875 length of segment : 353 time for calcul the mask position with numpy : 0.001132965087890625 nb_pixel_total : 29384 time to create 1 rle with old method : 0.0345609188079834 length of segment : 188 time for calcul the mask position with numpy : 0.0038652420043945312 nb_pixel_total : 121002 time to create 1 rle with old method : 0.13917970657348633 length of segment : 414 time for calcul the mask position with numpy : 0.0022001266479492188 nb_pixel_total : 52845 time to create 1 rle with old method : 0.0578155517578125 length of segment : 301 time for calcul the mask position with numpy : 0.0013301372528076172 nb_pixel_total : 29401 time to create 1 rle with old method : 0.033545494079589844 length of segment : 365 time for calcul the mask position with numpy : 0.001173257827758789 nb_pixel_total : 20324 time to create 1 rle with old method : 0.022954940795898438 length of segment : 143 time for calcul the mask position with numpy : 0.005716800689697266 nb_pixel_total : 147090 time to create 1 rle with old method : 0.16131019592285156 length of segment : 691 time for calcul the mask position with numpy : 0.000865936279296875 nb_pixel_total : 22580 time to create 1 rle with old method : 0.02542281150817871 length of segment : 149 time for calcul the mask position with numpy : 0.0010519027709960938 nb_pixel_total : 21182 time to create 1 rle with old method : 0.024118900299072266 length of segment : 256 time for calcul the mask position with numpy : 0.0025343894958496094 nb_pixel_total : 99453 time to create 1 rle with old method : 0.11219358444213867 length of segment : 335 time for calcul the mask position with numpy : 0.0010194778442382812 nb_pixel_total : 30722 time to create 1 rle with old method : 0.03482317924499512 length of segment : 229 time for calcul the mask position with numpy : 0.0007677078247070312 nb_pixel_total : 45287 time to create 1 rle with old method : 0.05121588706970215 length of segment : 245 time for calcul the mask position with numpy : 0.003609895706176758 nb_pixel_total : 176717 time to create 1 rle with new method : 0.006589174270629883 length of segment : 437 time for calcul the mask position with numpy : 0.0006735324859619141 nb_pixel_total : 26310 time to create 1 rle with old method : 0.03208112716674805 length of segment : 90 time for calcul the mask position with numpy : 0.0002827644348144531 nb_pixel_total : 11379 time to create 1 rle with old method : 0.013202190399169922 length of segment : 137 time for calcul the mask position with numpy : 0.0031812191009521484 nb_pixel_total : 157393 time to create 1 rle with new method : 0.007797718048095703 length of segment : 406 time for calcul the mask position with numpy : 0.07207298278808594 nb_pixel_total : 527477 time to create 1 rle with new method : 0.36792874336242676 length of segment : 495 time spent for convertir_results : 22.776814937591553 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 198 chid ids of type : 3594 Number RLEs to save : 62960 save missing photos in datou_result : time spend for datou_step_exec : 131.75746250152588 time spend to save output : 3.6143009662628174 total time spend for step 1 : 135.3717634677887 step2:crop_condition Tue May 20 15:22:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 14 ! batch 1 Loaded 198 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 129 About to insert : list_path_to_insert length 129 new photo from crops ! About to upload 129 photos upload in portfolio : 3736932 init cache_photo without model_param we have 129 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747747401_2771976 we have uploaded 129 photos in the portfolio 3736932 time of upload the photos Elapsed time : 33.00667858123779 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747747438_2771976 we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.6891138553619385 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747747445_2771976 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8878374099731445 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 3736932 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747747471_2771976 we have uploaded 46 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.250404834747314 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747747487_2771976 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9359397888183594 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747747492_2771976 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.5331921577453613 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359808562, 1359808532, 1359808528, 1359808524, 1359808521, 1359808517, 1359808515, 1359808500, 1359808498, 1359808496, 1359808494, 1359808490, 1359808486, 1359808458] Looping around the photos to save general results len do output : 198 /1359817714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359817956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808562', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808532', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808528', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808524', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808521', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808517', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808515', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808500', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808498', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808496', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808494', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808490', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808486', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808458', None, None, None, None, None, '2909112') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 608 time used for this insertion : 0.035121917724609375 save_final save missing photos in datou_result : time spend for datou_step_exec : 127.6754846572876 time spend to save output : 0.03945302963256836 total time spend for step 2 : 127.71493768692017 step3:rle_unique_nms_with_priority Tue May 20 15:24:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 198 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 9.610791444778442 time for calcul the mask position with numpy : 0.3584263324737549 nb_pixel_total : 7481919 time to create 1 rle with new method : 2.2624733448028564 time for calcul the mask position with numpy : 0.024150848388671875 nb_pixel_total : 57014 time to create 1 rle with old method : 0.06149578094482422 time for calcul the mask position with numpy : 0.024750232696533203 nb_pixel_total : 61090 time to create 1 rle with old method : 0.06565690040588379 time for calcul the mask position with numpy : 0.02671527862548828 nb_pixel_total : 10448 time to create 1 rle with old method : 0.011628866195678711 time for calcul the mask position with numpy : 0.024805068969726562 nb_pixel_total : 45459 time to create 1 rle with old method : 0.04946255683898926 time for calcul the mask position with numpy : 0.026208877563476562 nb_pixel_total : 21170 time to create 1 rle with old method : 0.023610830307006836 time for calcul the mask position with numpy : 0.029412508010864258 nb_pixel_total : 5438 time to create 1 rle with old method : 0.006274223327636719 time for calcul the mask position with numpy : 0.02588629722595215 nb_pixel_total : 96433 time to create 1 rle with old method : 0.10876107215881348 time for calcul the mask position with numpy : 0.024966001510620117 nb_pixel_total : 18794 time to create 1 rle with old method : 0.022267580032348633 time for calcul the mask position with numpy : 0.0253603458404541 nb_pixel_total : 37688 time to create 1 rle with old method : 0.04519844055175781 time for calcul the mask position with numpy : 0.026429414749145508 nb_pixel_total : 93682 time to create 1 rle with old method : 0.10302877426147461 time for calcul the mask position with numpy : 0.026457786560058594 nb_pixel_total : 20662 time to create 1 rle with old method : 0.02252960205078125 time for calcul the mask position with numpy : 0.025217056274414062 nb_pixel_total : 68933 time to create 1 rle with old method : 0.07552838325500488 time for calcul the mask position with numpy : 0.02533888816833496 nb_pixel_total : 21534 time to create 1 rle with old method : 0.0236513614654541 time for calcul the mask position with numpy : 0.02596426010131836 nb_pixel_total : 30025 time to create 1 rle with old method : 0.032959938049316406 time for calcul the mask position with numpy : 0.024636507034301758 nb_pixel_total : 13856 time to create 1 rle with old method : 0.014951467514038086 time for calcul the mask position with numpy : 0.024829626083374023 nb_pixel_total : 15877 time to create 1 rle with old method : 0.016521692276000977 time for calcul the mask position with numpy : 0.02486252784729004 nb_pixel_total : 8997 time to create 1 rle with old method : 0.009912490844726562 time for calcul the mask position with numpy : 0.026056528091430664 nb_pixel_total : 90785 time to create 1 rle with old method : 0.11984443664550781 time for calcul the mask position with numpy : 0.026719093322753906 nb_pixel_total : 67001 time to create 1 rle with old method : 0.07290267944335938 time for calcul the mask position with numpy : 0.02564525604248047 nb_pixel_total : 27595 time to create 1 rle with old method : 0.03000187873840332 create new chi : 4.0914130210876465 time to delete rle : 0.025277376174926758 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 13242 TO DO : save crop sub photo not yet done ! save time : 0.8217928409576416 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.842958688735962 time for calcul the mask position with numpy : 0.3827030658721924 nb_pixel_total : 7375619 time to create 1 rle with new method : 1.6319458484649658 time for calcul the mask position with numpy : 0.026448488235473633 nb_pixel_total : 52837 time to create 1 rle with old method : 0.05970478057861328 time for calcul the mask position with numpy : 0.02561640739440918 nb_pixel_total : 10996 time to create 1 rle with old method : 0.012206554412841797 time for calcul the mask position with numpy : 0.025830745697021484 nb_pixel_total : 97318 time to create 1 rle with old method : 0.10822463035583496 time for calcul the mask position with numpy : 0.02983856201171875 nb_pixel_total : 3781 time to create 1 rle with old method : 0.004255771636962891 time for calcul the mask position with numpy : 0.026768207550048828 nb_pixel_total : 2589 time to create 1 rle with old method : 0.0029888153076171875 time for calcul the mask position with numpy : 0.026678085327148438 nb_pixel_total : 21844 time to create 1 rle with old method : 0.02437281608581543 time for calcul the mask position with numpy : 0.026030778884887695 nb_pixel_total : 105989 time to create 1 rle with old method : 0.11952948570251465 time for calcul the mask position with numpy : 0.026613950729370117 nb_pixel_total : 85023 time to create 1 rle with old method : 0.09767603874206543 time for calcul the mask position with numpy : 0.02973771095275879 nb_pixel_total : 81474 time to create 1 rle with old method : 0.09257769584655762 time for calcul the mask position with numpy : 0.029134511947631836 nb_pixel_total : 149505 time to create 1 rle with old method : 0.16334939002990723 time for calcul the mask position with numpy : 0.02656841278076172 nb_pixel_total : 80302 time to create 1 rle with old method : 0.09592103958129883 time for calcul the mask position with numpy : 0.03032827377319336 nb_pixel_total : 18805 time to create 1 rle with old method : 0.02332162857055664 time for calcul the mask position with numpy : 0.02692127227783203 nb_pixel_total : 6003 time to create 1 rle with old method : 0.007011890411376953 time for calcul the mask position with numpy : 0.0264434814453125 nb_pixel_total : 69952 time to create 1 rle with old method : 0.07656979560852051 time for calcul the mask position with numpy : 0.024765968322753906 nb_pixel_total : 64317 time to create 1 rle with old method : 0.07150578498840332 time for calcul the mask position with numpy : 0.025490283966064453 nb_pixel_total : 68046 time to create 1 rle with old method : 0.07363557815551758 create new chi : 3.538930892944336 time to delete rle : 0.0015988349914550781 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 11579 TO DO : save crop sub photo not yet done ! save time : 0.69856858253479 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 6.836769104003906 time for calcul the mask position with numpy : 0.4433588981628418 nb_pixel_total : 7678228 time to create 1 rle with new method : 1.009793758392334 time for calcul the mask position with numpy : 0.04286384582519531 nb_pixel_total : 15826 time to create 1 rle with old method : 0.01768183708190918 time for calcul the mask position with numpy : 0.027538776397705078 nb_pixel_total : 14595 time to create 1 rle with old method : 0.01656055450439453 time for calcul the mask position with numpy : 0.04360175132751465 nb_pixel_total : 48695 time to create 1 rle with old method : 0.05394697189331055 time for calcul the mask position with numpy : 0.04677867889404297 nb_pixel_total : 141688 time to create 1 rle with old method : 0.16943931579589844 time for calcul the mask position with numpy : 0.04449582099914551 nb_pixel_total : 37154 time to create 1 rle with old method : 0.04549360275268555 time for calcul the mask position with numpy : 0.04623818397521973 nb_pixel_total : 113456 time to create 1 rle with old method : 0.1458902359008789 time for calcul the mask position with numpy : 0.045717477798461914 nb_pixel_total : 25177 time to create 1 rle with old method : 0.028370380401611328 time for calcul the mask position with numpy : 0.04101109504699707 nb_pixel_total : 153133 time to create 1 rle with new method : 0.8570563793182373 time for calcul the mask position with numpy : 0.030162811279296875 nb_pixel_total : 27379 time to create 1 rle with old method : 0.030429601669311523 time for calcul the mask position with numpy : 0.036295413970947266 nb_pixel_total : 39069 time to create 1 rle with old method : 0.04357457160949707 create new chi : 3.3513529300689697 time to delete rle : 0.002488851547241211 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 9158 TO DO : save crop sub photo not yet done ! save time : 0.5704729557037354 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 5.996291637420654 time for calcul the mask position with numpy : 0.7325899600982666 nb_pixel_total : 7414631 time to create 1 rle with new method : 0.7229094505310059 time for calcul the mask position with numpy : 0.04110884666442871 nb_pixel_total : 21114 time to create 1 rle with old method : 0.023282766342163086 time for calcul the mask position with numpy : 0.04054737091064453 nb_pixel_total : 28491 time to create 1 rle with old method : 0.03159213066101074 time for calcul the mask position with numpy : 0.04057002067565918 nb_pixel_total : 61097 time to create 1 rle with old method : 0.06713747978210449 time for calcul the mask position with numpy : 0.04233551025390625 nb_pixel_total : 111484 time to create 1 rle with old method : 0.12250924110412598 time for calcul the mask position with numpy : 0.025788545608520508 nb_pixel_total : 49044 time to create 1 rle with old method : 0.05418539047241211 time for calcul the mask position with numpy : 0.029437541961669922 nb_pixel_total : 17718 time to create 1 rle with old method : 0.020009994506835938 time for calcul the mask position with numpy : 0.030046701431274414 nb_pixel_total : 386760 time to create 1 rle with new method : 0.893669843673706 time for calcul the mask position with numpy : 0.02570319175720215 nb_pixel_total : 30657 time to create 1 rle with old method : 0.03444957733154297 time for calcul the mask position with numpy : 0.02633380889892578 nb_pixel_total : 33116 time to create 1 rle with old method : 0.03590965270996094 time for calcul the mask position with numpy : 0.027352094650268555 nb_pixel_total : 9999 time to create 1 rle with old method : 0.011485815048217773 time for calcul the mask position with numpy : 0.03567028045654297 nb_pixel_total : 24985 time to create 1 rle with old method : 0.040381431579589844 time for calcul the mask position with numpy : 0.039754629135131836 nb_pixel_total : 17103 time to create 1 rle with old method : 0.018997669219970703 time for calcul the mask position with numpy : 0.038854122161865234 nb_pixel_total : 88201 time to create 1 rle with old method : 0.09794330596923828 create new chi : 3.4257864952087402 time to delete rle : 0.0017249584197998047 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9998 TO DO : save crop sub photo not yet done ! save time : 0.631751537322998 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 8.900082111358643 time for calcul the mask position with numpy : 0.8613083362579346 nb_pixel_total : 7113548 time to create 1 rle with new method : 0.9798331260681152 time for calcul the mask position with numpy : 0.03950047492980957 nb_pixel_total : 121054 time to create 1 rle with old method : 0.13196206092834473 time for calcul the mask position with numpy : 0.027076005935668945 nb_pixel_total : 60689 time to create 1 rle with old method : 0.06636166572570801 time for calcul the mask position with numpy : 0.025107860565185547 nb_pixel_total : 9615 time to create 1 rle with old method : 0.010461568832397461 time for calcul the mask position with numpy : 0.024714946746826172 nb_pixel_total : 166870 time to create 1 rle with new method : 0.8889424800872803 time for calcul the mask position with numpy : 0.026715517044067383 nb_pixel_total : 44010 time to create 1 rle with old method : 0.046166181564331055 time for calcul the mask position with numpy : 0.02521061897277832 nb_pixel_total : 18268 time to create 1 rle with old method : 0.02082061767578125 time for calcul the mask position with numpy : 0.02585148811340332 nb_pixel_total : 14798 time to create 1 rle with old method : 0.016130447387695312 time for calcul the mask position with numpy : 0.02521061897277832 nb_pixel_total : 58700 time to create 1 rle with old method : 0.06292080879211426 time for calcul the mask position with numpy : 0.02438044548034668 nb_pixel_total : 23596 time to create 1 rle with old method : 0.025695085525512695 time for calcul the mask position with numpy : 0.02559971809387207 nb_pixel_total : 25657 time to create 1 rle with old method : 0.027712345123291016 time for calcul the mask position with numpy : 0.026047945022583008 nb_pixel_total : 42345 time to create 1 rle with old method : 0.044954538345336914 time for calcul the mask position with numpy : 0.0246126651763916 nb_pixel_total : 20252 time to create 1 rle with old method : 0.021753549575805664 time for calcul the mask position with numpy : 0.025545358657836914 nb_pixel_total : 117401 time to create 1 rle with old method : 0.12321853637695312 time for calcul the mask position with numpy : 0.0264589786529541 nb_pixel_total : 177829 time to create 1 rle with new method : 0.9692134857177734 time for calcul the mask position with numpy : 0.028251171112060547 nb_pixel_total : 134825 time to create 1 rle with old method : 0.16268420219421387 time for calcul the mask position with numpy : 0.025043487548828125 nb_pixel_total : 20548 time to create 1 rle with old method : 0.023166418075561523 time for calcul the mask position with numpy : 0.025781869888305664 nb_pixel_total : 64734 time to create 1 rle with old method : 0.07144618034362793 time for calcul the mask position with numpy : 0.02765202522277832 nb_pixel_total : 59661 time to create 1 rle with old method : 0.06953215599060059 create new chi : 5.204463720321655 time to delete rle : 0.002365589141845703 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 14269 TO DO : save crop sub photo not yet done ! save time : 0.8633642196655273 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 8.362213373184204 time for calcul the mask position with numpy : 0.7739999294281006 nb_pixel_total : 7334923 time to create 1 rle with new method : 1.0971863269805908 time for calcul the mask position with numpy : 0.026443958282470703 nb_pixel_total : 209481 time to create 1 rle with new method : 0.9426310062408447 time for calcul the mask position with numpy : 0.02630138397216797 nb_pixel_total : 72870 time to create 1 rle with old method : 0.09049224853515625 time for calcul the mask position with numpy : 0.026613473892211914 nb_pixel_total : 51385 time to create 1 rle with old method : 0.06456518173217773 time for calcul the mask position with numpy : 0.024959325790405273 nb_pixel_total : 62256 time to create 1 rle with old method : 0.06896448135375977 time for calcul the mask position with numpy : 0.02742791175842285 nb_pixel_total : 21307 time to create 1 rle with old method : 0.023258686065673828 time for calcul the mask position with numpy : 0.026257991790771484 nb_pixel_total : 69360 time to create 1 rle with old method : 0.07600784301757812 time for calcul the mask position with numpy : 0.028512001037597656 nb_pixel_total : 95887 time to create 1 rle with old method : 0.10617971420288086 time for calcul the mask position with numpy : 0.025465965270996094 nb_pixel_total : 24973 time to create 1 rle with old method : 0.028678178787231445 time for calcul the mask position with numpy : 0.024985313415527344 nb_pixel_total : 37347 time to create 1 rle with old method : 0.04094696044921875 time for calcul the mask position with numpy : 0.025045156478881836 nb_pixel_total : 14086 time to create 1 rle with old method : 0.015336751937866211 time for calcul the mask position with numpy : 0.027703046798706055 nb_pixel_total : 205460 time to create 1 rle with new method : 0.8992445468902588 time for calcul the mask position with numpy : 0.027785539627075195 nb_pixel_total : 13866 time to create 1 rle with old method : 0.015459775924682617 time for calcul the mask position with numpy : 0.027310848236083984 nb_pixel_total : 11737 time to create 1 rle with old method : 0.013198137283325195 time for calcul the mask position with numpy : 0.028439760208129883 nb_pixel_total : 69462 time to create 1 rle with old method : 0.1004326343536377 create new chi : 4.841796875 time to delete rle : 0.0023229122161865234 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 11426 TO DO : save crop sub photo not yet done ! save time : 0.7167582511901855 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 5.698079586029053 time for calcul the mask position with numpy : 1.5195236206054688 nb_pixel_total : 7437174 time to create 1 rle with new method : 0.8364310264587402 time for calcul the mask position with numpy : 0.026230573654174805 nb_pixel_total : 104299 time to create 1 rle with old method : 0.11360955238342285 time for calcul the mask position with numpy : 0.025983095169067383 nb_pixel_total : 52404 time to create 1 rle with old method : 0.05787158012390137 time for calcul the mask position with numpy : 0.024898529052734375 nb_pixel_total : 92585 time to create 1 rle with old method : 0.10617637634277344 time for calcul the mask position with numpy : 0.02577662467956543 nb_pixel_total : 161711 time to create 1 rle with new method : 0.8990926742553711 time for calcul the mask position with numpy : 0.025717735290527344 nb_pixel_total : 80304 time to create 1 rle with old method : 0.09520626068115234 time for calcul the mask position with numpy : 0.028421878814697266 nb_pixel_total : 52078 time to create 1 rle with old method : 0.0675513744354248 time for calcul the mask position with numpy : 0.024927854537963867 nb_pixel_total : 20306 time to create 1 rle with old method : 0.022282123565673828 time for calcul the mask position with numpy : 0.024506092071533203 nb_pixel_total : 17327 time to create 1 rle with old method : 0.021051406860351562 time for calcul the mask position with numpy : 0.028024673461914062 nb_pixel_total : 79634 time to create 1 rle with old method : 0.08593320846557617 time for calcul the mask position with numpy : 0.027747631072998047 nb_pixel_total : 113081 time to create 1 rle with old method : 0.12433934211730957 time for calcul the mask position with numpy : 0.026048660278320312 nb_pixel_total : 83497 time to create 1 rle with old method : 0.09216690063476562 create new chi : 4.4063942432403564 time to delete rle : 0.0016231536865234375 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 10454 TO DO : save crop sub photo not yet done ! save time : 0.6354906558990479 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 7.859846353530884 time for calcul the mask position with numpy : 0.5306060314178467 nb_pixel_total : 7366989 time to create 1 rle with new method : 1.273160457611084 time for calcul the mask position with numpy : 0.02513885498046875 nb_pixel_total : 11218 time to create 1 rle with old method : 0.012268781661987305 time for calcul the mask position with numpy : 0.026003360748291016 nb_pixel_total : 168908 time to create 1 rle with new method : 1.018960952758789 time for calcul the mask position with numpy : 0.042633056640625 nb_pixel_total : 37209 time to create 1 rle with old method : 0.04096221923828125 time for calcul the mask position with numpy : 0.027074813842773438 nb_pixel_total : 174373 time to create 1 rle with new method : 0.854755163192749 time for calcul the mask position with numpy : 0.027010679244995117 nb_pixel_total : 23035 time to create 1 rle with old method : 0.025995731353759766 time for calcul the mask position with numpy : 0.025399446487426758 nb_pixel_total : 75927 time to create 1 rle with old method : 0.0845181941986084 time for calcul the mask position with numpy : 0.028775691986083984 nb_pixel_total : 28750 time to create 1 rle with old method : 0.032196044921875 time for calcul the mask position with numpy : 0.02825617790222168 nb_pixel_total : 20360 time to create 1 rle with old method : 0.02264881134033203 time for calcul the mask position with numpy : 0.029499530792236328 nb_pixel_total : 26108 time to create 1 rle with old method : 0.029246807098388672 time for calcul the mask position with numpy : 0.026983976364135742 nb_pixel_total : 14370 time to create 1 rle with old method : 0.016182899475097656 time for calcul the mask position with numpy : 0.027280569076538086 nb_pixel_total : 140256 time to create 1 rle with old method : 0.16551971435546875 time for calcul the mask position with numpy : 0.02559208869934082 nb_pixel_total : 50193 time to create 1 rle with old method : 0.0622553825378418 time for calcul the mask position with numpy : 0.02879047393798828 nb_pixel_total : 156704 time to create 1 rle with new method : 0.8282337188720703 create new chi : 5.499421119689941 time to delete rle : 0.0017719268798828125 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11262 TO DO : save crop sub photo not yet done ! save time : 0.6991946697235107 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 9.579921007156372 time for calcul the mask position with numpy : 0.8364574909210205 nb_pixel_total : 7409183 time to create 1 rle with new method : 0.8981175422668457 time for calcul the mask position with numpy : 0.04127669334411621 nb_pixel_total : 43974 time to create 1 rle with old method : 0.04999256134033203 time for calcul the mask position with numpy : 0.02453303337097168 nb_pixel_total : 18960 time to create 1 rle with old method : 0.022448062896728516 time for calcul the mask position with numpy : 0.02979278564453125 nb_pixel_total : 196032 time to create 1 rle with new method : 0.8648490905761719 time for calcul the mask position with numpy : 0.02546095848083496 nb_pixel_total : 6195 time to create 1 rle with old method : 0.00683140754699707 time for calcul the mask position with numpy : 0.025811433792114258 nb_pixel_total : 22417 time to create 1 rle with old method : 0.02463555335998535 time for calcul the mask position with numpy : 0.024294614791870117 nb_pixel_total : 9780 time to create 1 rle with old method : 0.010401725769042969 time for calcul the mask position with numpy : 0.024298429489135742 nb_pixel_total : 14161 time to create 1 rle with old method : 0.015089273452758789 time for calcul the mask position with numpy : 0.02490067481994629 nb_pixel_total : 17072 time to create 1 rle with old method : 0.018584728240966797 time for calcul the mask position with numpy : 0.02559971809387207 nb_pixel_total : 4784 time to create 1 rle with old method : 0.005331277847290039 time for calcul the mask position with numpy : 0.026070356369018555 nb_pixel_total : 8636 time to create 1 rle with old method : 0.009908199310302734 time for calcul the mask position with numpy : 0.025153636932373047 nb_pixel_total : 103580 time to create 1 rle with old method : 0.1126718521118164 time for calcul the mask position with numpy : 0.030598878860473633 nb_pixel_total : 91895 time to create 1 rle with old method : 0.10815596580505371 time for calcul the mask position with numpy : 0.02702045440673828 nb_pixel_total : 22771 time to create 1 rle with old method : 0.025235652923583984 time for calcul the mask position with numpy : 0.026110172271728516 nb_pixel_total : 17988 time to create 1 rle with old method : 0.01955556869506836 time for calcul the mask position with numpy : 0.02482914924621582 nb_pixel_total : 9379 time to create 1 rle with old method : 0.010570764541625977 time for calcul the mask position with numpy : 0.02533698081970215 nb_pixel_total : 49244 time to create 1 rle with old method : 0.05531740188598633 time for calcul the mask position with numpy : 0.02600836753845215 nb_pixel_total : 6032 time to create 1 rle with old method : 0.006822824478149414 time for calcul the mask position with numpy : 0.026508569717407227 nb_pixel_total : 143136 time to create 1 rle with old method : 0.15379595756530762 time for calcul the mask position with numpy : 0.024854421615600586 nb_pixel_total : 99181 time to create 1 rle with old method : 0.10724329948425293 create new chi : 3.9510273933410645 time to delete rle : 0.0019183158874511719 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 12980 TO DO : save crop sub photo not yet done ! save time : 0.8611083030700684 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 6.769027948379517 time for calcul the mask position with numpy : 0.5291244983673096 nb_pixel_total : 7420993 time to create 1 rle with new method : 0.9212629795074463 time for calcul the mask position with numpy : 0.024163246154785156 nb_pixel_total : 8831 time to create 1 rle with old method : 0.009615659713745117 time for calcul the mask position with numpy : 0.024880409240722656 nb_pixel_total : 126089 time to create 1 rle with old method : 0.1387944221496582 time for calcul the mask position with numpy : 0.02504873275756836 nb_pixel_total : 38892 time to create 1 rle with old method : 0.04320526123046875 time for calcul the mask position with numpy : 0.02423548698425293 nb_pixel_total : 45239 time to create 1 rle with old method : 0.04929804801940918 time for calcul the mask position with numpy : 0.025509357452392578 nb_pixel_total : 49106 time to create 1 rle with old method : 0.05468153953552246 time for calcul the mask position with numpy : 0.025872230529785156 nb_pixel_total : 95467 time to create 1 rle with old method : 0.14801287651062012 time for calcul the mask position with numpy : 0.03412055969238281 nb_pixel_total : 145281 time to create 1 rle with old method : 0.16287732124328613 time for calcul the mask position with numpy : 0.026563405990600586 nb_pixel_total : 58848 time to create 1 rle with old method : 0.06640124320983887 time for calcul the mask position with numpy : 0.026468515396118164 nb_pixel_total : 85859 time to create 1 rle with old method : 0.09348654747009277 time for calcul the mask position with numpy : 0.027183055877685547 nb_pixel_total : 102270 time to create 1 rle with old method : 0.1277470588684082 time for calcul the mask position with numpy : 0.027212858200073242 nb_pixel_total : 117525 time to create 1 rle with old method : 0.13410735130310059 create new chi : 2.816418170928955 time to delete rle : 0.0014624595642089844 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9012 TO DO : save crop sub photo not yet done ! save time : 0.6364858150482178 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 7.431674242019653 time for calcul the mask position with numpy : 0.806708574295044 nb_pixel_total : 7627902 time to create 1 rle with new method : 0.8018496036529541 time for calcul the mask position with numpy : 0.04487919807434082 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003781318664550781 time for calcul the mask position with numpy : 0.04289364814758301 nb_pixel_total : 59853 time to create 1 rle with old method : 0.06605219841003418 time for calcul the mask position with numpy : 0.04168367385864258 nb_pixel_total : 55324 time to create 1 rle with old method : 0.06818771362304688 time for calcul the mask position with numpy : 0.05081343650817871 nb_pixel_total : 16035 time to create 1 rle with old method : 0.01828789710998535 time for calcul the mask position with numpy : 0.0422971248626709 nb_pixel_total : 34091 time to create 1 rle with old method : 0.03692817687988281 time for calcul the mask position with numpy : 0.040244102478027344 nb_pixel_total : 7764 time to create 1 rle with old method : 0.008370161056518555 time for calcul the mask position with numpy : 0.040085554122924805 nb_pixel_total : 24859 time to create 1 rle with old method : 0.026925325393676758 time for calcul the mask position with numpy : 0.039581298828125 nb_pixel_total : 72840 time to create 1 rle with old method : 0.07912015914916992 time for calcul the mask position with numpy : 0.041656494140625 nb_pixel_total : 18488 time to create 1 rle with old method : 0.02029109001159668 time for calcul the mask position with numpy : 0.04177284240722656 nb_pixel_total : 30284 time to create 1 rle with old method : 0.033503055572509766 time for calcul the mask position with numpy : 0.041858673095703125 nb_pixel_total : 43945 time to create 1 rle with old method : 0.04880928993225098 time for calcul the mask position with numpy : 0.041764020919799805 nb_pixel_total : 133610 time to create 1 rle with old method : 0.14801669120788574 time for calcul the mask position with numpy : 0.037583112716674805 nb_pixel_total : 66016 time to create 1 rle with old method : 0.07324528694152832 time for calcul the mask position with numpy : 0.028372526168823242 nb_pixel_total : 9514 time to create 1 rle with old method : 0.01053476333618164 time for calcul the mask position with numpy : 0.0263216495513916 nb_pixel_total : 32299 time to create 1 rle with old method : 0.03529191017150879 time for calcul the mask position with numpy : 0.029664039611816406 nb_pixel_total : 41565 time to create 1 rle with old method : 0.04479479789733887 time for calcul the mask position with numpy : 0.025690793991088867 nb_pixel_total : 19803 time to create 1 rle with old method : 0.021950483322143555 create new chi : 3.055630922317505 time to delete rle : 0.002442598342895508 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10290 TO DO : save crop sub photo not yet done ! save time : 0.6404807567596436 nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 8.237635135650635 time for calcul the mask position with numpy : 0.724571704864502 nb_pixel_total : 7132893 time to create 1 rle with new method : 1.0850629806518555 time for calcul the mask position with numpy : 0.02828693389892578 nb_pixel_total : 125230 time to create 1 rle with old method : 0.13858795166015625 time for calcul the mask position with numpy : 0.02692270278930664 nb_pixel_total : 104606 time to create 1 rle with old method : 0.1156611442565918 time for calcul the mask position with numpy : 0.043914079666137695 nb_pixel_total : 13431 time to create 1 rle with old method : 0.01513528823852539 time for calcul the mask position with numpy : 0.041757822036743164 nb_pixel_total : 30903 time to create 1 rle with old method : 0.033908843994140625 time for calcul the mask position with numpy : 0.04152274131774902 nb_pixel_total : 13897 time to create 1 rle with old method : 0.01625537872314453 time for calcul the mask position with numpy : 0.04115653038024902 nb_pixel_total : 51245 time to create 1 rle with old method : 0.057761430740356445 time for calcul the mask position with numpy : 0.0418238639831543 nb_pixel_total : 41036 time to create 1 rle with old method : 0.04541945457458496 time for calcul the mask position with numpy : 0.0424199104309082 nb_pixel_total : 28825 time to create 1 rle with old method : 0.03194594383239746 time for calcul the mask position with numpy : 0.04136180877685547 nb_pixel_total : 17757 time to create 1 rle with old method : 0.020277738571166992 time for calcul the mask position with numpy : 0.03991413116455078 nb_pixel_total : 35457 time to create 1 rle with old method : 0.060120582580566406 time for calcul the mask position with numpy : 0.03216910362243652 nb_pixel_total : 69165 time to create 1 rle with old method : 0.08370661735534668 time for calcul the mask position with numpy : 0.02831244468688965 nb_pixel_total : 182039 time to create 1 rle with new method : 0.7639908790588379 time for calcul the mask position with numpy : 0.031679391860961914 nb_pixel_total : 164315 time to create 1 rle with new method : 1.0788354873657227 time for calcul the mask position with numpy : 0.028900861740112305 nb_pixel_total : 195089 time to create 1 rle with new method : 1.09138822555542 time for calcul the mask position with numpy : 0.043471574783325195 nb_pixel_total : 68148 time to create 1 rle with old method : 0.12789177894592285 time for calcul the mask position with numpy : 0.04120683670043945 nb_pixel_total : 20364 time to create 1 rle with old method : 0.02292323112487793 create new chi : 6.263918399810791 time to delete rle : 0.0034880638122558594 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 13601 TO DO : save crop sub photo not yet done ! save time : 0.8548779487609863 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 6.582922697067261 time for calcul the mask position with numpy : 0.8234684467315674 nb_pixel_total : 7547513 time to create 1 rle with new method : 0.6021268367767334 time for calcul the mask position with numpy : 0.04397773742675781 nb_pixel_total : 21182 time to create 1 rle with old method : 0.02528238296508789 time for calcul the mask position with numpy : 0.0484158992767334 nb_pixel_total : 22580 time to create 1 rle with old method : 0.025109052658081055 time for calcul the mask position with numpy : 0.04237771034240723 nb_pixel_total : 147090 time to create 1 rle with old method : 0.17061948776245117 time for calcul the mask position with numpy : 0.04305124282836914 nb_pixel_total : 20324 time to create 1 rle with old method : 0.022871732711791992 time for calcul the mask position with numpy : 0.04181051254272461 nb_pixel_total : 29401 time to create 1 rle with old method : 0.03316950798034668 time for calcul the mask position with numpy : 0.040845394134521484 nb_pixel_total : 52845 time to create 1 rle with old method : 0.05927419662475586 time for calcul the mask position with numpy : 0.04237937927246094 nb_pixel_total : 121002 time to create 1 rle with old method : 0.13575243949890137 time for calcul the mask position with numpy : 0.04242753982543945 nb_pixel_total : 29384 time to create 1 rle with old method : 0.03290414810180664 time for calcul the mask position with numpy : 0.043633460998535156 nb_pixel_total : 125493 time to create 1 rle with old method : 0.1385941505432129 time for calcul the mask position with numpy : 0.04068326950073242 nb_pixel_total : 60343 time to create 1 rle with old method : 0.07117605209350586 time for calcul the mask position with numpy : 0.037483930587768555 nb_pixel_total : 59995 time to create 1 rle with old method : 0.0667257308959961 time for calcul the mask position with numpy : 0.04081869125366211 nb_pixel_total : 57248 time to create 1 rle with old method : 0.08341264724731445 create new chi : 2.8511528968811035 time to delete rle : 0.001739501953125 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 10424 TO DO : save crop sub photo not yet done ! save time : 0.6521832942962646 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.997953176498413 time for calcul the mask position with numpy : 0.8691220283508301 nb_pixel_total : 7402135 time to create 1 rle with new method : 1.2885808944702148 time for calcul the mask position with numpy : 0.04406404495239258 nb_pixel_total : 345006 time to create 1 rle with new method : 1.0864500999450684 time for calcul the mask position with numpy : 0.025972843170166016 nb_pixel_total : 157393 time to create 1 rle with new method : 0.9143588542938232 time for calcul the mask position with numpy : 0.02622699737548828 nb_pixel_total : 11379 time to create 1 rle with old method : 0.012720108032226562 time for calcul the mask position with numpy : 0.026584386825561523 nb_pixel_total : 26310 time to create 1 rle with old method : 0.029509544372558594 time for calcul the mask position with numpy : 0.02781820297241211 nb_pixel_total : 176717 time to create 1 rle with new method : 1.0000650882720947 time for calcul the mask position with numpy : 0.04111146926879883 nb_pixel_total : 45285 time to create 1 rle with old method : 0.05075860023498535 time for calcul the mask position with numpy : 0.041936635971069336 nb_pixel_total : 30722 time to create 1 rle with old method : 0.0343937873840332 time for calcul the mask position with numpy : 0.04285097122192383 nb_pixel_total : 99453 time to create 1 rle with old method : 0.11084342002868652 create new chi : 5.814091205596924 time to delete rle : 0.0012781620025634766 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6636 TO DO : save crop sub photo not yet done ! save time : 0.4412569999694824 map_output_result : {1359808562: (0.0, 'Should be the crop_list due to order', 0), 1359808532: (0.0, 'Should be the crop_list due to order', 0), 1359808528: (0.0, 'Should be the crop_list due to order', 0), 1359808524: (0.0, 'Should be the crop_list due to order', 0), 1359808521: (0.0, 'Should be the crop_list due to order', 0), 1359808517: (0.0, 'Should be the crop_list due to order', 0), 1359808515: (0.0, 'Should be the crop_list due to order', 0), 1359808500: (0.0, 'Should be the crop_list due to order', 0), 1359808498: (0.0, 'Should be the crop_list due to order', 0), 1359808496: (0.0, 'Should be the crop_list due to order', 0), 1359808494: (0.0, 'Should be the crop_list due to order', 0), 1359808490: (0.0, 'Should be the crop_list due to order', 0), 1359808486: (0.0, 'Should be the crop_list due to order', 0), 1359808458: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359808562, 1359808532, 1359808528, 1359808524, 1359808521, 1359808517, 1359808515, 1359808500, 1359808498, 1359808496, 1359808494, 1359808490, 1359808486, 1359808458] Looping around the photos to save general results len do output : 14 /1359808562.Didn't retrieve data . /1359808532.Didn't retrieve data . /1359808528.Didn't retrieve data . /1359808524.Didn't retrieve data . /1359808521.Didn't retrieve data . /1359808517.Didn't retrieve data . /1359808515.Didn't retrieve data . /1359808500.Didn't retrieve data . /1359808498.Didn't retrieve data . /1359808496.Didn't retrieve data . /1359808494.Didn't retrieve data . /1359808490.Didn't retrieve data . /1359808486.Didn't retrieve data . /1359808458.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808562', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808532', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808528', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808524', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808521', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808517', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808515', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808500', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808498', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808496', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808494', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808490', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808486', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808458', None, None, None, None, None, '2909112') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.015122652053833008 save_final save missing photos in datou_result : time spend for datou_step_exec : 173.53754234313965 time spend to save output : 0.016469717025756836 total time spend for step 3 : 173.5540120601654 step4:ventilate_hashtags_in_portfolio Tue May 20 15:27:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23170112 get user id for portfolio 23170112 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170112 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_clair','pehd','background','pet_fonce','mal_croppe','carton','autre','papier','environnement','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170112 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_clair','pehd','background','pet_fonce','mal_croppe','carton','autre','papier','environnement','flou')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170112 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_clair','pehd','background','pet_fonce','mal_croppe','carton','autre','papier','environnement','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23170700,23170701,23170702,23170703,23170704,23170705,23170706,23170707,23170708,23170709,23170710?tags=metal,pet_clair,pehd,background,pet_fonce,mal_croppe,carton,autre,papier,environnement,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359808562, 1359808532, 1359808528, 1359808524, 1359808521, 1359808517, 1359808515, 1359808500, 1359808498, 1359808496, 1359808494, 1359808490, 1359808486, 1359808458] Looping around the photos to save general results len do output : 1 /23170112. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808562', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808532', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808528', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808524', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808521', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808517', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808515', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808500', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808498', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808496', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808494', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808490', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808486', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808458', None, None, None, None, None, '2909112') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014201879501342773 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7940945625305176 time spend to save output : 0.014860391616821289 total time spend for step 4 : 0.8089549541473389 step5:final Tue May 20 15:27:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359808562: ('0.10659472484016758',), 1359808532: ('0.10659472484016758',), 1359808528: ('0.10659472484016758',), 1359808524: ('0.10659472484016758',), 1359808521: ('0.10659472484016758',), 1359808517: ('0.10659472484016758',), 1359808515: ('0.10659472484016758',), 1359808500: ('0.10659472484016758',), 1359808498: ('0.10659472484016758',), 1359808496: ('0.10659472484016758',), 1359808494: ('0.10659472484016758',), 1359808490: ('0.10659472484016758',), 1359808486: ('0.10659472484016758',), 1359808458: ('0.10659472484016758',)} new output for save of step final : {1359808562: ('0.10659472484016758',), 1359808532: ('0.10659472484016758',), 1359808528: ('0.10659472484016758',), 1359808524: ('0.10659472484016758',), 1359808521: ('0.10659472484016758',), 1359808517: ('0.10659472484016758',), 1359808515: ('0.10659472484016758',), 1359808500: ('0.10659472484016758',), 1359808498: ('0.10659472484016758',), 1359808496: ('0.10659472484016758',), 1359808494: ('0.10659472484016758',), 1359808490: ('0.10659472484016758',), 1359808486: ('0.10659472484016758',), 1359808458: ('0.10659472484016758',)} [1359808562, 1359808532, 1359808528, 1359808524, 1359808521, 1359808517, 1359808515, 1359808500, 1359808498, 1359808496, 1359808494, 1359808490, 1359808486, 1359808458] Looping around the photos to save general results len do output : 14 /1359808562.Didn't retrieve data . /1359808532.Didn't retrieve data . /1359808528.Didn't retrieve data . /1359808524.Didn't retrieve data . /1359808521.Didn't retrieve data . /1359808517.Didn't retrieve data . /1359808515.Didn't retrieve data . /1359808500.Didn't retrieve data . /1359808498.Didn't retrieve data . /1359808496.Didn't retrieve data . /1359808494.Didn't retrieve data . /1359808490.Didn't retrieve data . /1359808486.Didn't retrieve data . /1359808458.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808562', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808532', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808528', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808524', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808521', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808517', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808515', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808500', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808498', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808496', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808494', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808490', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808486', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808458', None, None, None, None, None, '2909112') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.01310276985168457 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1230001449584961 time spend to save output : 0.014145851135253906 total time spend for step 5 : 0.13714599609375 step6:blur_detection Tue May 20 15:27:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab.jpg resize: (2160, 3840) 1359808562 -5.729582577204221 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f.jpg resize: (2160, 3840) 1359808532 -5.775563871532884 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555.jpg resize: (2160, 3840) 1359808528 -5.715157286500144 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f.jpg resize: (2160, 3840) 1359808524 -5.714692445809163 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d.jpg resize: (2160, 3840) 1359808521 -5.64462328661869 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e.jpg resize: (2160, 3840) 1359808517 -5.666851865499973 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282.jpg resize: (2160, 3840) 1359808515 -5.716403749961548 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc.jpg resize: (2160, 3840) 1359808500 -5.665066476204482 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78.jpg resize: (2160, 3840) 1359808498 -5.700972992505053 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636.jpg resize: (2160, 3840) 1359808496 -5.757552739233496 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508.jpg resize: (2160, 3840) 1359808494 -5.875413444171193 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2.jpg resize: (2160, 3840) 1359808490 -5.66771549290572 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5.jpg resize: (2160, 3840) 1359808486 -5.70864013232938 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1.jpg resize: (2160, 3840) 1359808458 -3.889752628582056 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380928_0.png resize: (149, 293) 1359817714 -1.2207402585091858 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380929_0.png resize: (237, 393) 1359817715 -1.1317803326759155 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380930_0.png resize: (374, 382) 1359817716 -2.3491570062984093 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380931_0.png resize: (153, 90) 1359817717 -2.989086313289514 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380932_0.png resize: (160, 136) 1359817718 -0.00350654022312829 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380933_0.png resize: (136, 175) 1359817719 -1.0120973984019754 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380934_0.png resize: (240, 190) 1359817720 -2.6216384919966735 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380935_0.png resize: (267, 185) 1359817721 -2.310559455641029 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380936_0.png resize: (300, 346) 1359817722 -0.8972747065170521 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380937_0.png resize: (302, 101) 1359817723 -2.2187064325188586 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380938_0.png resize: (458, 277) 1359817724 -2.3045257605057765 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380939_0.png resize: (495, 241) 1359817725 -3.578422687755872 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380941_0.png resize: (395, 465) 1359817726 -3.4795352382001496 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380942_0.png resize: (98, 74) 1359817727 -1.3006988330312208 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380943_0.png resize: (179, 172) 1359817728 -4.140525222357743 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380944_0.png resize: (304, 252) 1359817729 -3.2608326165744113 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380945_0.png resize: (101, 173) 1359817730 0.3124126949480708 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380946_0.png resize: (402, 274) 1359817731 -4.044020679692437 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380947_0.png resize: (231, 417) 1359817732 -1.8018091323033825 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380949_0.png resize: (309, 324) 1359817733 -2.9465955093038927 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380950_0.png resize: (312, 329) 1359817734 -2.502171008270385 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380951_0.png resize: (96, 179) 1359817735 -1.794376099195776 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380953_0.png resize: (242, 471) 1359817737 -2.5282550153280496 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380956_0.png resize: (303, 450) 1359817738 -3.5227182710006884 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380958_0.png resize: (157, 202) 1359817739 -2.6860337815185478 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380959_0.png resize: (85, 63) 1359817740 -3.6457545855313125 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380960_0.png resize: (83, 72) 1359817741 -2.599589417967921 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380961_0.png resize: (452, 325) 1359817742 -2.2630374394103843 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380962_0.png resize: (93, 175) 1359817743 -2.849636435636121 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380963_0.png resize: (381, 180) 1359817744 -2.7131168692499976 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380964_0.png resize: (209, 285) 1359817745 -0.3606221514646225 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380967_0.png resize: (265, 159) 1359817746 -3.072605844005609 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380968_0.png resize: (419, 489) 1359817747 -2.777317027836651 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380969_0.png resize: (424, 334) 1359817748 -1.8132584212994245 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380970_0.png resize: (486, 406) 1359817749 -3.1079154379282383 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380975_0.png resize: (146, 156) 1359817750 -0.10755855180874106 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380976_0.png resize: (249, 175) 1359817751 -3.206867319752824 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380977_0.png resize: (76, 183) 1359817752 -1.8040870884243343 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380978_0.png resize: (259, 236) 1359817753 0.3488314688492527 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380979_0.png resize: (221, 200) 1359817755 -2.047730538290482 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380984_0.png resize: (342, 303) 1359817756 2.1512853315346026 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380985_0.png resize: (247, 213) 1359817757 -2.2174863281812582 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380986_0.png resize: (246, 122) 1359817758 -1.913679302135345 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380987_0.png resize: (257, 376) 1359817759 0.702636889125594 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380988_0.png resize: (331, 309) 1359817760 -0.6666794839581356 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380989_0.png resize: (270, 119) 1359817761 -3.2607243431364927 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380990_0.png resize: (579, 336) 1359817762 -2.0309899376518574 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380993_0.png resize: (240, 134) 1359817763 -2.169672004463754 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380995_0.png resize: (239, 160) 1359817764 -4.021736794595295 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380996_0.png resize: (175, 208) 1359817765 -1.1586373600073427 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380999_0.png resize: (154, 169) 1359817766 -3.1458458028557157 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381002_0.png resize: (118, 126) 1359817767 0.47699245667740664 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381004_0.png resize: (401, 599) 1359817768 -2.374766812210024 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381006_0.png resize: (170, 105) 1359817769 -1.7103749988470394 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381007_0.png resize: (132, 141) 1359817770 -1.5167143954191256 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381008_0.png resize: (683, 496) 1359817771 -3.1387853656502887 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381009_0.png resize: (159, 156) 1359817772 5.794293495419443 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381011_0.png resize: (374, 201) 1359817773 -2.368317759319288 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381012_0.png resize: (307, 431) 1359817774 -0.9821120195853664 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381014_0.png resize: (152, 184) 1359817775 -3.362983384042245 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381016_0.png resize: (287, 210) 1359817776 -1.1632524192230227 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381018_0.png resize: (617, 474) 1359817777 -4.1387187692438525 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381019_0.png resize: (479, 237) 1359817778 -1.7372435049163018 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381020_0.png resize: (404, 392) 1359817779 -3.3153676566025685 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381022_0.png resize: (214, 90) 1359817780 -1.6060675009536112 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381023_0.png resize: (255, 124) 1359817781 -3.7578468361745236 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381024_0.png resize: (328, 218) 1359817782 -2.999927989299186 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381027_0.png resize: (384, 337) 1359817783 -3.722325935153381 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381028_0.png resize: (224, 329) 1359817784 -3.1734980270955333 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381030_0.png resize: (711, 358) 1359817785 -1.445331552039633 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381031_0.png resize: (443, 159) 1359817786 -0.9199608617806607 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381033_0.png resize: (98, 202) 1359817787 -3.425858642979724 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381034_0.png resize: (247, 234) 1359817788 -3.6812486175293913 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381035_0.png resize: (191, 152) 1359817789 -1.1887488541885407 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381036_0.png resize: (197, 190) 1359817790 0.5363604271844571 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381038_0.png resize: (243, 160) 1359817791 -3.0894402232523768 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381041_0.png resize: (564, 436) 1359817792 -4.029532395411374 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381045_0.png resize: (87, 86) 1359817793 -0.8057632190984149 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381046_0.png resize: (232, 277) 1359817794 -3.255376970383316 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381047_0.png resize: (67, 167) 1359817795 -3.1866809545213766 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381049_0.png resize: (156, 230) 1359817796 1.7673456670947094 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381050_0.png resize: (760, 221) 1359817797 -2.8295420697766636 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381053_0.png resize: (64, 98) 1359817798 -1.0551306744781608 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381054_0.png resize: (119, 207) 1359817799 -2.830147811720681 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381055_0.png resize: (120, 143) 1359817800 -3.238806649749419 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381056_0.png resize: (99, 122) 1359817801 1.1392577964591095 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381057_0.png resize: (224, 142) 1359817802 -2.4656982496447672 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381058_0.png resize: (117, 88) 1359817803 -4.047810353556023 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381060_0.png resize: (284, 100) 1359817804 -3.8964267867492945 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381062_0.png resize: (345, 497) 1359817805 -1.5883469884414105 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381064_0.png resize: (277, 542) 1359817806 -2.9846590344017074 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381065_0.png resize: (382, 335) 1359817807 -2.4578105697264077 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381066_0.png resize: (387, 526) 1359817808 -2.307202216131028 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381067_0.png resize: (312, 503) 1359817809 -3.559734514752246 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381068_0.png resize: (191, 347) 1359817810 -2.4352087143109005 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381073_0.png resize: (127, 194) 1359817811 -2.301992162723409 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381074_0.png resize: (238, 228) 1359817812 -0.39727699081509754 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381075_0.png resize: (175, 274) 1359817814 -1.3775329228551019 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381076_0.png resize: (106, 126) 1359817815 -2.910778759780235 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381077_0.png resize: (628, 176) 1359817816 -2.4591563748546594 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381078_0.png resize: (327, 557) 1359817817 -3.8687223512411055 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381079_0.png resize: (203, 265) 1359817818 -0.6077111022163125 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381081_0.png resize: (176, 190) 1359817819 -1.9513478889433615 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381082_0.png resize: (312, 334) 1359817820 -4.0020093882647885 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381084_0.png resize: (103, 88) 1359817821 0.08560142315283673 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381085_0.png resize: (226, 445) 1359817822 -4.229419232036155 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381086_0.png resize: (194, 134) 1359817823 0.06218511124090487 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381088_0.png resize: (295, 367) 1359817824 1.0241026036330536 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381089_0.png resize: (114, 208) 1359817825 -4.304710947951693 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381090_0.png resize: (247, 144) 1359817826 -2.2258128432322604 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381091_0.png resize: (307, 347) 1359817827 -1.072676079692651 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381095_0.png resize: (446, 269) 1359817828 -3.8953494345925783 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381096_0.png resize: (218, 210) 1359817829 -2.8598460674868975 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381097_0.png resize: (156, 147) 1359817830 -2.535450620749876 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381098_0.png resize: (206, 236) 1359817831 -1.495183429085742 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381099_0.png resize: (170, 408) 1359817832 -0.053665964797560035 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381100_0.png resize: (241, 262) 1359817833 -0.7467995044349713 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381101_0.png resize: (120, 147) 1359817834 -1.64122569106718 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381103_0.png resize: (143, 115) 1359817835 -2.3591331794321473 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381105_0.png resize: (514, 357) 1359817836 -2.5225523854726903 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381106_0.png resize: (280, 348) 1359817837 -0.8249727294630186 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381107_0.png resize: (323, 304) 1359817838 1.3422483821770566 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381110_0.png resize: (176, 242) 1359817839 -1.807383670427219 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381113_0.png resize: (230, 219) 1359817840 -2.5573805273367958 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381116_0.png resize: (149, 247) 1359817841 -3.6316830270853 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381119_0.png resize: (226, 169) 1359817842 -3.643425662517584 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381120_0.png resize: (245, 258) 1359817843 1.317212230408357 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381123_0.png resize: (137, 102) 1359817844 -3.2960493638324198 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381124_0.png resize: (394, 553) 1359817845 -2.599310107605236 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380965_0.png resize: (276, 128) 1359817852 -1.7563153134714213 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380973_0.png resize: (149, 139) 1359817853 -2.1326691950500214 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380991_0.png resize: (597, 465) 1359817854 -3.9169231557609123 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380997_0.png resize: (417, 186) 1359817855 -3.0377536928940256 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380998_0.png resize: (182, 142) 1359817856 -3.358494113381267 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381003_0.png resize: (281, 280) 1359817857 -2.954884680985338 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381010_0.png resize: (242, 217) 1359817859 -3.799031981619201 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381040_0.png resize: (197, 371) 1359817860 -2.332615955433905 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381052_0.png resize: (114, 130) 1359817861 -3.351945806709799 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381072_0.png resize: (99, 111) 1359817862 -1.4713853474970893 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381112_0.png resize: (287, 303) 1359817863 -4.4902405356448005 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380981_0.png resize: (159, 129) 1359817867 -2.852755440069841 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381013_0.png resize: (340, 272) 1359817868 -4.592127943865426 treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380940_0.png resize: (118, 206) 1359817895 -3.663965331455029 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380948_0.png resize: (421, 200) 1359817896 -2.9618338631903662 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380954_0.png resize: (317, 616) 1359817897 -4.1158718196510256 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380955_0.png resize: (408, 261) 1359817898 -3.6905769783545725 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380957_0.png resize: (542, 266) 1359817899 -3.7208664894673995 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380971_0.png resize: (337, 347) 1359817900 -2.6679366706302488 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380972_0.png resize: (109, 185) 1359817901 -4.477534384439253 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380974_0.png resize: (291, 348) 1359817902 -3.6495160484252276 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380980_0.png resize: (845, 544) 1359817903 -4.848397528292506 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380994_0.png resize: (219, 229) 1359817904 -4.360231536995308 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381001_0.png resize: (608, 340) 1359817905 -4.452307616543942 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381005_0.png resize: (309, 325) 1359817906 -3.9994773496621217 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381015_0.png resize: (467, 248) 1359817907 -3.4201575987069126 treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381017_0.png resize: (328, 302) 1359817908 -4.439538860221783 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381021_0.png resize: (505, 207) 1359817909 -4.053829584482455 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381026_0.png resize: (481, 426) 1359817910 -4.873379170352221 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381029_0.png resize: (320, 400) 1359817911 -2.4867967138768674 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381032_0.png resize: (536, 396) 1359817912 -3.9213591871770603 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381037_0.png resize: (236, 380) 1359817913 -2.713926340928513 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381039_0.png resize: (440, 478) 1359817914 -4.835498643920016 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381043_0.png resize: (269, 494) 1359817915 -4.279387687874427 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381044_0.png resize: (543, 340) 1359817916 -3.6669738645942265 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381048_0.png resize: (164, 181) 1359817917 -3.9769264203381502 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381051_0.png resize: (520, 340) 1359817918 -3.976154888586693 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381059_0.png resize: (523, 666) 1359817919 -3.5627477128426155 treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381061_0.png resize: (391, 137) 1359817920 -2.997075407701746 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381063_0.png resize: (402, 300) 1359817921 -3.555241849843163 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381070_0.png resize: (275, 374) 1359817922 -3.3134743101012756 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381071_0.png resize: (402, 472) 1359817923 -3.560964292007549 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381083_0.png resize: (186, 172) 1359817925 -3.3512609248283174 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381087_0.png resize: (414, 366) 1359817926 -3.36022870530824 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381092_0.png resize: (575, 593) 1359817927 -3.6820109574351743 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381093_0.png resize: (468, 514) 1359817928 -3.960895303001739 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381094_0.png resize: (360, 700) 1359817929 -4.272355215464248 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381102_0.png resize: (197, 189) 1359817930 -4.75402662015134 treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381104_0.png resize: (729, 470) 1359817931 -2.560145261298397 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381108_0.png resize: (574, 181) 1359817932 -3.3593159972821796 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381109_0.png resize: (347, 457) 1359817933 -4.062486915832757 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381111_0.png resize: (411, 394) 1359817934 -2.5840356822145703 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381114_0.png resize: (130, 294) 1359817935 -2.1037242482117975 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381115_0.png resize: (691, 354) 1359817936 -1.992907791655602 treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381117_0.png resize: (237, 159) 1359817937 -3.1832537290124012 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381118_0.png resize: (335, 529) 1359817938 -3.756539978547549 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381121_0.png resize: (257, 949) 1359817939 -4.039103082171467 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381122_0.png resize: (90, 338) 1359817940 -3.948775112197389 treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381125_0.png resize: (510, 2413) 1359817941 -3.877034549999615 treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380952_0.png resize: (179, 138) 1359817945 -3.4611186863348844 treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380966_0.png resize: (376, 514) 1359817946 -1.2159010385395699 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380992_0.png resize: (371, 355) 1359817947 -1.9527681661169454 treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381000_0.png resize: (294, 247) 1359817948 -4.093717700772355 treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381025_0.png resize: (273, 325) 1359817949 -0.829638526783115 treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381042_0.png resize: (128, 111) 1359817950 -1.083181568573045 treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381080_0.png resize: (201, 178) 1359817951 -0.3013904964136882 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380982_0.png resize: (188, 303) 1359817954 -3.053196672353995 treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380983_0.png resize: (440, 355) 1359817955 -4.501504672108925 treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381069_0.png resize: (190, 409) 1359817956 -3.8341104020124415 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 212 time used for this insertion : 0.021666765213012695 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 212 time used for this insertion : 0.045865774154663086 save missing photos in datou_result : time spend for datou_step_exec : 64.46287536621094 time spend to save output : 0.0747220516204834 total time spend for step 6 : 64.53759741783142 step7:brightness Tue May 20 15:28:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab.jpg treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f.jpg treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555.jpg treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f.jpg treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d.jpg treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e.jpg treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282.jpg treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc.jpg treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78.jpg treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636.jpg treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508.jpg treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2.jpg treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5.jpg treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1.jpg treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380928_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380929_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380930_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380931_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380932_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380933_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380934_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380935_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380936_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380937_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380938_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380939_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380941_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380942_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380943_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380944_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380945_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380946_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380947_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380949_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380950_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380951_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380953_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380956_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380958_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380959_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380960_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380961_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380962_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380963_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380964_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380967_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380968_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380969_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380970_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380975_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380976_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380977_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380978_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380979_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380984_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380985_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380986_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380987_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380988_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380989_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380990_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380993_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380995_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380996_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380999_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381002_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381004_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381006_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381007_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381008_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381009_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381011_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381012_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381014_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381016_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381018_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381019_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381020_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381022_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381023_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381024_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381027_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381028_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381030_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381031_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381033_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381034_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381035_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381036_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381038_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381041_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381045_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381046_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381047_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381049_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381050_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381053_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381054_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381055_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381056_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381057_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381058_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381060_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381062_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381064_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381065_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381066_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381067_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381068_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381073_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381074_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381075_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381076_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381077_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381078_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381079_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381081_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381082_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381084_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381085_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381086_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381088_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381089_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381090_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381091_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381095_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381096_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381097_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381098_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381099_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381100_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381101_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381103_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381105_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381106_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381107_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381110_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381113_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381116_0.png treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381119_0.png treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381120_0.png treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381123_0.png treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381124_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380965_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380973_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380991_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380997_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380998_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381003_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381010_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381040_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381052_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381072_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381112_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380981_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381013_0.png treat image : temp/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380940_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380948_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380954_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380955_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380957_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380971_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380972_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380974_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380980_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380994_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381001_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381005_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381015_0.png treat image : temp/1747747227_2771976_1359808517_862a0d9a8d7176c881a175653d6e3e7e_rle_crop_3806381017_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381021_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381026_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381029_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381032_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381037_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381039_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381043_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381044_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381048_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381051_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381059_0.png treat image : temp/1747747227_2771976_1359808498_49735f1584d3508118833c29833add78_rle_crop_3806381061_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381063_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381070_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381071_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381083_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381087_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381092_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381093_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381094_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381102_0.png treat image : temp/1747747227_2771976_1359808490_e97c02aab9bcb3d80a2c01919862b8f2_rle_crop_3806381104_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381108_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381109_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381111_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381114_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381115_0.png treat image : temp/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381117_0.png treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381118_0.png treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381121_0.png treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381122_0.png treat image : temp/1747747227_2771976_1359808458_0d5dc25432bf47550617f50c58b462f1_rle_crop_3806381125_0.png treat image : temp/1747747227_2771976_1359808532_03892922ce34da683ec477326c25570f_rle_crop_3806380952_0.png treat image : temp/1747747227_2771976_1359808528_8eb7119557d3dd9280237f24d5036555_rle_crop_3806380966_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806380992_0.png treat image : temp/1747747227_2771976_1359808521_14f2ab810439a9a7643880f28feffc6d_rle_crop_3806381000_0.png treat image : temp/1747747227_2771976_1359808515_24591454ec21e8df2f59ba67eeb0e282_rle_crop_3806381025_0.png treat image : temp/1747747227_2771976_1359808500_1182592ad6bd66ae98554f45f257abfc_rle_crop_3806381042_0.png treat image : temp/1747747227_2771976_1359808494_f2c84817cc6e65cfa45d56f1ce74f508_rle_crop_3806381080_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380982_0.png treat image : temp/1747747227_2771976_1359808524_a9cb143e40a723e7c83344970d75e73f_rle_crop_3806380983_0.png treat image : temp/1747747227_2771976_1359808496_3a4bdd6405528853114abc48179ff636_rle_crop_3806381069_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 212 time used for this insertion : 0.024938583374023438 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 212 time used for this insertion : 0.04218101501464844 save missing photos in datou_result : time spend for datou_step_exec : 17.911640405654907 time spend to save output : 0.07293462753295898 total time spend for step 7 : 17.984575033187866 step8:velours_tree Tue May 20 15:29:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.0257716178894043 time spend to save output : 3.719329833984375e-05 total time spend for step 8 : 1.0258088111877441 step9:send_mail_cod Tue May 20 15:29:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23170112_20-05-2025_15_29_13.pdf 23170700 change filename to text .change filename to text .imagette231707001747747753 23170701 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text -- Missing : http://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/5/20/f7066deb0f821e1053b70e071a66ac4a_42625542.png retrying : [Errno 104] Connection reset by peer change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231707011747747753 23170702 imagette231707021747747754 23170703 imagette231707031747747754 23170704 change filename to text .change filename to text .change filename to text .imagette231707041747747754 23170705 imagette231707051747747755 23170706 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231707061747747755 23170707 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231707071747747756 23170708 change filename to text .change filename to text .change filename to text -- Missing : http://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/5/20/f7998dbc3f27010c7974551ff11ecccb_93716383.png retrying : [Errno 104] Connection reset by peer change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231707081747747756 23170710 imagette231707101747747758 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23170112 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23170700,23170701,23170702,23170703,23170704,23170705,23170706,23170707,23170708,23170709,23170710?tags=metal,pet_clair,pehd,background,pet_fonce,mal_croppe,carton,autre,papier,environnement,flou args[1359808562] : ((1359808562, -5.729582577204221, 492609224), (1359808562, 0.944163070361774, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808532] : ((1359808532, -5.775563871532884, 492609224), (1359808532, 0.9325187392760955, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808528] : ((1359808528, -5.715157286500144, 492609224), (1359808528, 0.8926921043322643, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808524] : ((1359808524, -5.714692445809163, 492609224), (1359808524, 0.8110067019178132, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808521] : ((1359808521, -5.64462328661869, 492609224), (1359808521, 0.9337953379686502, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808517] : ((1359808517, -5.666851865499973, 492609224), (1359808517, 1.0359563612195624, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808515] : ((1359808515, -5.716403749961548, 492609224), (1359808515, 0.8978783346013335, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808500] : ((1359808500, -5.665066476204482, 492609224), (1359808500, 0.9069609198490002, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808498] : ((1359808498, -5.700972992505053, 492609224), (1359808498, 0.9880638121216566, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808496] : ((1359808496, -5.757552739233496, 492609224), (1359808496, 1.039353484572844, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808494] : ((1359808494, -5.875413444171193, 492609224), (1359808494, 0.9557344351234146, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808490] : ((1359808490, -5.66771549290572, 492609224), (1359808490, 0.8105589348761237, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808486] : ((1359808486, -5.70864013232938, 492609224), (1359808486, 0.9579906561527968, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com args[1359808458] : ((1359808458, -3.889752628582056, 492609224), (1359808458, 0.08872481631403992, 2107752395), '0.10659472484016758') We are sending mail with results at report@fotonower.com refus_total : 0.10659472484016758 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23170112 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 error cannot identify image file 'imagette231707081747747756/1747747227_2771976_1359808562_8c3869e82b4b41d0e16fc65fca7756ab_rle_crop_3806380930_0.png.png' error cannot identify image file 'imagette231707011747747753/1747747227_2771976_1359808486_fb8f02826175ddae1f71905d85b28dc5_rle_crop_3806381108_0.png.png' start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170112_20-05-2025_15_29_13.pdf results_Auto_P23170112_20-05-2025_15_29_13.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170112_20-05-2025_15_29_13.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23170112','results_Auto_P23170112_20-05-2025_15_29_13.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170112_20-05-2025_15_29_13.pdf','pdf','','0.9','0.10659472484016758') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23170112

https://www.fotonower.com/image?json=false&list_photos_id=1359808562
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808532
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808528
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808524
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808521
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808517
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808515
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808500
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808498
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808496
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808494
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808490
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808486
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359808458
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.66%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/23170700?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23170701?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23170704?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23170706?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23170707?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23170708?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170112_20-05-2025_15_29_13.pdf.

Lien vers velours :https://www.fotonower.com/velours/23170700,23170701,23170702,23170703,23170704,23170705,23170706,23170707,23170708,23170709,23170710?tags=metal,pet_clair,pehd,background,pet_fonce,mal_croppe,carton,autre,papier,environnement,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 20 May 2025 13:29:23 GMT Content-Length: 0 Connection: close X-Message-Id: s4IC9sGCT06s8ZK1I4t5XA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359808562, 1359808532, 1359808528, 1359808524, 1359808521, 1359808517, 1359808515, 1359808500, 1359808498, 1359808496, 1359808494, 1359808490, 1359808486, 1359808458] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808562', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808532', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808528', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808524', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808521', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808517', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808515', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808500', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808498', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808496', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808494', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808490', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808486', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808458', None, None, None, None, None, '2909112') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.01340174674987793 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.051118612289429 time spend to save output : 0.013781309127807617 total time spend for step 9 : 10.064899921417236 step10:split_time_score Tue May 20 15:29:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 14),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20052025 23170112 Nombre de photos uploadées : 14 / 23040 (0%) 20052025 23170112 Nombre de photos taguées (types de déchets): 0 / 14 (0%) 20052025 23170112 Nombre de photos taguées (volume) : 0 / 14 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 6.67572021484375e-06 ?????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007345676422119141 elapsed_time : insert_dashboard_record_day_entry 0.023403167724609375 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09201400421027917 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157181_20-05-2025_08_46_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157181 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157181 AND mptpi.`type`=3594 To do Qualite : 0.10180426772060878 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157188_20-05-2025_08_35_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157188 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157188 AND mptpi.`type`=3594 To do Qualite : 0.09871742380401231 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157192_20-05-2025_08_28_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157192 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157192 AND mptpi.`type`=3594 To do Qualite : 0.10408518822159352 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23161557_20-05-2025_10_30_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23161557 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23161557 AND mptpi.`type`=3594 To do Qualite : 0.1308608699845679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23164737_20-05-2025_11_54_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23164737 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23164737 AND mptpi.`type`=3594 To do Qualite : 0.1064864810896508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23164744_20-05-2025_12_03_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23164744 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23164744 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170102 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170104 order by id desc limit 1 Qualite : 0.02726871178050528 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23166958_20-05-2025_13_30_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23166958 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23166958 AND mptpi.`type`=3726 To do Qualite : 0.09543954354745371 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23166961_20-05-2025_13_20_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23166961 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23166961 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170110 order by id desc limit 1 Qualite : 0.10659472484016758 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170112_20-05-2025_15_29_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170112 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20052025': {'nb_upload': 14, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359808562, 1359808532, 1359808528, 1359808524, 1359808521, 1359808517, 1359808515, 1359808500, 1359808498, 1359808496, 1359808494, 1359808490, 1359808486, 1359808458] Looping around the photos to save general results len do output : 1 /23170112Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808562', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808532', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808528', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808524', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808521', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808517', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808515', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808500', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808498', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808496', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808494', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808490', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808486', None, None, None, None, None, '2909112') ('3318', None, None, None, None, None, None, None, '2909112') ('3318', '23170112', '1359808458', None, None, None, None, None, '2909112') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014202356338500977 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.458771228790283 time spend to save output : 0.014460325241088867 total time spend for step 10 : 3.473231554031372 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 14 set_done_treatment 226.78user 244.29system 9:02.41elapsed 86%CPU (0avgtext+0avgdata 6480336maxresident)k 891760inputs+190224outputs (20480major+22549346minor)pagefaults 0swaps