python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3539443 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2911953'] with mtr_portfolio_ids : ['23177171'] and first list_photo_ids : [] new path : /proc/3539443/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.59006929397583 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 20 19:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2731 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-20 19:10:33.608092: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-20 19:10:33.635242: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-20 19:10:33.637287: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f49b0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-20 19:10:33.637323: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-20 19:10:33.641280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-20 19:10:33.928752: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x40e0c010 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-20 19:10:33.928808: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-20 19:10:33.929717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 19:10:33.930060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 19:10:33.932315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 19:10:33.934719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 19:10:33.935204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 19:10:33.938295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 19:10:33.939800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 19:10:33.945978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 19:10:33.947408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 19:10:33.947546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 19:10:33.948241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 19:10:33.948267: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 19:10:33.948279: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 19:10:33.949525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2279 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-20 19:10:34.247969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 19:10:34.248043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 19:10:34.248060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 19:10:34.248076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 19:10:34.248091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 19:10:34.248105: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 19:10:34.248120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 19:10:34.248134: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 19:10:34.248965: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 19:10:34.249810: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 19:10:34.249842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 19:10:34.249858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 19:10:34.249872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 19:10:34.249886: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 19:10:34.249899: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 19:10:34.249913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 19:10:34.249927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 19:10:34.250730: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 19:10:34.250759: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 19:10:34.250768: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 19:10:34.250776: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 19:10:34.251645: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2279 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-20 19:10:46.941268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 19:10:47.136812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 19:10:48.533846: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.533909: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.540334: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.540357: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.589683: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.589762: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.631894: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.631933: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.683114: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.683144: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-20 19:10:48.685461: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.23G (1317928960 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.685969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.10G (1186136064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.685981: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-05-20 19:10:48.707756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.708305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.738569: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.739131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.740793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.741328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.747697: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.748233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.750077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.750607: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.757240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.757775: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.759452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.759988: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.790008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.790552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.791100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.791636: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.795113: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.795774: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.811120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.811663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.812234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.812794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.824981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.825517: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.826046: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.826573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.830746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.831301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.835778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.836431: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.848503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.849040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.853146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.853682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.854359: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.854904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.865605: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.866141: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.866686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.867225: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.867772: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.868303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.906017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.906071: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-20 19:10:48.907185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.908152: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.915468: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.916270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.924193: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.924731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.944834: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.945661: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.946467: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.947267: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.951649: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.952256: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.952787: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.953318: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.954232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.964448: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.964983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.973848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.974402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.974950: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.975483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.976022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-20 19:10:48.976552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.73G (1854799872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 Detection mask done ! Trying to reset tf kernel 3540121 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 564 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1757 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002727985382080078 nb_pixel_total : 72468 time to create 1 rle with old method : 0.08660364151000977 length of segment : 358 time for calcul the mask position with numpy : 0.0012111663818359375 nb_pixel_total : 25922 time to create 1 rle with old method : 0.03660082817077637 length of segment : 193 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 21834 time to create 1 rle with old method : 0.02818441390991211 length of segment : 138 time for calcul the mask position with numpy : 0.00041604042053222656 nb_pixel_total : 12784 time to create 1 rle with old method : 0.02073979377746582 length of segment : 138 time for calcul the mask position with numpy : 0.001119852066040039 nb_pixel_total : 43024 time to create 1 rle with old method : 0.05016970634460449 length of segment : 314 time for calcul the mask position with numpy : 0.0029523372650146484 nb_pixel_total : 116782 time to create 1 rle with old method : 0.18076038360595703 length of segment : 292 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 9977 time to create 1 rle with old method : 0.012262582778930664 length of segment : 150 time for calcul the mask position with numpy : 0.0002884864807128906 nb_pixel_total : 12970 time to create 1 rle with old method : 0.016054391860961914 length of segment : 115 time for calcul the mask position with numpy : 0.004044532775878906 nb_pixel_total : 144599 time to create 1 rle with old method : 0.17415976524353027 length of segment : 620 time for calcul the mask position with numpy : 0.0008873939514160156 nb_pixel_total : 35459 time to create 1 rle with old method : 0.04175972938537598 length of segment : 214 time for calcul the mask position with numpy : 0.0014977455139160156 nb_pixel_total : 65809 time to create 1 rle with old method : 0.07775616645812988 length of segment : 442 time for calcul the mask position with numpy : 0.0005064010620117188 nb_pixel_total : 18642 time to create 1 rle with old method : 0.022624731063842773 length of segment : 179 time for calcul the mask position with numpy : 0.0007281303405761719 nb_pixel_total : 33613 time to create 1 rle with old method : 0.040261030197143555 length of segment : 273 time for calcul the mask position with numpy : 0.000911712646484375 nb_pixel_total : 27540 time to create 1 rle with old method : 0.033449411392211914 length of segment : 195 time for calcul the mask position with numpy : 0.00044035911560058594 nb_pixel_total : 9857 time to create 1 rle with old method : 0.012340307235717773 length of segment : 99 time for calcul the mask position with numpy : 0.0006878376007080078 nb_pixel_total : 23242 time to create 1 rle with old method : 0.027947425842285156 length of segment : 201 time for calcul the mask position with numpy : 0.0003838539123535156 nb_pixel_total : 19149 time to create 1 rle with old method : 0.02685999870300293 length of segment : 130 time for calcul the mask position with numpy : 0.0019712448120117188 nb_pixel_total : 109914 time to create 1 rle with old method : 0.1275184154510498 length of segment : 535 time for calcul the mask position with numpy : 0.0011813640594482422 nb_pixel_total : 66980 time to create 1 rle with old method : 0.07747673988342285 length of segment : 375 time for calcul the mask position with numpy : 0.00033283233642578125 nb_pixel_total : 14880 time to create 1 rle with old method : 0.01789236068725586 length of segment : 85 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 17205 time to create 1 rle with old method : 0.020852088928222656 length of segment : 162 time for calcul the mask position with numpy : 0.0004088878631591797 nb_pixel_total : 13593 time to create 1 rle with old method : 0.016881942749023438 length of segment : 146 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 8157 time to create 1 rle with old method : 0.010139942169189453 length of segment : 88 time for calcul the mask position with numpy : 0.0003802776336669922 nb_pixel_total : 13107 time to create 1 rle with old method : 0.01769256591796875 length of segment : 170 time for calcul the mask position with numpy : 0.0004744529724121094 nb_pixel_total : 11262 time to create 1 rle with old method : 0.0183103084564209 length of segment : 193 time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 27959 time to create 1 rle with old method : 0.03403806686401367 length of segment : 236 time for calcul the mask position with numpy : 0.0015997886657714844 nb_pixel_total : 92348 time to create 1 rle with old method : 0.10952425003051758 length of segment : 246 time for calcul the mask position with numpy : 0.00033926963806152344 nb_pixel_total : 17116 time to create 1 rle with old method : 0.020657062530517578 length of segment : 149 time for calcul the mask position with numpy : 0.001588582992553711 nb_pixel_total : 89873 time to create 1 rle with old method : 0.10673689842224121 length of segment : 315 time for calcul the mask position with numpy : 0.0011048316955566406 nb_pixel_total : 81729 time to create 1 rle with old method : 0.1193695068359375 length of segment : 291 time for calcul the mask position with numpy : 0.00028586387634277344 nb_pixel_total : 11469 time to create 1 rle with old method : 0.01397562026977539 length of segment : 91 time for calcul the mask position with numpy : 0.0008335113525390625 nb_pixel_total : 39415 time to create 1 rle with old method : 0.04762101173400879 length of segment : 216 time for calcul the mask position with numpy : 0.0003914833068847656 nb_pixel_total : 19603 time to create 1 rle with old method : 0.02342700958251953 length of segment : 111 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 12655 time to create 1 rle with old method : 0.015427350997924805 length of segment : 110 time for calcul the mask position with numpy : 0.00017142295837402344 nb_pixel_total : 7207 time to create 1 rle with old method : 0.008800506591796875 length of segment : 98 time for calcul the mask position with numpy : 0.00038504600524902344 nb_pixel_total : 29156 time to create 1 rle with old method : 0.035205841064453125 length of segment : 113 time for calcul the mask position with numpy : 0.0010373592376708984 nb_pixel_total : 75889 time to create 1 rle with old method : 0.0889580249786377 length of segment : 233 time for calcul the mask position with numpy : 0.0002841949462890625 nb_pixel_total : 17042 time to create 1 rle with old method : 0.021860599517822266 length of segment : 153 time for calcul the mask position with numpy : 0.0007731914520263672 nb_pixel_total : 39502 time to create 1 rle with old method : 0.05426478385925293 length of segment : 139 time for calcul the mask position with numpy : 0.0011928081512451172 nb_pixel_total : 57365 time to create 1 rle with old method : 0.06741833686828613 length of segment : 489 time for calcul the mask position with numpy : 0.0011320114135742188 nb_pixel_total : 45091 time to create 1 rle with old method : 0.05952811241149902 length of segment : 449 time for calcul the mask position with numpy : 0.006865501403808594 nb_pixel_total : 211323 time to create 1 rle with new method : 0.24415230751037598 length of segment : 580 time for calcul the mask position with numpy : 0.0008378028869628906 nb_pixel_total : 46554 time to create 1 rle with old method : 0.0549769401550293 length of segment : 253 time for calcul the mask position with numpy : 0.00037741661071777344 nb_pixel_total : 17676 time to create 1 rle with old method : 0.021077394485473633 length of segment : 243 time for calcul the mask position with numpy : 0.0007815361022949219 nb_pixel_total : 34193 time to create 1 rle with old method : 0.045411109924316406 length of segment : 165 time for calcul the mask position with numpy : 0.0012240409851074219 nb_pixel_total : 35633 time to create 1 rle with old method : 0.042406558990478516 length of segment : 267 time for calcul the mask position with numpy : 0.0026106834411621094 nb_pixel_total : 43519 time to create 1 rle with old method : 0.05111956596374512 length of segment : 315 time for calcul the mask position with numpy : 0.002790212631225586 nb_pixel_total : 73760 time to create 1 rle with old method : 0.08648848533630371 length of segment : 308 time for calcul the mask position with numpy : 0.0010998249053955078 nb_pixel_total : 16384 time to create 1 rle with old method : 0.027759790420532227 length of segment : 279 time for calcul the mask position with numpy : 0.0018157958984375 nb_pixel_total : 65268 time to create 1 rle with old method : 0.07653069496154785 length of segment : 269 time for calcul the mask position with numpy : 0.0004410743713378906 nb_pixel_total : 8841 time to create 1 rle with old method : 0.010699987411499023 length of segment : 130 time for calcul the mask position with numpy : 0.0007526874542236328 nb_pixel_total : 20418 time to create 1 rle with old method : 0.024393558502197266 length of segment : 180 time for calcul the mask position with numpy : 0.0006248950958251953 nb_pixel_total : 18332 time to create 1 rle with old method : 0.0230100154876709 length of segment : 119 time for calcul the mask position with numpy : 0.0011522769927978516 nb_pixel_total : 23738 time to create 1 rle with old method : 0.03336930274963379 length of segment : 133 time for calcul the mask position with numpy : 0.007219791412353516 nb_pixel_total : 122420 time to create 1 rle with old method : 0.20533514022827148 length of segment : 474 time for calcul the mask position with numpy : 0.0021059513092041016 nb_pixel_total : 60746 time to create 1 rle with old method : 0.07112288475036621 length of segment : 368 time for calcul the mask position with numpy : 0.0074617862701416016 nb_pixel_total : 163039 time to create 1 rle with new method : 0.0148162841796875 length of segment : 615 time for calcul the mask position with numpy : 0.004472255706787109 nb_pixel_total : 108115 time to create 1 rle with old method : 0.1413424015045166 length of segment : 791 time for calcul the mask position with numpy : 0.0018513202667236328 nb_pixel_total : 25565 time to create 1 rle with old method : 0.03242611885070801 length of segment : 464 time for calcul the mask position with numpy : 0.0008206367492675781 nb_pixel_total : 17446 time to create 1 rle with old method : 0.020856857299804688 length of segment : 167 time for calcul the mask position with numpy : 0.0003266334533691406 nb_pixel_total : 12401 time to create 1 rle with old method : 0.016887187957763672 length of segment : 113 time for calcul the mask position with numpy : 0.0015888214111328125 nb_pixel_total : 54838 time to create 1 rle with old method : 0.06439399719238281 length of segment : 367 time for calcul the mask position with numpy : 0.008638143539428711 nb_pixel_total : 286343 time to create 1 rle with new method : 0.014897584915161133 length of segment : 619 time for calcul the mask position with numpy : 0.0004737377166748047 nb_pixel_total : 11158 time to create 1 rle with old method : 0.013720989227294922 length of segment : 84 time for calcul the mask position with numpy : 0.0030989646911621094 nb_pixel_total : 92011 time to create 1 rle with old method : 0.10706782341003418 length of segment : 486 time for calcul the mask position with numpy : 0.001064300537109375 nb_pixel_total : 9385 time to create 1 rle with old method : 0.011618375778198242 length of segment : 262 time for calcul the mask position with numpy : 0.0011250972747802734 nb_pixel_total : 7763 time to create 1 rle with old method : 0.009781599044799805 length of segment : 233 time for calcul the mask position with numpy : 0.004603862762451172 nb_pixel_total : 205069 time to create 1 rle with new method : 0.010503768920898438 length of segment : 557 time for calcul the mask position with numpy : 0.005108356475830078 nb_pixel_total : 62382 time to create 1 rle with old method : 0.10014724731445312 length of segment : 587 time for calcul the mask position with numpy : 0.0012736320495605469 nb_pixel_total : 29194 time to create 1 rle with old method : 0.034816741943359375 length of segment : 208 time for calcul the mask position with numpy : 0.0019371509552001953 nb_pixel_total : 65825 time to create 1 rle with old method : 0.07784700393676758 length of segment : 216 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 6757 time to create 1 rle with old method : 0.008466482162475586 length of segment : 95 time for calcul the mask position with numpy : 0.0009708404541015625 nb_pixel_total : 32999 time to create 1 rle with old method : 0.046378135681152344 length of segment : 181 time for calcul the mask position with numpy : 0.0013761520385742188 nb_pixel_total : 31666 time to create 1 rle with old method : 0.05230450630187988 length of segment : 248 time for calcul the mask position with numpy : 0.0034902095794677734 nb_pixel_total : 115065 time to create 1 rle with old method : 0.14967679977416992 length of segment : 490 time for calcul the mask position with numpy : 0.0005884170532226562 nb_pixel_total : 16024 time to create 1 rle with old method : 0.019040346145629883 length of segment : 171 time for calcul the mask position with numpy : 0.0016062259674072266 nb_pixel_total : 40419 time to create 1 rle with old method : 0.04751849174499512 length of segment : 385 time for calcul the mask position with numpy : 0.0026268959045410156 nb_pixel_total : 76564 time to create 1 rle with old method : 0.08956098556518555 length of segment : 361 time for calcul the mask position with numpy : 0.00779414176940918 nb_pixel_total : 324184 time to create 1 rle with new method : 0.015044450759887695 length of segment : 625 time for calcul the mask position with numpy : 0.0028944015502929688 nb_pixel_total : 103607 time to create 1 rle with old method : 0.12418794631958008 length of segment : 319 time for calcul the mask position with numpy : 0.0011279582977294922 nb_pixel_total : 68367 time to create 1 rle with old method : 0.08898568153381348 length of segment : 406 time for calcul the mask position with numpy : 0.0013248920440673828 nb_pixel_total : 23119 time to create 1 rle with old method : 0.03833770751953125 length of segment : 259 time for calcul the mask position with numpy : 0.0013821125030517578 nb_pixel_total : 25441 time to create 1 rle with old method : 0.030147314071655273 length of segment : 214 time for calcul the mask position with numpy : 0.0009980201721191406 nb_pixel_total : 27175 time to create 1 rle with old method : 0.032526254653930664 length of segment : 250 time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 14917 time to create 1 rle with old method : 0.023285865783691406 length of segment : 179 time for calcul the mask position with numpy : 0.0023610591888427734 nb_pixel_total : 50501 time to create 1 rle with old method : 0.07988190650939941 length of segment : 320 time for calcul the mask position with numpy : 0.0003936290740966797 nb_pixel_total : 8475 time to create 1 rle with old method : 0.010245800018310547 length of segment : 132 time for calcul the mask position with numpy : 0.0006444454193115234 nb_pixel_total : 13059 time to create 1 rle with old method : 0.0166776180267334 length of segment : 85 time for calcul the mask position with numpy : 0.0025475025177001953 nb_pixel_total : 80200 time to create 1 rle with old method : 0.0930783748626709 length of segment : 410 time for calcul the mask position with numpy : 0.0011472702026367188 nb_pixel_total : 30958 time to create 1 rle with old method : 0.0366673469543457 length of segment : 622 time for calcul the mask position with numpy : 0.0023910999298095703 nb_pixel_total : 84185 time to create 1 rle with old method : 0.10839176177978516 length of segment : 329 time for calcul the mask position with numpy : 0.0037381649017333984 nb_pixel_total : 121572 time to create 1 rle with old method : 0.1976916790008545 length of segment : 578 time for calcul the mask position with numpy : 0.0010833740234375 nb_pixel_total : 25033 time to create 1 rle with old method : 0.029762744903564453 length of segment : 240 time for calcul the mask position with numpy : 0.001079559326171875 nb_pixel_total : 19306 time to create 1 rle with old method : 0.022814512252807617 length of segment : 308 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 9107 time to create 1 rle with old method : 0.011500358581542969 length of segment : 106 time for calcul the mask position with numpy : 0.0024919509887695312 nb_pixel_total : 60291 time to create 1 rle with old method : 0.07164502143859863 length of segment : 324 time for calcul the mask position with numpy : 0.0015769004821777344 nb_pixel_total : 35237 time to create 1 rle with old method : 0.04102516174316406 length of segment : 341 time for calcul the mask position with numpy : 0.0031337738037109375 nb_pixel_total : 122906 time to create 1 rle with old method : 0.1465442180633545 length of segment : 529 time for calcul the mask position with numpy : 0.0010776519775390625 nb_pixel_total : 31965 time to create 1 rle with old method : 0.038362741470336914 length of segment : 197 time for calcul the mask position with numpy : 0.0013740062713623047 nb_pixel_total : 33127 time to create 1 rle with old method : 0.04297590255737305 length of segment : 299 time for calcul the mask position with numpy : 0.0008406639099121094 nb_pixel_total : 14782 time to create 1 rle with old method : 0.01763319969177246 length of segment : 166 time for calcul the mask position with numpy : 0.0017006397247314453 nb_pixel_total : 67344 time to create 1 rle with old method : 0.09011960029602051 length of segment : 229 time for calcul the mask position with numpy : 0.002710103988647461 nb_pixel_total : 86016 time to create 1 rle with old method : 0.09944653511047363 length of segment : 477 time for calcul the mask position with numpy : 0.0009720325469970703 nb_pixel_total : 27455 time to create 1 rle with old method : 0.041970014572143555 length of segment : 233 time for calcul the mask position with numpy : 0.0009388923645019531 nb_pixel_total : 15748 time to create 1 rle with old method : 0.02341461181640625 length of segment : 190 time for calcul the mask position with numpy : 0.008339881896972656 nb_pixel_total : 153865 time to create 1 rle with new method : 0.04336833953857422 length of segment : 695 time for calcul the mask position with numpy : 0.0006811618804931641 nb_pixel_total : 11037 time to create 1 rle with old method : 0.013274908065795898 length of segment : 181 time for calcul the mask position with numpy : 0.0009531974792480469 nb_pixel_total : 25602 time to create 1 rle with old method : 0.030466318130493164 length of segment : 184 time for calcul the mask position with numpy : 0.0008747577667236328 nb_pixel_total : 16961 time to create 1 rle with old method : 0.020209550857543945 length of segment : 184 time for calcul the mask position with numpy : 0.005943775177001953 nb_pixel_total : 104652 time to create 1 rle with old method : 0.12904024124145508 length of segment : 588 time for calcul the mask position with numpy : 0.002154827117919922 nb_pixel_total : 65523 time to create 1 rle with old method : 0.07711601257324219 length of segment : 242 time for calcul the mask position with numpy : 0.0006892681121826172 nb_pixel_total : 24058 time to create 1 rle with old method : 0.029239654541015625 length of segment : 95 time for calcul the mask position with numpy : 0.0006945133209228516 nb_pixel_total : 11222 time to create 1 rle with old method : 0.013614654541015625 length of segment : 169 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 12796 time to create 1 rle with old method : 0.015429496765136719 length of segment : 123 time for calcul the mask position with numpy : 0.0012638568878173828 nb_pixel_total : 39122 time to create 1 rle with old method : 0.04593181610107422 length of segment : 257 time for calcul the mask position with numpy : 0.0012192726135253906 nb_pixel_total : 23712 time to create 1 rle with old method : 0.027934789657592773 length of segment : 237 time for calcul the mask position with numpy : 0.0021283626556396484 nb_pixel_total : 43103 time to create 1 rle with old method : 0.07196784019470215 length of segment : 233 time for calcul the mask position with numpy : 0.0025911331176757812 nb_pixel_total : 71883 time to create 1 rle with old method : 0.0913858413696289 length of segment : 249 time for calcul the mask position with numpy : 0.0052890777587890625 nb_pixel_total : 168012 time to create 1 rle with new method : 0.011394262313842773 length of segment : 447 time for calcul the mask position with numpy : 0.001608133316040039 nb_pixel_total : 36793 time to create 1 rle with old method : 0.04344654083251953 length of segment : 315 time for calcul the mask position with numpy : 0.0009753704071044922 nb_pixel_total : 18195 time to create 1 rle with old method : 0.021623849868774414 length of segment : 208 time for calcul the mask position with numpy : 0.0012128353118896484 nb_pixel_total : 21907 time to create 1 rle with old method : 0.029950618743896484 length of segment : 124 time for calcul the mask position with numpy : 0.005614757537841797 nb_pixel_total : 148547 time to create 1 rle with old method : 0.17216897010803223 length of segment : 550 time for calcul the mask position with numpy : 0.0012183189392089844 nb_pixel_total : 37325 time to create 1 rle with old method : 0.04379868507385254 length of segment : 204 time for calcul the mask position with numpy : 0.0009350776672363281 nb_pixel_total : 39671 time to create 1 rle with old method : 0.04653024673461914 length of segment : 307 time for calcul the mask position with numpy : 0.002272367477416992 nb_pixel_total : 49905 time to create 1 rle with old method : 0.06070303916931152 length of segment : 355 time for calcul the mask position with numpy : 0.001870870590209961 nb_pixel_total : 39434 time to create 1 rle with old method : 0.06347441673278809 length of segment : 257 time for calcul the mask position with numpy : 0.001043081283569336 nb_pixel_total : 19239 time to create 1 rle with old method : 0.024921655654907227 length of segment : 218 time for calcul the mask position with numpy : 0.0013556480407714844 nb_pixel_total : 25033 time to create 1 rle with old method : 0.041780710220336914 length of segment : 223 time for calcul the mask position with numpy : 0.002205371856689453 nb_pixel_total : 64267 time to create 1 rle with old method : 0.07567906379699707 length of segment : 244 time for calcul the mask position with numpy : 0.00593876838684082 nb_pixel_total : 182976 time to create 1 rle with new method : 0.013118982315063477 length of segment : 550 time for calcul the mask position with numpy : 0.0011606216430664062 nb_pixel_total : 16109 time to create 1 rle with old method : 0.01977825164794922 length of segment : 192 time for calcul the mask position with numpy : 0.0013260841369628906 nb_pixel_total : 36595 time to create 1 rle with old method : 0.04582786560058594 length of segment : 268 time for calcul the mask position with numpy : 0.001920461654663086 nb_pixel_total : 46534 time to create 1 rle with old method : 0.07575345039367676 length of segment : 264 time for calcul the mask position with numpy : 0.001589059829711914 nb_pixel_total : 38728 time to create 1 rle with old method : 0.04502749443054199 length of segment : 337 time for calcul the mask position with numpy : 0.0007340908050537109 nb_pixel_total : 22143 time to create 1 rle with old method : 0.026403188705444336 length of segment : 308 time for calcul the mask position with numpy : 0.0013775825500488281 nb_pixel_total : 34729 time to create 1 rle with old method : 0.042098045349121094 length of segment : 220 time for calcul the mask position with numpy : 0.0007445812225341797 nb_pixel_total : 20711 time to create 1 rle with old method : 0.02452540397644043 length of segment : 163 time for calcul the mask position with numpy : 0.0026254653930664062 nb_pixel_total : 60213 time to create 1 rle with old method : 0.0823209285736084 length of segment : 559 time for calcul the mask position with numpy : 0.0009746551513671875 nb_pixel_total : 26975 time to create 1 rle with old method : 0.031214475631713867 length of segment : 190 time for calcul the mask position with numpy : 0.0015177726745605469 nb_pixel_total : 54878 time to create 1 rle with old method : 0.06433439254760742 length of segment : 392 time for calcul the mask position with numpy : 0.0017621517181396484 nb_pixel_total : 48648 time to create 1 rle with old method : 0.057064056396484375 length of segment : 303 time for calcul the mask position with numpy : 0.0002448558807373047 nb_pixel_total : 8447 time to create 1 rle with old method : 0.009897232055664062 length of segment : 109 time spent for convertir_results : 14.227309942245483 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 143 chid ids of type : 3594 Number RLEs to save : 40138 save missing photos in datou_result : time spend for datou_step_exec : 77.68702363967896 time spend to save output : 2.3817498683929443 total time spend for step 1 : 80.0687735080719 step2:crop_condition Tue May 20 19:11:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 143 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 91 About to insert : list_path_to_insert length 91 new photo from crops ! About to upload 91 photos upload in portfolio : 3736932 init cache_photo without model_param we have 91 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761132_3539443 we have uploaded 91 photos in the portfolio 3736932 time of upload the photos Elapsed time : 22.289281606674194 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761157_3539443 we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.4143285751342773 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3736932 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761174_3539443 we have uploaded 40 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.124155521392822 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761186_3539443 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5604591369628906 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761187_3539443 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5408804416656494 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359842351, 1359842333, 1359842302, 1359842286, 1359842281, 1359842063, 1359841685, 1359841673, 1359841670, 1359841668] Looping around the photos to save general results len do output : 143 /1359845083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359845287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842351', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842333', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842302', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842286', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842281', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842063', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841685', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841673', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841670', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841668', None, None, None, None, None, '2911953') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 439 time used for this insertion : 0.0370790958404541 save_final save missing photos in datou_result : time spend for datou_step_exec : 76.84742283821106 time spend to save output : 0.04457902908325195 total time spend for step 2 : 76.89200186729431 step3:rle_unique_nms_with_priority Tue May 20 19:13:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 143 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 26 nb_hashtags : 4 time to prepare the origin masks : 3.7886900901794434 time for calcul the mask position with numpy : 0.4883763790130615 nb_pixel_total : 6089298 time to create 1 rle with new method : 0.5476751327514648 time for calcul the mask position with numpy : 0.029052257537841797 nb_pixel_total : 21834 time to create 1 rle with old method : 0.025102615356445312 time for calcul the mask position with numpy : 0.028287410736083984 nb_pixel_total : 27959 time to create 1 rle with old method : 0.03212547302246094 time for calcul the mask position with numpy : 0.028645992279052734 nb_pixel_total : 9857 time to create 1 rle with old method : 0.011240482330322266 time for calcul the mask position with numpy : 0.028144359588623047 nb_pixel_total : 23242 time to create 1 rle with old method : 0.02575826644897461 time for calcul the mask position with numpy : 0.027344465255737305 nb_pixel_total : 14506 time to create 1 rle with old method : 0.016003847122192383 time for calcul the mask position with numpy : 0.028554916381835938 nb_pixel_total : 116782 time to create 1 rle with old method : 0.13227581977844238 time for calcul the mask position with numpy : 0.028499126434326172 nb_pixel_total : 66980 time to create 1 rle with old method : 0.0757443904876709 time for calcul the mask position with numpy : 0.03337717056274414 nb_pixel_total : 18642 time to create 1 rle with old method : 0.030797481536865234 time for calcul the mask position with numpy : 0.032244205474853516 nb_pixel_total : 43024 time to create 1 rle with old method : 0.049799442291259766 time for calcul the mask position with numpy : 0.02908778190612793 nb_pixel_total : 25922 time to create 1 rle with old method : 0.030168771743774414 time for calcul the mask position with numpy : 0.0290830135345459 nb_pixel_total : 65809 time to create 1 rle with old method : 0.07532167434692383 time for calcul the mask position with numpy : 0.029088497161865234 nb_pixel_total : 11262 time to create 1 rle with old method : 0.01315617561340332 time for calcul the mask position with numpy : 0.029486417770385742 nb_pixel_total : 27540 time to create 1 rle with old method : 0.0319209098815918 time for calcul the mask position with numpy : 0.02889561653137207 nb_pixel_total : 9977 time to create 1 rle with old method : 0.011586666107177734 time for calcul the mask position with numpy : 0.028878450393676758 nb_pixel_total : 109914 time to create 1 rle with old method : 0.12495088577270508 time for calcul the mask position with numpy : 0.028858184814453125 nb_pixel_total : 12543 time to create 1 rle with old method : 0.01437997817993164 time for calcul the mask position with numpy : 0.028967618942260742 nb_pixel_total : 144599 time to create 1 rle with old method : 0.16127753257751465 time for calcul the mask position with numpy : 0.027842044830322266 nb_pixel_total : 72468 time to create 1 rle with old method : 0.10858559608459473 time for calcul the mask position with numpy : 0.028756141662597656 nb_pixel_total : 33613 time to create 1 rle with old method : 0.03775906562805176 time for calcul the mask position with numpy : 0.028505802154541016 nb_pixel_total : 13593 time to create 1 rle with old method : 0.015743494033813477 time for calcul the mask position with numpy : 0.029093503952026367 nb_pixel_total : 8157 time to create 1 rle with old method : 0.009584903717041016 time for calcul the mask position with numpy : 0.02969670295715332 nb_pixel_total : 2357 time to create 1 rle with old method : 0.002844095230102539 time for calcul the mask position with numpy : 0.050623416900634766 nb_pixel_total : 12784 time to create 1 rle with old method : 0.019423484802246094 time for calcul the mask position with numpy : 0.029702186584472656 nb_pixel_total : 35459 time to create 1 rle with old method : 0.04411125183105469 time for calcul the mask position with numpy : 0.029989957809448242 nb_pixel_total : 19149 time to create 1 rle with old method : 0.022811174392700195 time for calcul the mask position with numpy : 0.029393672943115234 nb_pixel_total : 12970 time to create 1 rle with old method : 0.015072822570800781 create new chi : 2.988852024078369 time to delete rle : 0.022916793823242188 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 13893 TO DO : save crop sub photo not yet done ! save time : 0.9045093059539795 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 4.9708428382873535 time for calcul the mask position with numpy : 0.5267579555511475 nb_pixel_total : 6461808 time to create 1 rle with new method : 0.588630199432373 time for calcul the mask position with numpy : 0.021540403366088867 nb_pixel_total : 57365 time to create 1 rle with old method : 0.06506204605102539 time for calcul the mask position with numpy : 0.021156787872314453 nb_pixel_total : 39502 time to create 1 rle with old method : 0.045493364334106445 time for calcul the mask position with numpy : 0.03399538993835449 nb_pixel_total : 16213 time to create 1 rle with old method : 0.01842021942138672 time for calcul the mask position with numpy : 0.03624987602233887 nb_pixel_total : 75889 time to create 1 rle with old method : 0.10536766052246094 time for calcul the mask position with numpy : 0.03329181671142578 nb_pixel_total : 29156 time to create 1 rle with old method : 0.03342723846435547 time for calcul the mask position with numpy : 0.034600019454956055 nb_pixel_total : 7207 time to create 1 rle with old method : 0.008490324020385742 time for calcul the mask position with numpy : 0.034194231033325195 nb_pixel_total : 12655 time to create 1 rle with old method : 0.014729022979736328 time for calcul the mask position with numpy : 0.03467679023742676 nb_pixel_total : 19603 time to create 1 rle with old method : 0.025092363357543945 time for calcul the mask position with numpy : 0.03694009780883789 nb_pixel_total : 38307 time to create 1 rle with old method : 0.04507136344909668 time for calcul the mask position with numpy : 0.030901670455932617 nb_pixel_total : 11469 time to create 1 rle with old method : 0.013451099395751953 time for calcul the mask position with numpy : 0.022324562072753906 nb_pixel_total : 81729 time to create 1 rle with old method : 0.099029541015625 time for calcul the mask position with numpy : 0.02295851707458496 nb_pixel_total : 89873 time to create 1 rle with old method : 0.10362648963928223 time for calcul the mask position with numpy : 0.021682262420654297 nb_pixel_total : 17116 time to create 1 rle with old method : 0.020139217376708984 time for calcul the mask position with numpy : 0.022556781768798828 nb_pixel_total : 92348 time to create 1 rle with old method : 0.10623693466186523 create new chi : 2.2610411643981934 time to delete rle : 0.0011484622955322266 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7568 TO DO : save crop sub photo not yet done ! save time : 0.5721454620361328 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 6.685365438461304 time for calcul the mask position with numpy : 0.4202911853790283 nb_pixel_total : 5935746 time to create 1 rle with new method : 0.6715641021728516 time for calcul the mask position with numpy : 0.03999829292297363 nb_pixel_total : 107559 time to create 1 rle with old method : 0.12386822700500488 time for calcul the mask position with numpy : 0.03546738624572754 nb_pixel_total : 163039 time to create 1 rle with new method : 0.6073181629180908 time for calcul the mask position with numpy : 0.03952169418334961 nb_pixel_total : 60746 time to create 1 rle with old method : 0.07327938079833984 time for calcul the mask position with numpy : 0.034561872482299805 nb_pixel_total : 122420 time to create 1 rle with old method : 0.1390221118927002 time for calcul the mask position with numpy : 0.03661823272705078 nb_pixel_total : 23738 time to create 1 rle with old method : 0.02734541893005371 time for calcul the mask position with numpy : 0.03341984748840332 nb_pixel_total : 18332 time to create 1 rle with old method : 0.021243572235107422 time for calcul the mask position with numpy : 0.033010244369506836 nb_pixel_total : 20418 time to create 1 rle with old method : 0.023712873458862305 time for calcul the mask position with numpy : 0.032366275787353516 nb_pixel_total : 8841 time to create 1 rle with old method : 0.010259628295898438 time for calcul the mask position with numpy : 0.021168947219848633 nb_pixel_total : 65268 time to create 1 rle with old method : 0.07651877403259277 time for calcul the mask position with numpy : 0.021974563598632812 nb_pixel_total : 16384 time to create 1 rle with old method : 0.018985271453857422 time for calcul the mask position with numpy : 0.020952224731445312 nb_pixel_total : 73760 time to create 1 rle with old method : 0.08393621444702148 time for calcul the mask position with numpy : 0.021251678466796875 nb_pixel_total : 43519 time to create 1 rle with old method : 0.050110816955566406 time for calcul the mask position with numpy : 0.021260976791381836 nb_pixel_total : 35633 time to create 1 rle with old method : 0.04737448692321777 time for calcul the mask position with numpy : 0.026134252548217773 nb_pixel_total : 34193 time to create 1 rle with old method : 0.040892839431762695 time for calcul the mask position with numpy : 0.022910356521606445 nb_pixel_total : 17676 time to create 1 rle with old method : 0.020476818084716797 time for calcul the mask position with numpy : 0.03085803985595703 nb_pixel_total : 46554 time to create 1 rle with old method : 0.0535731315612793 time for calcul the mask position with numpy : 0.036907196044921875 nb_pixel_total : 211323 time to create 1 rle with new method : 0.44847893714904785 time for calcul the mask position with numpy : 0.0377960205078125 nb_pixel_total : 45091 time to create 1 rle with old method : 0.057741403579711914 create new chi : 3.6578426361083984 time to delete rle : 0.0021314620971679688 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 13943 TO DO : save crop sub photo not yet done ! save time : 0.9440288543701172 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 4.885634183883667 time for calcul the mask position with numpy : 0.47396016120910645 nb_pixel_total : 6179577 time to create 1 rle with new method : 1.5823888778686523 time for calcul the mask position with numpy : 0.02429938316345215 nb_pixel_total : 65825 time to create 1 rle with old method : 0.07520914077758789 time for calcul the mask position with numpy : 0.0213162899017334 nb_pixel_total : 29194 time to create 1 rle with old method : 0.03506755828857422 time for calcul the mask position with numpy : 0.023151636123657227 nb_pixel_total : 62382 time to create 1 rle with old method : 0.0716712474822998 time for calcul the mask position with numpy : 0.023423194885253906 nb_pixel_total : 205069 time to create 1 rle with new method : 0.5551228523254395 time for calcul the mask position with numpy : 0.021651268005371094 nb_pixel_total : 708 time to create 1 rle with old method : 0.0011281967163085938 time for calcul the mask position with numpy : 0.02401566505432129 nb_pixel_total : 9385 time to create 1 rle with old method : 0.010820150375366211 time for calcul the mask position with numpy : 0.026360511779785156 nb_pixel_total : 92011 time to create 1 rle with old method : 0.10579299926757812 time for calcul the mask position with numpy : 0.02266073226928711 nb_pixel_total : 11158 time to create 1 rle with old method : 0.012821197509765625 time for calcul the mask position with numpy : 0.02469611167907715 nb_pixel_total : 286343 time to create 1 rle with new method : 0.6152021884918213 time for calcul the mask position with numpy : 0.0213773250579834 nb_pixel_total : 54838 time to create 1 rle with old method : 0.060324668884277344 time for calcul the mask position with numpy : 0.023928403854370117 nb_pixel_total : 10739 time to create 1 rle with old method : 0.012427806854248047 time for calcul the mask position with numpy : 0.023068904876708984 nb_pixel_total : 17446 time to create 1 rle with old method : 0.01958942413330078 time for calcul the mask position with numpy : 0.019629240036010742 nb_pixel_total : 25565 time to create 1 rle with old method : 0.02835869789123535 create new chi : 4.05289888381958 time to delete rle : 0.0015461444854736328 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10539 TO DO : save crop sub photo not yet done ! save time : 0.787869930267334 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.309946537017822 time for calcul the mask position with numpy : 0.6709194183349609 nb_pixel_total : 6300049 time to create 1 rle with new method : 0.7212140560150146 time for calcul the mask position with numpy : 0.034485578536987305 nb_pixel_total : 2906 time to create 1 rle with old method : 0.0035123825073242188 time for calcul the mask position with numpy : 0.020721435546875 nb_pixel_total : 103607 time to create 1 rle with old method : 0.11805486679077148 time for calcul the mask position with numpy : 0.022599458694458008 nb_pixel_total : 324184 time to create 1 rle with new method : 0.612574577331543 time for calcul the mask position with numpy : 0.020499467849731445 nb_pixel_total : 76564 time to create 1 rle with old method : 0.08545184135437012 time for calcul the mask position with numpy : 0.020316600799560547 nb_pixel_total : 40419 time to create 1 rle with old method : 0.04495120048522949 time for calcul the mask position with numpy : 0.020398616790771484 nb_pixel_total : 16024 time to create 1 rle with old method : 0.018474817276000977 time for calcul the mask position with numpy : 0.02139568328857422 nb_pixel_total : 115065 time to create 1 rle with old method : 0.12788748741149902 time for calcul the mask position with numpy : 0.02264690399169922 nb_pixel_total : 31666 time to create 1 rle with old method : 0.03504586219787598 time for calcul the mask position with numpy : 0.020182132720947266 nb_pixel_total : 32999 time to create 1 rle with old method : 0.036876678466796875 time for calcul the mask position with numpy : 0.020017147064208984 nb_pixel_total : 6757 time to create 1 rle with old method : 0.007611274719238281 create new chi : 2.76529860496521 time to delete rle : 0.0011892318725585938 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8181 TO DO : save crop sub photo not yet done ! save time : 0.6130847930908203 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 6.139016628265381 time for calcul the mask position with numpy : 0.6081864833831787 nb_pixel_total : 6464768 time to create 1 rle with new method : 0.7438673973083496 time for calcul the mask position with numpy : 0.02030777931213379 nb_pixel_total : 60291 time to create 1 rle with old method : 0.06791305541992188 time for calcul the mask position with numpy : 0.022051334381103516 nb_pixel_total : 9107 time to create 1 rle with old method : 0.010169744491577148 time for calcul the mask position with numpy : 0.021886825561523438 nb_pixel_total : 19306 time to create 1 rle with old method : 0.022066593170166016 time for calcul the mask position with numpy : 0.02139425277709961 nb_pixel_total : 25033 time to create 1 rle with old method : 0.028203725814819336 time for calcul the mask position with numpy : 0.02179574966430664 nb_pixel_total : 121572 time to create 1 rle with old method : 0.13593149185180664 time for calcul the mask position with numpy : 0.022130250930786133 nb_pixel_total : 84185 time to create 1 rle with old method : 0.09572839736938477 time for calcul the mask position with numpy : 0.025728464126586914 nb_pixel_total : 23091 time to create 1 rle with old method : 0.033212900161743164 time for calcul the mask position with numpy : 0.032143354415893555 nb_pixel_total : 80200 time to create 1 rle with old method : 0.12710928916931152 time for calcul the mask position with numpy : 0.029965639114379883 nb_pixel_total : 13059 time to create 1 rle with old method : 0.015475273132324219 time for calcul the mask position with numpy : 0.02305912971496582 nb_pixel_total : 8475 time to create 1 rle with old method : 0.010026693344116211 time for calcul the mask position with numpy : 0.024348974227905273 nb_pixel_total : 50501 time to create 1 rle with old method : 0.06109619140625 time for calcul the mask position with numpy : 0.022200584411621094 nb_pixel_total : 14917 time to create 1 rle with old method : 0.017063379287719727 time for calcul the mask position with numpy : 0.02142953872680664 nb_pixel_total : 27175 time to create 1 rle with old method : 0.031046390533447266 time for calcul the mask position with numpy : 0.020528554916381836 nb_pixel_total : 25441 time to create 1 rle with old method : 0.028084754943847656 time for calcul the mask position with numpy : 0.020772218704223633 nb_pixel_total : 23119 time to create 1 rle with old method : 0.026722431182861328 create new chi : 2.4489753246307373 time to delete rle : 0.0015652179718017578 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10421 TO DO : save crop sub photo not yet done ! save time : 0.7591438293457031 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.076250076293945 time for calcul the mask position with numpy : 0.6659605503082275 nb_pixel_total : 6462413 time to create 1 rle with new method : 0.9680767059326172 time for calcul the mask position with numpy : 0.022243976593017578 nb_pixel_total : 153247 time to create 1 rle with new method : 0.6069581508636475 time for calcul the mask position with numpy : 0.020485639572143555 nb_pixel_total : 15748 time to create 1 rle with old method : 0.0179443359375 time for calcul the mask position with numpy : 0.02006387710571289 nb_pixel_total : 27455 time to create 1 rle with old method : 0.030505895614624023 time for calcul the mask position with numpy : 0.021974802017211914 nb_pixel_total : 86016 time to create 1 rle with old method : 0.10059380531311035 time for calcul the mask position with numpy : 0.021154165267944336 nb_pixel_total : 67344 time to create 1 rle with old method : 0.0783085823059082 time for calcul the mask position with numpy : 0.029442310333251953 nb_pixel_total : 14782 time to create 1 rle with old method : 0.020563840866088867 time for calcul the mask position with numpy : 0.02202153205871582 nb_pixel_total : 33127 time to create 1 rle with old method : 0.03764629364013672 time for calcul the mask position with numpy : 0.021968603134155273 nb_pixel_total : 31965 time to create 1 rle with old method : 0.03731703758239746 time for calcul the mask position with numpy : 0.02269148826599121 nb_pixel_total : 122906 time to create 1 rle with old method : 0.1460096836090088 time for calcul the mask position with numpy : 0.021948575973510742 nb_pixel_total : 35237 time to create 1 rle with old method : 0.04055976867675781 create new chi : 3.033068895339966 time to delete rle : 0.0014333724975585938 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8787 TO DO : save crop sub photo not yet done ! save time : 0.6201515197753906 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.203956365585327 time for calcul the mask position with numpy : 0.5668799877166748 nb_pixel_total : 6715555 time to create 1 rle with new method : 1.1427240371704102 time for calcul the mask position with numpy : 0.03648948669433594 nb_pixel_total : 23712 time to create 1 rle with old method : 0.027706146240234375 time for calcul the mask position with numpy : 0.038222551345825195 nb_pixel_total : 39122 time to create 1 rle with old method : 0.04599332809448242 time for calcul the mask position with numpy : 0.027037382125854492 nb_pixel_total : 12796 time to create 1 rle with old method : 0.014587163925170898 time for calcul the mask position with numpy : 0.02110600471496582 nb_pixel_total : 11222 time to create 1 rle with old method : 0.012836456298828125 time for calcul the mask position with numpy : 0.0258028507232666 nb_pixel_total : 24058 time to create 1 rle with old method : 0.03089737892150879 time for calcul the mask position with numpy : 0.035225629806518555 nb_pixel_total : 65523 time to create 1 rle with old method : 0.07412934303283691 time for calcul the mask position with numpy : 0.03461861610412598 nb_pixel_total : 104652 time to create 1 rle with old method : 0.11819791793823242 time for calcul the mask position with numpy : 0.03578352928161621 nb_pixel_total : 16961 time to create 1 rle with old method : 0.019522666931152344 time for calcul the mask position with numpy : 0.03341102600097656 nb_pixel_total : 25602 time to create 1 rle with old method : 0.03292059898376465 time for calcul the mask position with numpy : 0.02733159065246582 nb_pixel_total : 11037 time to create 1 rle with old method : 0.012737035751342773 create new chi : 2.4550538063049316 time to delete rle : 0.0011887550354003906 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6680 TO DO : save crop sub photo not yet done ! save time : 0.47881031036376953 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 5.037603139877319 time for calcul the mask position with numpy : 0.5379230976104736 nb_pixel_total : 6083950 time to create 1 rle with new method : 0.8109166622161865 time for calcul the mask position with numpy : 0.023272037506103516 nb_pixel_total : 182976 time to create 1 rle with new method : 0.7893314361572266 time for calcul the mask position with numpy : 0.023340702056884766 nb_pixel_total : 64267 time to create 1 rle with old method : 0.07741761207580566 time for calcul the mask position with numpy : 0.024911165237426758 nb_pixel_total : 25033 time to create 1 rle with old method : 0.029280900955200195 time for calcul the mask position with numpy : 0.023081064224243164 nb_pixel_total : 19239 time to create 1 rle with old method : 0.022597074508666992 time for calcul the mask position with numpy : 0.027503013610839844 nb_pixel_total : 39434 time to create 1 rle with old method : 0.0705869197845459 time for calcul the mask position with numpy : 0.02731943130493164 nb_pixel_total : 49905 time to create 1 rle with old method : 0.07943010330200195 time for calcul the mask position with numpy : 0.022767066955566406 nb_pixel_total : 39671 time to create 1 rle with old method : 0.04633951187133789 time for calcul the mask position with numpy : 0.029220104217529297 nb_pixel_total : 37325 time to create 1 rle with old method : 0.05718350410461426 time for calcul the mask position with numpy : 0.04286670684814453 nb_pixel_total : 148547 time to create 1 rle with old method : 0.17765426635742188 time for calcul the mask position with numpy : 0.03853869438171387 nb_pixel_total : 21907 time to create 1 rle with old method : 0.02555704116821289 time for calcul the mask position with numpy : 0.04122352600097656 nb_pixel_total : 18195 time to create 1 rle with old method : 0.021591663360595703 time for calcul the mask position with numpy : 0.03655743598937988 nb_pixel_total : 36793 time to create 1 rle with old method : 0.04593062400817871 time for calcul the mask position with numpy : 0.0364532470703125 nb_pixel_total : 168012 time to create 1 rle with new method : 1.060379981994629 time for calcul the mask position with numpy : 0.03408336639404297 nb_pixel_total : 71883 time to create 1 rle with old method : 0.08248615264892578 time for calcul the mask position with numpy : 0.03379416465759277 nb_pixel_total : 43103 time to create 1 rle with old method : 0.04923701286315918 create new chi : 4.5348896980285645 time to delete rle : 0.0029823780059814453 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 11128 TO DO : save crop sub photo not yet done ! save time : 0.8270728588104248 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 4.905817747116089 time for calcul the mask position with numpy : 0.4856123924255371 nb_pixel_total : 6635656 time to create 1 rle with new method : 0.8314573764801025 time for calcul the mask position with numpy : 0.0379641056060791 nb_pixel_total : 8447 time to create 1 rle with old method : 0.014056921005249023 time for calcul the mask position with numpy : 0.03974604606628418 nb_pixel_total : 48648 time to create 1 rle with old method : 0.05664253234863281 time for calcul the mask position with numpy : 0.03450798988342285 nb_pixel_total : 54752 time to create 1 rle with old method : 0.06309795379638672 time for calcul the mask position with numpy : 0.034768104553222656 nb_pixel_total : 26975 time to create 1 rle with old method : 0.03142046928405762 time for calcul the mask position with numpy : 0.03103351593017578 nb_pixel_total : 60213 time to create 1 rle with old method : 0.06931233406066895 time for calcul the mask position with numpy : 0.036353111267089844 nb_pixel_total : 20711 time to create 1 rle with old method : 0.023767948150634766 time for calcul the mask position with numpy : 0.033580780029296875 nb_pixel_total : 34729 time to create 1 rle with old method : 0.039168357849121094 time for calcul the mask position with numpy : 0.02634906768798828 nb_pixel_total : 22143 time to create 1 rle with old method : 0.025872468948364258 time for calcul the mask position with numpy : 0.021859407424926758 nb_pixel_total : 38728 time to create 1 rle with old method : 0.04488205909729004 time for calcul the mask position with numpy : 0.022948265075683594 nb_pixel_total : 46534 time to create 1 rle with old method : 0.0539093017578125 time for calcul the mask position with numpy : 0.028210163116455078 nb_pixel_total : 36595 time to create 1 rle with old method : 0.041370391845703125 time for calcul the mask position with numpy : 0.036590576171875 nb_pixel_total : 16109 time to create 1 rle with old method : 0.018685579299926758 create new chi : 2.222180128097534 time to delete rle : 0.0014493465423583984 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8753 TO DO : save crop sub photo not yet done ! save time : 0.6170051097869873 map_output_result : {1359842351: (0.0, 'Should be the crop_list due to order', 0), 1359842333: (0.0, 'Should be the crop_list due to order', 0), 1359842302: (0.0, 'Should be the crop_list due to order', 0), 1359842286: (0.0, 'Should be the crop_list due to order', 0), 1359842281: (0.0, 'Should be the crop_list due to order', 0), 1359842063: (0.0, 'Should be the crop_list due to order', 0), 1359841685: (0.0, 'Should be the crop_list due to order', 0), 1359841673: (0.0, 'Should be the crop_list due to order', 0), 1359841670: (0.0, 'Should be the crop_list due to order', 0), 1359841668: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359842351, 1359842333, 1359842302, 1359842286, 1359842281, 1359842063, 1359841685, 1359841673, 1359841670, 1359841668] Looping around the photos to save general results len do output : 10 /1359842351.Didn't retrieve data . /1359842333.Didn't retrieve data . /1359842302.Didn't retrieve data . /1359842286.Didn't retrieve data . /1359842281.Didn't retrieve data . /1359842063.Didn't retrieve data . /1359841685.Didn't retrieve data . /1359841673.Didn't retrieve data . /1359841670.Didn't retrieve data . /1359841668.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842351', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842333', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842302', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842286', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842281', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842063', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841685', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841673', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841670', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841668', None, None, None, None, None, '2911953') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.012854814529418945 save_final save missing photos in datou_result : time spend for datou_step_exec : 88.95318102836609 time spend to save output : 0.013328075408935547 total time spend for step 3 : 88.96650910377502 step4:ventilate_hashtags_in_portfolio Tue May 20 19:14:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23177171 get user id for portfolio 23177171 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177171 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','environnement','carton','pet_fonce','papier','flou','background','pehd','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177171 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','environnement','carton','pet_fonce','papier','flou','background','pehd','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177171 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','environnement','carton','pet_fonce','papier','flou','background','pehd','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23177510,23177511,23177512,23177513,23177514,23177515,23177516,23177517,23177518,23177519,23177520?tags=autre,mal_croppe,environnement,carton,pet_fonce,papier,flou,background,pehd,pet_clair,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359842351, 1359842333, 1359842302, 1359842286, 1359842281, 1359842063, 1359841685, 1359841673, 1359841670, 1359841668] Looping around the photos to save general results len do output : 1 /23177171. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842351', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842333', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842302', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842286', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842281', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842063', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841685', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841673', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841670', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841668', None, None, None, None, None, '2911953') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015558719635009766 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6581292152404785 time spend to save output : 0.0158843994140625 total time spend for step 4 : 1.674013614654541 step5:final Tue May 20 19:14:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359842351: ('0.10174944399055919',), 1359842333: ('0.10174944399055919',), 1359842302: ('0.10174944399055919',), 1359842286: ('0.10174944399055919',), 1359842281: ('0.10174944399055919',), 1359842063: ('0.10174944399055919',), 1359841685: ('0.10174944399055919',), 1359841673: ('0.10174944399055919',), 1359841670: ('0.10174944399055919',), 1359841668: ('0.10174944399055919',)} new output for save of step final : {1359842351: ('0.10174944399055919',), 1359842333: ('0.10174944399055919',), 1359842302: ('0.10174944399055919',), 1359842286: ('0.10174944399055919',), 1359842281: ('0.10174944399055919',), 1359842063: ('0.10174944399055919',), 1359841685: ('0.10174944399055919',), 1359841673: ('0.10174944399055919',), 1359841670: ('0.10174944399055919',), 1359841668: ('0.10174944399055919',)} [1359842351, 1359842333, 1359842302, 1359842286, 1359842281, 1359842063, 1359841685, 1359841673, 1359841670, 1359841668] Looping around the photos to save general results len do output : 10 /1359842351.Didn't retrieve data . /1359842333.Didn't retrieve data . /1359842302.Didn't retrieve data . /1359842286.Didn't retrieve data . /1359842281.Didn't retrieve data . /1359842063.Didn't retrieve data . /1359841685.Didn't retrieve data . /1359841673.Didn't retrieve data . /1359841670.Didn't retrieve data . /1359841668.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842351', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842333', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842302', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842286', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842281', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842063', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841685', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841673', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841670', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841668', None, None, None, None, None, '2911953') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013041257858276367 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11536431312561035 time spend to save output : 0.05238509178161621 total time spend for step 5 : 0.16774940490722656 step6:blur_detection Tue May 20 19:14:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897.jpg resize: (2160, 3264) 1359842351 -1.5898810202319738 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a.jpg resize: (2160, 3264) 1359842333 -0.6743238218501143 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa.jpg resize: (2160, 3264) 1359842302 0.5369407251720432 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b.jpg resize: (2160, 3264) 1359842286 -0.8722753359700258 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06.jpg resize: (2160, 3264) 1359842281 -1.1559295898365918 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733.jpg resize: (2160, 3264) 1359842063 -0.9434268423792779 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7.jpg resize: (2160, 3264) 1359841685 0.25518622166772403 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c.jpg resize: (2160, 3264) 1359841673 -0.07557803041943348 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9.jpg resize: (2160, 3264) 1359841670 -0.44544672717654044 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7.jpg resize: (2160, 3264) 1359841668 -0.9879561183918307 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500409_0.png resize: (193, 250) 1359845083 -0.4293268774331449 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500411_0.png resize: (137, 131) 1359845085 -0.8391902734346157 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500414_0.png resize: (150, 136) 1359845087 -2.1552986049144303 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500415_0.png resize: (115, 141) 1359845089 -0.1177458769333652 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500416_0.png resize: (423, 507) 1359845092 -1.8516925469971917 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500417_0.png resize: (192, 268) 1359845094 -0.9439596895657458 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500418_0.png resize: (432, 218) 1359845096 -1.4639214252520107 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500419_0.png resize: (150, 186) 1359845098 -0.3683642566541205 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500420_0.png resize: (271, 185) 1359845100 -1.905610003192643 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500421_0.png resize: (186, 247) 1359845102 -1.14793803639466 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500425_0.png resize: (535, 265) 1359845104 -0.8642153143056812 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500427_0.png resize: (85, 219) 1359845106 -0.1731753508301377 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500428_0.png resize: (157, 172) 1359845108 -1.4248017760763967 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500429_0.png resize: (146, 148) 1359845110 -0.8468705029397058 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500430_0.png resize: (88, 106) 1359845112 1.59834979485621 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500431_0.png resize: (170, 155) 1359845114 -0.8395122452700937 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500432_0.png resize: (193, 113) 1359845116 -0.36205658786959 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500438_0.png resize: (91, 203) 1359845118 0.17484389553427546 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500439_0.png resize: (215, 233) 1359845120 0.25653618522804766 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500440_0.png resize: (93, 285) 1359845122 -0.6469637627230894 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500447_0.png resize: (489, 276) 1359845124 0.4552455800331673 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500448_0.png resize: (445, 170) 1359845126 -2.040949392799603 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500449_0.png resize: (580, 803) 1359845128 0.6777973545151751 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500450_0.png resize: (253, 273) 1359845130 -0.258523910493779 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500451_0.png resize: (242, 105) 1359845132 -1.6540632830943527 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500452_0.png resize: (132, 341) 1359845134 -1.5885634380252995 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500453_0.png resize: (245, 191) 1359845136 -0.054876913557882885 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500456_0.png resize: (267, 130) 1359845137 -2.3418676332055512 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500457_0.png resize: (268, 341) 1359845138 -0.3791909306684515 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500459_0.png resize: (176, 152) 1359845139 -0.8231410852941362 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500466_0.png resize: (415, 189) 1359845140 -2.0927763378814235 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500467_0.png resize: (167, 173) 1359845141 -1.8337471864989512 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500468_0.png resize: (112, 146) 1359845142 -0.3995859540858863 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500471_0.png resize: (84, 163) 1359845143 0.7084409578781522 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500472_0.png resize: (394, 370) 1359845144 -1.788732650473415 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500473_0.png resize: (262, 173) 1359845145 -1.9086318197893068 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500477_0.png resize: (208, 233) 1359845146 -2.381786906996599 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500479_0.png resize: (95, 132) 1359845147 -1.2919705146255056 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500480_0.png resize: (170, 272) 1359845148 -0.5718178946659158 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500482_0.png resize: (485, 347) 1359845149 -0.30177796256168354 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500487_0.png resize: (291, 637) 1359845150 -0.21641396314539021 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500488_0.png resize: (347, 309) 1359845151 -2.1340080888576614 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500489_0.png resize: (258, 149) 1359845152 -1.241429683753918 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500490_0.png resize: (198, 227) 1359845153 -1.34556673099769 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500491_0.png resize: (250, 161) 1359845154 -1.9440783397255084 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500492_0.png resize: (178, 108) 1359845155 -0.5762854655110614 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500493_0.png resize: (255, 325) 1359845156 -1.3443599238684945 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500494_0.png resize: (132, 86) 1359845157 -0.5350797510368873 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500496_0.png resize: (377, 293) 1359845158 -1.3757804776259912 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500497_0.png resize: (373, 207) 1359845159 -2.6554001906814158 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500498_0.png resize: (303, 434) 1359845160 -1.9941248012338566 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500500_0.png resize: (211, 147) 1359845161 -0.9733653195583608 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500501_0.png resize: (308, 85) 1359845162 -0.8348940882570292 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500502_0.png resize: (106, 103) 1359845163 -0.3375639640537903 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500503_0.png resize: (304, 369) 1359845164 -0.856709432648389 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500504_0.png resize: (341, 148) 1359845165 -0.3545131280431171 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500506_0.png resize: (197, 264) 1359845166 0.09608875844721437 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500507_0.png resize: (295, 203) 1359845167 -0.9703375776398488 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500508_0.png resize: (158, 153) 1359845168 -0.7526374393749565 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500510_0.png resize: (464, 317) 1359845169 -0.4924832401050625 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500512_0.png resize: (186, 198) 1359845170 -0.7123281355345981 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500513_0.png resize: (695, 774) 1359845171 0.4125096379090753 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500514_0.png resize: (180, 102) 1359845172 -0.34277122972969476 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500515_0.png resize: (184, 212) 1359845173 0.1817340409839492 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500516_0.png resize: (182, 137) 1359845174 -0.5550244954429779 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500517_0.png resize: (564, 419) 1359845175 0.8924128963503577 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500518_0.png resize: (199, 442) 1359845176 -0.7509691467183834 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500520_0.png resize: (169, 143) 1359845177 -1.0371897438993127 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500521_0.png resize: (123, 144) 1359845178 0.8215864975601446 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500524_0.png resize: (233, 331) 1359845179 -0.24685201216616415 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500525_0.png resize: (226, 494) 1359845180 -0.9447108744618379 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500526_0.png resize: (426, 484) 1359845181 -0.886868603173107 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500527_0.png resize: (254, 265) 1359845182 -2.4525928467765423 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500528_0.png resize: (208, 148) 1359845183 -0.9862885517575771 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500529_0.png resize: (124, 271) 1359845184 -0.5976171664430308 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500530_0.png resize: (550, 397) 1359845185 -0.8996997880665356 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500532_0.png resize: (307, 194) 1359845186 -2.425304838144236 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500533_0.png resize: (276, 263) 1359845187 -1.389277487130412 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500534_0.png resize: (257, 256) 1359845188 1.3983366607666445 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500535_0.png resize: (218, 217) 1359845189 -0.9442779115873081 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500536_0.png resize: (223, 164) 1359845190 -0.7320934062465932 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500538_0.png resize: (550, 600) 1359845191 -0.3618148404128637 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500539_0.png resize: (188, 282) 1359845192 -1.0414906476776051 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500541_0.png resize: (252, 294) 1359845193 -1.731827946508425 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500542_0.png resize: (337, 168) 1359845194 0.4990338014924256 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500543_0.png resize: (228, 152) 1359845195 -1.4509948415470306 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500544_0.png resize: (210, 271) 1359845196 -1.2352058750176325 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500545_0.png resize: (139, 191) 1359845197 -0.20083378356717257 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500546_0.png resize: (556, 214) 1359845198 -0.6530566949749966 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500547_0.png resize: (189, 238) 1359845199 -1.6016656964200746 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500549_0.png resize: (284, 249) 1359845200 -0.7527277268242409 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500423_0.png resize: (185, 191) 1359845207 -0.477576139916085 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500435_0.png resize: (149, 174) 1359845209 -1.3680576134568663 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500441_0.png resize: (105, 177) 1359845210 0.23277143261219158 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500458_0.png resize: (130, 87) 1359845211 -0.8849738684968188 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500481_0.png resize: (248, 170) 1359845212 -0.8948489557376542 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500495_0.png resize: (80, 221) 1359845213 0.027558177626455637 treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500499_0.png resize: (392, 527) 1359845214 -1.0737809357054695 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500511_0.png resize: (212, 179) 1359845215 -0.881222297366367 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500523_0.png resize: (237, 135) 1359845216 -0.8988785749692086 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500540_0.png resize: (268, 215) 1359845217 -0.8899107283886195 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500408_0.png resize: (330, 290) 1359845239 -2.191422317344995 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500410_0.png resize: (138, 180) 1359845242 0.0013492236802184574 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500412_0.png resize: (313, 221) 1359845243 -1.6575454815771888 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500413_0.png resize: (285, 575) 1359845244 -0.8591989664179532 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500422_0.png resize: (97, 173) 1359845245 -1.2239617846262836 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500426_0.png resize: (375, 223) 1359845246 -3.0340030103338362 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500433_0.png resize: (212, 187) 1359845247 -1.0359659979039983 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500434_0.png resize: (244, 533) 1359845248 -1.600718334930193 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500436_0.png resize: (314, 360) 1359845249 -1.5952219050049068 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500437_0.png resize: (286, 351) 1359845250 -0.7079828015368174 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500442_0.png resize: (98, 96) 1359845251 -0.5213408826063713 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500443_0.png resize: (110, 322) 1359845252 -0.9979096578022995 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500444_0.png resize: (230, 423) 1359845253 -0.490111500680856 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500445_0.png resize: (151, 136) 1359845254 -3.388993072017036 treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500446_0.png resize: (139, 371) 1359845255 -2.349579444454311 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500454_0.png resize: (315, 272) 1359845256 -0.7314786764080496 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500455_0.png resize: (301, 316) 1359845257 0.0915744834072779 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500460_0.png resize: (118, 196) 1359845258 -1.2440330518285252 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500461_0.png resize: (132, 251) 1359845259 -2.2335634875594312 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500462_0.png resize: (474, 572) 1359845260 -0.17587113582910333 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500463_0.png resize: (367, 251) 1359845261 -0.7040459593528502 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500464_0.png resize: (613, 385) 1359845262 -1.2763654791383057 treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500465_0.png resize: (491, 495) 1359845263 -2.170337214450235 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500469_0.png resize: (365, 211) 1359845264 -2.430883282617342 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500470_0.png resize: (617, 585) 1359845265 -1.7354957832447977 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500474_0.png resize: (233, 184) 1359845266 -1.9154778468975557 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500475_0.png resize: (534, 552) 1359845267 0.03855964534348293 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500476_0.png resize: (447, 799) 1359845268 -1.2163315466865372 treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500478_0.png resize: (206, 445) 1359845270 -1.3223960118111848 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500483_0.png resize: (170, 125) 1359845271 -1.8397526653735912 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500484_0.png resize: (369, 171) 1359845272 -2.8906392473014506 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500485_0.png resize: (321, 310) 1359845273 -1.979431344890685 treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500486_0.png resize: (594, 656) 1359845275 -1.0992935091472584 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500505_0.png resize: (529, 303) 1359845276 -1.2828727193290166 treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500509_0.png resize: (225, 402) 1359845277 -2.5924326827617272 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500519_0.png resize: (93, 322) 1359845278 -0.20961775682014958 treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500522_0.png resize: (211, 235) 1359845279 -2.0681169910712693 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500531_0.png resize: (202, 228) 1359845280 -3.2188460473995457 treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500537_0.png resize: (237, 370) 1359845281 -1.4126410043650297 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500548_0.png resize: (388, 207) 1359845282 -0.4882067918476636 treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500424_0.png resize: (129, 188) 1359845283 -0.7981649689144227 treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500550_0.png resize: (108, 102) 1359845287 0.41116789801677534 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 153 time used for this insertion : 0.019676685333251953 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 153 time used for this insertion : 0.03585362434387207 save missing photos in datou_result : time spend for datou_step_exec : 35.63519334793091 time spend to save output : 0.060413360595703125 total time spend for step 6 : 35.69560670852661 step7:brightness Tue May 20 19:15:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897.jpg treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a.jpg treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa.jpg treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b.jpg treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06.jpg treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733.jpg treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7.jpg treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c.jpg treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9.jpg treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7.jpg treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500409_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500411_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500414_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500415_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500416_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500417_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500418_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500419_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500420_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500421_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500425_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500427_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500428_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500429_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500430_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500431_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500432_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500438_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500439_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500440_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500447_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500448_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500449_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500450_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500451_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500452_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500453_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500456_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500457_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500459_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500466_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500467_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500468_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500471_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500472_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500473_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500477_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500479_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500480_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500482_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500487_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500488_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500489_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500490_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500491_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500492_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500493_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500494_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500496_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500497_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500498_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500500_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500501_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500502_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500503_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500504_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500506_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500507_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500508_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500510_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500512_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500513_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500514_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500515_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500516_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500517_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500518_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500520_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500521_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500524_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500525_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500526_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500527_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500528_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500529_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500530_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500532_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500533_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500534_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500535_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500536_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500538_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500539_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500541_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500542_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500543_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500544_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500545_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500546_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500547_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500549_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500423_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500435_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500441_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500458_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500481_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500495_0.png treat image : temp/1747761029_3539443_1359842063_5d548ebc6c6b5cecaadfc973094fa733_rle_crop_3806500499_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500511_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500523_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500540_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500408_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500410_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500412_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500413_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500422_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500426_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500433_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500434_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500436_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500437_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500442_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500443_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500444_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500445_0.png treat image : temp/1747761029_3539443_1359842333_a7c5c23dd327ba8b0a7dd4b4f7a94c5a_rle_crop_3806500446_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500454_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500455_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500460_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500461_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500462_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500463_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500464_0.png treat image : temp/1747761029_3539443_1359842302_9aa7a0e4699d499d0102fa48f20b13aa_rle_crop_3806500465_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500469_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500470_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500474_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500475_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500476_0.png treat image : temp/1747761029_3539443_1359842286_6a0b400150b7701fa425c1326cfc059b_rle_crop_3806500478_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500483_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500484_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500485_0.png treat image : temp/1747761029_3539443_1359842281_4748cfac494d99caf9f77b958d151f06_rle_crop_3806500486_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500505_0.png treat image : temp/1747761029_3539443_1359841685_8f009247abcbeba20f7d24f9c59b2dc7_rle_crop_3806500509_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500519_0.png treat image : temp/1747761029_3539443_1359841673_0da979a3f77f4ec2e2976e2ed18f0f0c_rle_crop_3806500522_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500531_0.png treat image : temp/1747761029_3539443_1359841670_eddebc458d50e388499acf62f1e40bc9_rle_crop_3806500537_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500548_0.png treat image : temp/1747761029_3539443_1359842351_b01d161f4358cfc9b9e8fcacacc35897_rle_crop_3806500424_0.png treat image : temp/1747761029_3539443_1359841668_6c780e89406bedae90c2fae2e3d9ccc7_rle_crop_3806500550_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 153 time used for this insertion : 0.021845102310180664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 153 time used for this insertion : 0.03357815742492676 save missing photos in datou_result : time spend for datou_step_exec : 8.970693111419678 time spend to save output : 0.06074094772338867 total time spend for step 7 : 9.031434059143066 step8:velours_tree Tue May 20 19:15:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.20585298538208008 time spend to save output : 5.14984130859375e-05 total time spend for step 8 : 0.20590448379516602 step9:send_mail_cod Tue May 20 19:15:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23177171_20-05-2025_19_15_23.pdf 23177510 change filename to text .imagette231775101747761323 23177511 imagette231775111747761323 23177513 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231775131747761323 23177514 imagette231775141747761324 23177515 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231775151747761324 23177516 imagette231775161747761325 23177517 imagette231775171747761325 23177518 change filename to text .imagette231775181747761325 23177519 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .-- Missing : http://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/5/20/3f646a5fde093d1c3f0f9f5633647de8_91391204.png retrying : [Errno 104] Connection reset by peer change filename to text .imagette231775191747761325 23177520 imagette231775201747761327 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23177171 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23177510,23177511,23177512,23177513,23177514,23177515,23177516,23177517,23177518,23177519,23177520?tags=autre,mal_croppe,environnement,carton,pet_fonce,papier,flou,background,pehd,pet_clair,metal args[1359842351] : ((1359842351, -1.5898810202319738, 492688767), (1359842351, 0.053806378862047186, 2107752395), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359842333] : ((1359842333, -0.6743238218501143, 492688767), (1359842333, 0.14473484008158538, 2107752395), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359842302] : ((1359842302, 0.5369407251720432, 492688767), (1359842302, -0.3583221529927513, 496442774), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359842286] : ((1359842286, -0.8722753359700258, 492688767), (1359842286, -0.08150812936133238, 496442774), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359842281] : ((1359842281, -1.1559295898365918, 492688767), (1359842281, 0.2275893205221626, 2107752395), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359842063] : ((1359842063, -0.9434268423792779, 492688767), (1359842063, 0.14205601910568366, 2107752395), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359841685] : ((1359841685, 0.25518622166772403, 492688767), (1359841685, 0.24583491571424143, 2107752395), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359841673] : ((1359841673, -0.07557803041943348, 492688767), (1359841673, 0.2211139274362821, 2107752395), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359841670] : ((1359841670, -0.44544672717654044, 492688767), (1359841670, 0.12450296934543834, 2107752395), '0.10174944399055919') We are sending mail with results at report@fotonower.com args[1359841668] : ((1359841668, -0.9879561183918307, 492688767), (1359841668, 0.10119260313399119, 2107752395), '0.10174944399055919') We are sending mail with results at report@fotonower.com refus_total : 0.10174944399055919 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23177171 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177171_20-05-2025_19_15_23.pdf results_Auto_P23177171_20-05-2025_19_15_23.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177171_20-05-2025_19_15_23.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23177171','results_Auto_P23177171_20-05-2025_19_15_23.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177171_20-05-2025_19_15_23.pdf','pdf','','0.57','0.10174944399055919') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23177171

https://www.fotonower.com/image?json=false&list_photos_id=1359842351
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359842333
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359842302
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359842286
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359842281
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359842063
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841685
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841673
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841670
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841668
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.17%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/23177510?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23177513?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23177515?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/23177518?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23177519?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177171_20-05-2025_19_15_23.pdf.

Lien vers velours :https://www.fotonower.com/velours/23177510,23177511,23177512,23177513,23177514,23177515,23177516,23177517,23177518,23177519,23177520?tags=autre,mal_croppe,environnement,carton,pet_fonce,papier,flou,background,pehd,pet_clair,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 20 May 2025 17:15:29 GMT Content-Length: 0 Connection: close X-Message-Id: wpwVAzQiRI6T0iyWP-INIQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359842351, 1359842333, 1359842302, 1359842286, 1359842281, 1359842063, 1359841685, 1359841673, 1359841670, 1359841668] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842351', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842333', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842302', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842286', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842281', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842063', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841685', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841673', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841670', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841668', None, None, None, None, None, '2911953') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013408899307250977 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.322529077529907 time spend to save output : 0.013590574264526367 total time spend for step 9 : 6.336119651794434 step10:split_time_score Tue May 20 19:15:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20052025 23177171 Nombre de photos uploadées : 10 / 23040 (0%) 20052025 23177171 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 20052025 23177171 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005486011505126953 elapsed_time : insert_dashboard_record_day_entry 0.030407428741455078 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.0462500658941438 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23159907_20-05-2025_09_13_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23159907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23159907 AND mptpi.`type`=3726 To do Qualite : 0.12732645980846047 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23167061_20-05-2025_13_36_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23167061 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23167061 AND mptpi.`type`=3594 To do Qualite : 0.11592767054738566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172605_20-05-2025_16_44_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172605 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175553 order by id desc limit 1 Qualite : 0.14202566153776322 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23175554_20-05-2025_18_16_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23175554 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175556 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177157 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177158 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177162 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177165 order by id desc limit 1 Qualite : 0.10174944399055919 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177171_20-05-2025_19_15_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177171 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20052025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359842351, 1359842333, 1359842302, 1359842286, 1359842281, 1359842063, 1359841685, 1359841673, 1359841670, 1359841668] Looping around the photos to save general results len do output : 1 /23177171Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842351', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842333', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842302', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842286', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842281', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359842063', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841685', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841673', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841670', None, None, None, None, None, '2911953') ('3318', None, None, None, None, None, None, None, '2911953') ('3318', '23177171', '1359841668', None, None, None, None, None, '2911953') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016887903213500977 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.112730264663696 time spend to save output : 0.0171205997467041 total time spend for step 10 : 6.1298508644104 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 136.78user 121.67system 5:11.63elapsed 82%CPU (0avgtext+0avgdata 5110264maxresident)k 720688inputs+72712outputs (13747major+12991267minor)pagefaults 0swaps