python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3810365 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2551267'] with mtr_portfolio_ids : ['20255775'] and first list_photo_ids : [] new path : /proc/3810365/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.9823732376098633 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Feb 5 13:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-05 13:40:34.439338: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-05 13:40:34.463061: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-05 13:40:34.464657: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7adc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-05 13:40:34.464696: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-05 13:40:34.467578: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-05 13:40:34.792760: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3cb9ff00 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-05 13:40:34.792827: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-05 13:40:34.794420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-05 13:40:34.795096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-05 13:40:34.798411: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-05 13:40:34.801660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-05 13:40:34.802267: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-05 13:40:34.805329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-05 13:40:34.806462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-05 13:40:34.811023: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-05 13:40:34.812545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-05 13:40:34.812622: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-05 13:40:34.813383: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-05 13:40:34.813398: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-05 13:40:34.813407: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-05 13:40:34.814719: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-05 13:40:35.063798: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-05 13:40:35.063881: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-05 13:40:35.063901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-05 13:40:35.063923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-05 13:40:35.063943: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-05 13:40:35.063960: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-05 13:40:35.063976: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-05 13:40:35.063993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-05 13:40:35.065305: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-05 13:40:35.066395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-05 13:40:35.066428: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-05 13:40:35.066446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-05 13:40:35.066460: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-05 13:40:35.066474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-05 13:40:35.066487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-05 13:40:35.066501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-05 13:40:35.066515: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-05 13:40:35.067802: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-05 13:40:35.067831: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-05 13:40:35.067840: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-05 13:40:35.067848: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-05 13:40:35.069215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-05 13:40:43.286969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-05 13:40:43.472352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 Detection mask done ! Trying to reset tf kernel 3811124 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5553 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.003543376922607422 nb_pixel_total : 86724 time to create 1 rle with old method : 0.09837865829467773 length of segment : 425 time for calcul the mask position with numpy : 0.0005819797515869141 nb_pixel_total : 24287 time to create 1 rle with old method : 0.027965307235717773 length of segment : 149 time for calcul the mask position with numpy : 0.001416921615600586 nb_pixel_total : 44125 time to create 1 rle with old method : 0.048000335693359375 length of segment : 268 time for calcul the mask position with numpy : 0.00033974647521972656 nb_pixel_total : 16582 time to create 1 rle with old method : 0.01904916763305664 length of segment : 143 time for calcul the mask position with numpy : 0.00042247772216796875 nb_pixel_total : 14888 time to create 1 rle with old method : 0.038489580154418945 length of segment : 173 time for calcul the mask position with numpy : 0.0007803440093994141 nb_pixel_total : 11942 time to create 1 rle with old method : 0.027427196502685547 length of segment : 149 time for calcul the mask position with numpy : 0.0008351802825927734 nb_pixel_total : 21882 time to create 1 rle with old method : 0.024997472763061523 length of segment : 217 time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 17842 time to create 1 rle with old method : 0.020952939987182617 length of segment : 385 time for calcul the mask position with numpy : 0.0008170604705810547 nb_pixel_total : 32690 time to create 1 rle with old method : 0.03604459762573242 length of segment : 267 time for calcul the mask position with numpy : 0.0008487701416015625 nb_pixel_total : 25671 time to create 1 rle with old method : 0.029865503311157227 length of segment : 237 time for calcul the mask position with numpy : 0.0014600753784179688 nb_pixel_total : 51436 time to create 1 rle with old method : 0.056880950927734375 length of segment : 394 time for calcul the mask position with numpy : 0.007050991058349609 nb_pixel_total : 211258 time to create 1 rle with new method : 0.026127338409423828 length of segment : 713 time for calcul the mask position with numpy : 0.0005702972412109375 nb_pixel_total : 27422 time to create 1 rle with old method : 0.0314335823059082 length of segment : 207 time for calcul the mask position with numpy : 0.00028514862060546875 nb_pixel_total : 10524 time to create 1 rle with old method : 0.011824369430541992 length of segment : 204 time for calcul the mask position with numpy : 0.0024566650390625 nb_pixel_total : 85940 time to create 1 rle with old method : 0.09589910507202148 length of segment : 417 time for calcul the mask position with numpy : 0.0003299713134765625 nb_pixel_total : 14127 time to create 1 rle with old method : 0.016246318817138672 length of segment : 161 time for calcul the mask position with numpy : 0.0004749298095703125 nb_pixel_total : 23056 time to create 1 rle with old method : 0.0297091007232666 length of segment : 150 time for calcul the mask position with numpy : 0.0005593299865722656 nb_pixel_total : 25412 time to create 1 rle with old method : 0.04095935821533203 length of segment : 183 time for calcul the mask position with numpy : 0.0004994869232177734 nb_pixel_total : 29133 time to create 1 rle with old method : 0.03665924072265625 length of segment : 208 time for calcul the mask position with numpy : 0.0007481575012207031 nb_pixel_total : 43396 time to create 1 rle with old method : 0.05189919471740723 length of segment : 262 time for calcul the mask position with numpy : 0.0006868839263916016 nb_pixel_total : 25421 time to create 1 rle with old method : 0.029248952865600586 length of segment : 247 time for calcul the mask position with numpy : 0.000982046127319336 nb_pixel_total : 44038 time to create 1 rle with old method : 0.06903696060180664 length of segment : 332 time for calcul the mask position with numpy : 0.001874685287475586 nb_pixel_total : 119627 time to create 1 rle with old method : 0.12934422492980957 length of segment : 464 time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 17968 time to create 1 rle with old method : 0.019793272018432617 length of segment : 179 time for calcul the mask position with numpy : 0.003081083297729492 nb_pixel_total : 154561 time to create 1 rle with new method : 0.01231527328491211 length of segment : 571 time for calcul the mask position with numpy : 0.00032901763916015625 nb_pixel_total : 17205 time to create 1 rle with old method : 0.019112825393676758 length of segment : 145 time for calcul the mask position with numpy : 0.0005543231964111328 nb_pixel_total : 26827 time to create 1 rle with old method : 0.033133506774902344 length of segment : 353 time for calcul the mask position with numpy : 0.0005133152008056641 nb_pixel_total : 27887 time to create 1 rle with old method : 0.03098464012145996 length of segment : 229 time for calcul the mask position with numpy : 0.0006227493286132812 nb_pixel_total : 34607 time to create 1 rle with old method : 0.04119420051574707 length of segment : 263 time for calcul the mask position with numpy : 0.003629446029663086 nb_pixel_total : 94172 time to create 1 rle with old method : 0.13077116012573242 length of segment : 590 time for calcul the mask position with numpy : 0.0007195472717285156 nb_pixel_total : 20105 time to create 1 rle with old method : 0.02251577377319336 length of segment : 167 time for calcul the mask position with numpy : 0.0017018318176269531 nb_pixel_total : 58544 time to create 1 rle with old method : 0.06357908248901367 length of segment : 282 time for calcul the mask position with numpy : 0.0012691020965576172 nb_pixel_total : 33593 time to create 1 rle with old method : 0.03788566589355469 length of segment : 237 time for calcul the mask position with numpy : 0.0014595985412597656 nb_pixel_total : 37813 time to create 1 rle with old method : 0.04194211959838867 length of segment : 275 time for calcul the mask position with numpy : 0.0009357929229736328 nb_pixel_total : 24801 time to create 1 rle with old method : 0.02812027931213379 length of segment : 162 time for calcul the mask position with numpy : 0.0011217594146728516 nb_pixel_total : 28176 time to create 1 rle with old method : 0.035247087478637695 length of segment : 240 time for calcul the mask position with numpy : 0.009680509567260742 nb_pixel_total : 249032 time to create 1 rle with new method : 0.020864248275756836 length of segment : 653 time for calcul the mask position with numpy : 0.0008251667022705078 nb_pixel_total : 21254 time to create 1 rle with old method : 0.031208038330078125 length of segment : 150 time for calcul the mask position with numpy : 0.00152587890625 nb_pixel_total : 35857 time to create 1 rle with old method : 0.03964686393737793 length of segment : 385 time for calcul the mask position with numpy : 0.0010323524475097656 nb_pixel_total : 31469 time to create 1 rle with old method : 0.03554797172546387 length of segment : 183 time for calcul the mask position with numpy : 0.0012810230255126953 nb_pixel_total : 28294 time to create 1 rle with old method : 0.031839847564697266 length of segment : 233 time for calcul the mask position with numpy : 0.0023262500762939453 nb_pixel_total : 47017 time to create 1 rle with old method : 0.053193092346191406 length of segment : 367 time for calcul the mask position with numpy : 0.002421140670776367 nb_pixel_total : 99671 time to create 1 rle with old method : 0.10986781120300293 length of segment : 347 time for calcul the mask position with numpy : 0.000461578369140625 nb_pixel_total : 12039 time to create 1 rle with old method : 0.013805389404296875 length of segment : 100 time for calcul the mask position with numpy : 0.002370595932006836 nb_pixel_total : 71582 time to create 1 rle with old method : 0.07661080360412598 length of segment : 457 time for calcul the mask position with numpy : 0.0003490447998046875 nb_pixel_total : 12898 time to create 1 rle with old method : 0.013924360275268555 length of segment : 154 time for calcul the mask position with numpy : 0.0073757171630859375 nb_pixel_total : 254613 time to create 1 rle with new method : 0.01522374153137207 length of segment : 841 time for calcul the mask position with numpy : 0.0014820098876953125 nb_pixel_total : 60356 time to create 1 rle with old method : 0.06467103958129883 length of segment : 244 time for calcul the mask position with numpy : 0.0026578903198242188 nb_pixel_total : 87042 time to create 1 rle with old method : 0.09449100494384766 length of segment : 385 time for calcul the mask position with numpy : 0.0003650188446044922 nb_pixel_total : 8658 time to create 1 rle with old method : 0.00956273078918457 length of segment : 103 time for calcul the mask position with numpy : 0.0011281967163085938 nb_pixel_total : 21684 time to create 1 rle with old method : 0.024203777313232422 length of segment : 340 time for calcul the mask position with numpy : 0.000438690185546875 nb_pixel_total : 8555 time to create 1 rle with old method : 0.009715080261230469 length of segment : 103 time for calcul the mask position with numpy : 0.0012505054473876953 nb_pixel_total : 84601 time to create 1 rle with old method : 0.08724093437194824 length of segment : 291 time for calcul the mask position with numpy : 0.0007727146148681641 nb_pixel_total : 23921 time to create 1 rle with old method : 0.025191068649291992 length of segment : 173 time for calcul the mask position with numpy : 0.003954172134399414 nb_pixel_total : 121087 time to create 1 rle with old method : 0.12458276748657227 length of segment : 484 time for calcul the mask position with numpy : 0.00638890266418457 nb_pixel_total : 186882 time to create 1 rle with new method : 0.012236356735229492 length of segment : 846 time for calcul the mask position with numpy : 0.0007891654968261719 nb_pixel_total : 6262 time to create 1 rle with old method : 0.0071833133697509766 length of segment : 122 time for calcul the mask position with numpy : 0.0021088123321533203 nb_pixel_total : 45361 time to create 1 rle with old method : 0.04960799217224121 length of segment : 398 time for calcul the mask position with numpy : 0.0017099380493164062 nb_pixel_total : 41211 time to create 1 rle with old method : 0.04467940330505371 length of segment : 512 time for calcul the mask position with numpy : 0.001093149185180664 nb_pixel_total : 23636 time to create 1 rle with old method : 0.0256497859954834 length of segment : 226 time for calcul the mask position with numpy : 0.0003352165222167969 nb_pixel_total : 9976 time to create 1 rle with old method : 0.011475563049316406 length of segment : 115 time for calcul the mask position with numpy : 0.0018856525421142578 nb_pixel_total : 57811 time to create 1 rle with old method : 0.06484365463256836 length of segment : 616 time for calcul the mask position with numpy : 0.0009329319000244141 nb_pixel_total : 12198 time to create 1 rle with old method : 0.013687372207641602 length of segment : 228 time for calcul the mask position with numpy : 0.0010442733764648438 nb_pixel_total : 25868 time to create 1 rle with old method : 0.028694629669189453 length of segment : 241 time for calcul the mask position with numpy : 0.002308368682861328 nb_pixel_total : 66584 time to create 1 rle with old method : 0.07677674293518066 length of segment : 442 time for calcul the mask position with numpy : 0.0008289813995361328 nb_pixel_total : 8593 time to create 1 rle with old method : 0.012255191802978516 length of segment : 211 time for calcul the mask position with numpy : 0.0012063980102539062 nb_pixel_total : 26226 time to create 1 rle with old method : 0.02977895736694336 length of segment : 232 time for calcul the mask position with numpy : 0.004751920700073242 nb_pixel_total : 71048 time to create 1 rle with old method : 0.07996654510498047 length of segment : 599 time for calcul the mask position with numpy : 0.0013089179992675781 nb_pixel_total : 28930 time to create 1 rle with old method : 0.033535003662109375 length of segment : 182 time for calcul the mask position with numpy : 0.0009362697601318359 nb_pixel_total : 21422 time to create 1 rle with old method : 0.02410149574279785 length of segment : 254 time for calcul the mask position with numpy : 0.00150299072265625 nb_pixel_total : 24892 time to create 1 rle with old method : 0.028208017349243164 length of segment : 290 time for calcul the mask position with numpy : 0.0012786388397216797 nb_pixel_total : 24379 time to create 1 rle with old method : 0.027286767959594727 length of segment : 449 time for calcul the mask position with numpy : 0.0024385452270507812 nb_pixel_total : 68347 time to create 1 rle with old method : 0.07802104949951172 length of segment : 405 time for calcul the mask position with numpy : 0.0017092227935791016 nb_pixel_total : 48375 time to create 1 rle with old method : 0.06317734718322754 length of segment : 230 time for calcul the mask position with numpy : 0.0009176731109619141 nb_pixel_total : 6236 time to create 1 rle with old method : 0.01024484634399414 length of segment : 343 time for calcul the mask position with numpy : 0.001775979995727539 nb_pixel_total : 52316 time to create 1 rle with old method : 0.057952165603637695 length of segment : 294 time for calcul the mask position with numpy : 0.014248132705688477 nb_pixel_total : 281978 time to create 1 rle with new method : 0.02576756477355957 length of segment : 790 time for calcul the mask position with numpy : 0.000997781753540039 nb_pixel_total : 15616 time to create 1 rle with old method : 0.017953872680664062 length of segment : 274 time for calcul the mask position with numpy : 0.0009272098541259766 nb_pixel_total : 17363 time to create 1 rle with old method : 0.0196380615234375 length of segment : 181 time for calcul the mask position with numpy : 0.0013577938079833984 nb_pixel_total : 23429 time to create 1 rle with old method : 0.026456356048583984 length of segment : 235 time for calcul the mask position with numpy : 0.003521442413330078 nb_pixel_total : 51441 time to create 1 rle with old method : 0.05960583686828613 length of segment : 258 time for calcul the mask position with numpy : 0.0016782283782958984 nb_pixel_total : 44368 time to create 1 rle with old method : 0.04953432083129883 length of segment : 302 time for calcul the mask position with numpy : 0.0023784637451171875 nb_pixel_total : 62141 time to create 1 rle with old method : 0.06911063194274902 length of segment : 424 time for calcul the mask position with numpy : 0.0009832382202148438 nb_pixel_total : 37231 time to create 1 rle with old method : 0.04149985313415527 length of segment : 180 time for calcul the mask position with numpy : 0.0012354850769042969 nb_pixel_total : 28576 time to create 1 rle with old method : 0.03173708915710449 length of segment : 239 time for calcul the mask position with numpy : 0.0009448528289794922 nb_pixel_total : 20954 time to create 1 rle with old method : 0.023430585861206055 length of segment : 192 time for calcul the mask position with numpy : 0.0006091594696044922 nb_pixel_total : 14587 time to create 1 rle with old method : 0.017139911651611328 length of segment : 68 time for calcul the mask position with numpy : 0.0010900497436523438 nb_pixel_total : 18607 time to create 1 rle with old method : 0.02127528190612793 length of segment : 206 time for calcul the mask position with numpy : 0.002794027328491211 nb_pixel_total : 51122 time to create 1 rle with old method : 0.07554912567138672 length of segment : 395 time for calcul the mask position with numpy : 0.0006952285766601562 nb_pixel_total : 17350 time to create 1 rle with old method : 0.019487857818603516 length of segment : 147 time for calcul the mask position with numpy : 0.0007283687591552734 nb_pixel_total : 15016 time to create 1 rle with old method : 0.016928672790527344 length of segment : 124 time for calcul the mask position with numpy : 0.0019526481628417969 nb_pixel_total : 26328 time to create 1 rle with old method : 0.03136920928955078 length of segment : 238 time for calcul the mask position with numpy : 0.001615762710571289 nb_pixel_total : 27596 time to create 1 rle with old method : 0.03143143653869629 length of segment : 297 time for calcul the mask position with numpy : 0.00095367431640625 nb_pixel_total : 24074 time to create 1 rle with old method : 0.02742934226989746 length of segment : 115 time for calcul the mask position with numpy : 0.0006172657012939453 nb_pixel_total : 11781 time to create 1 rle with old method : 0.013449668884277344 length of segment : 145 time for calcul the mask position with numpy : 0.001997709274291992 nb_pixel_total : 50247 time to create 1 rle with old method : 0.05559802055358887 length of segment : 288 time for calcul the mask position with numpy : 0.004024982452392578 nb_pixel_total : 66424 time to create 1 rle with old method : 0.07250189781188965 length of segment : 825 time for calcul the mask position with numpy : 0.0013337135314941406 nb_pixel_total : 26328 time to create 1 rle with old method : 0.029004335403442383 length of segment : 240 time for calcul the mask position with numpy : 0.0020961761474609375 nb_pixel_total : 31046 time to create 1 rle with old method : 0.03556394577026367 length of segment : 201 time for calcul the mask position with numpy : 0.002284526824951172 nb_pixel_total : 48200 time to create 1 rle with old method : 0.058825016021728516 length of segment : 304 time for calcul the mask position with numpy : 0.00034427642822265625 nb_pixel_total : 9009 time to create 1 rle with old method : 0.010582685470581055 length of segment : 99 time for calcul the mask position with numpy : 0.0074024200439453125 nb_pixel_total : 188606 time to create 1 rle with new method : 0.012388944625854492 length of segment : 649 time for calcul the mask position with numpy : 0.001432657241821289 nb_pixel_total : 37553 time to create 1 rle with old method : 0.04280233383178711 length of segment : 213 time for calcul the mask position with numpy : 0.0009241104125976562 nb_pixel_total : 18283 time to create 1 rle with old method : 0.020962238311767578 length of segment : 173 time for calcul the mask position with numpy : 0.002113819122314453 nb_pixel_total : 27096 time to create 1 rle with old method : 0.030826807022094727 length of segment : 318 time for calcul the mask position with numpy : 0.002134084701538086 nb_pixel_total : 56022 time to create 1 rle with old method : 0.0610959529876709 length of segment : 410 time for calcul the mask position with numpy : 0.00032520294189453125 nb_pixel_total : 3880 time to create 1 rle with old method : 0.0044803619384765625 length of segment : 99 time for calcul the mask position with numpy : 0.004319429397583008 nb_pixel_total : 122695 time to create 1 rle with old method : 0.1404273509979248 length of segment : 557 time for calcul the mask position with numpy : 0.004492998123168945 nb_pixel_total : 23619 time to create 1 rle with old method : 0.027874469757080078 length of segment : 277 time for calcul the mask position with numpy : 0.0030291080474853516 nb_pixel_total : 81641 time to create 1 rle with old method : 0.08903360366821289 length of segment : 414 time for calcul the mask position with numpy : 0.0020148754119873047 nb_pixel_total : 58605 time to create 1 rle with old method : 0.06664562225341797 length of segment : 316 time for calcul the mask position with numpy : 0.0010800361633300781 nb_pixel_total : 32231 time to create 1 rle with old method : 0.03565192222595215 length of segment : 182 time for calcul the mask position with numpy : 0.00417017936706543 nb_pixel_total : 115133 time to create 1 rle with old method : 0.16266512870788574 length of segment : 340 time for calcul the mask position with numpy : 0.0007433891296386719 nb_pixel_total : 20883 time to create 1 rle with old method : 0.023530006408691406 length of segment : 143 time for calcul the mask position with numpy : 0.0014369487762451172 nb_pixel_total : 39279 time to create 1 rle with old method : 0.04334259033203125 length of segment : 293 time for calcul the mask position with numpy : 0.0012176036834716797 nb_pixel_total : 31718 time to create 1 rle with old method : 0.034929513931274414 length of segment : 236 time for calcul the mask position with numpy : 0.0006756782531738281 nb_pixel_total : 24158 time to create 1 rle with old method : 0.026953458786010742 length of segment : 125 time for calcul the mask position with numpy : 0.001516580581665039 nb_pixel_total : 44161 time to create 1 rle with old method : 0.04852771759033203 length of segment : 386 time for calcul the mask position with numpy : 0.0016088485717773438 nb_pixel_total : 33710 time to create 1 rle with old method : 0.037485599517822266 length of segment : 428 time for calcul the mask position with numpy : 0.0006268024444580078 nb_pixel_total : 13149 time to create 1 rle with old method : 0.014913797378540039 length of segment : 126 time for calcul the mask position with numpy : 0.002404928207397461 nb_pixel_total : 66487 time to create 1 rle with old method : 0.07320785522460938 length of segment : 398 time for calcul the mask position with numpy : 0.002664327621459961 nb_pixel_total : 77003 time to create 1 rle with old method : 0.08472633361816406 length of segment : 318 time for calcul the mask position with numpy : 0.0008828639984130859 nb_pixel_total : 16480 time to create 1 rle with old method : 0.02719283103942871 length of segment : 149 time for calcul the mask position with numpy : 0.00028204917907714844 nb_pixel_total : 10373 time to create 1 rle with old method : 0.011821269989013672 length of segment : 137 time for calcul the mask position with numpy : 0.0006439685821533203 nb_pixel_total : 20295 time to create 1 rle with old method : 0.02268528938293457 length of segment : 186 time for calcul the mask position with numpy : 0.0006186962127685547 nb_pixel_total : 11971 time to create 1 rle with old method : 0.013547897338867188 length of segment : 166 time for calcul the mask position with numpy : 0.0006089210510253906 nb_pixel_total : 20695 time to create 1 rle with old method : 0.02319788932800293 length of segment : 156 time for calcul the mask position with numpy : 0.0035893917083740234 nb_pixel_total : 74548 time to create 1 rle with old method : 0.08228707313537598 length of segment : 345 time for calcul the mask position with numpy : 0.0007512569427490234 nb_pixel_total : 22172 time to create 1 rle with old method : 0.02512192726135254 length of segment : 172 time for calcul the mask position with numpy : 0.0008404254913330078 nb_pixel_total : 21893 time to create 1 rle with old method : 0.024175167083740234 length of segment : 192 time for calcul the mask position with numpy : 0.0012826919555664062 nb_pixel_total : 37064 time to create 1 rle with old method : 0.04133915901184082 length of segment : 216 time for calcul the mask position with numpy : 0.0008554458618164062 nb_pixel_total : 24607 time to create 1 rle with old method : 0.02783036231994629 length of segment : 189 time for calcul the mask position with numpy : 0.00032019615173339844 nb_pixel_total : 7109 time to create 1 rle with old method : 0.008062601089477539 length of segment : 86 time for calcul the mask position with numpy : 0.0011107921600341797 nb_pixel_total : 32360 time to create 1 rle with old method : 0.036005258560180664 length of segment : 191 time for calcul the mask position with numpy : 0.0013997554779052734 nb_pixel_total : 28949 time to create 1 rle with old method : 0.031958580017089844 length of segment : 274 time for calcul the mask position with numpy : 0.0007250308990478516 nb_pixel_total : 21781 time to create 1 rle with old method : 0.030169010162353516 length of segment : 174 time for calcul the mask position with numpy : 0.0006730556488037109 nb_pixel_total : 18092 time to create 1 rle with old method : 0.029798507690429688 length of segment : 132 time for calcul the mask position with numpy : 0.0004665851593017578 nb_pixel_total : 19533 time to create 1 rle with old method : 0.02196955680847168 length of segment : 165 time for calcul the mask position with numpy : 0.0015833377838134766 nb_pixel_total : 32121 time to create 1 rle with old method : 0.03575587272644043 length of segment : 247 time for calcul the mask position with numpy : 0.0012083053588867188 nb_pixel_total : 35024 time to create 1 rle with old method : 0.03857159614562988 length of segment : 280 time for calcul the mask position with numpy : 0.0006036758422851562 nb_pixel_total : 10597 time to create 1 rle with old method : 0.017677783966064453 length of segment : 98 time for calcul the mask position with numpy : 0.0005376338958740234 nb_pixel_total : 12671 time to create 1 rle with old method : 0.020939350128173828 length of segment : 113 time for calcul the mask position with numpy : 0.0019233226776123047 nb_pixel_total : 58574 time to create 1 rle with old method : 0.06453871726989746 length of segment : 318 time spent for convertir_results : 11.776739835739136 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 143 chid ids of type : 3594 Number RLEs to save : 40430 save missing photos in datou_result : time spend for datou_step_exec : 66.19521427154541 time spend to save output : 2.7038235664367676 total time spend for step 1 : 68.89903783798218 step2:crop_condition Wed Feb 5 13:41:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 143 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 116 About to insert : list_path_to_insert length 116 new photo from crops ! About to upload 116 photos upload in portfolio : 3736932 init cache_photo without model_param we have 116 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738759328_3810365 we have uploaded 116 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.798024654388428 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738759360_3810365 we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.268685579299927 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738759366_3810365 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5342655181884766 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738759368_3810365 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0403480529785156 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1334894212, 1334894203, 1334894151, 1334894094, 1334894008, 1334893901, 1334893655, 1334893647, 1334893633] Looping around the photos to save general results len do output : 143 /1334933239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334933404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894212', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894203', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894151', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894094', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894008', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893901', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893655', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893647', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893633', None, None, None, None, None, '2551267') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 438 time used for this insertion : 0.02670884132385254 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.91266369819641 time spend to save output : 0.02986001968383789 total time spend for step 2 : 68.94252371788025 step3:rle_unique_nms_with_priority Wed Feb 5 13:42:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 143 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 1.5746104717254639 time for calcul the mask position with numpy : 0.6344180107116699 nb_pixel_total : 7697127 time to create 1 rle with new method : 0.8316736221313477 time for calcul the mask position with numpy : 0.02449774742126465 nb_pixel_total : 10524 time to create 1 rle with old method : 0.012012481689453125 time for calcul the mask position with numpy : 0.023904085159301758 nb_pixel_total : 27422 time to create 1 rle with old method : 0.030028343200683594 time for calcul the mask position with numpy : 0.026461124420166016 nb_pixel_total : 211258 time to create 1 rle with new method : 0.4135897159576416 time for calcul the mask position with numpy : 0.025316476821899414 nb_pixel_total : 51436 time to create 1 rle with old method : 0.0701298713684082 time for calcul the mask position with numpy : 0.02572035789489746 nb_pixel_total : 25671 time to create 1 rle with old method : 0.03135275840759277 time for calcul the mask position with numpy : 0.02353811264038086 nb_pixel_total : 32690 time to create 1 rle with old method : 0.03435921669006348 time for calcul the mask position with numpy : 0.023142099380493164 nb_pixel_total : 17842 time to create 1 rle with old method : 0.01873612403869629 time for calcul the mask position with numpy : 0.02320241928100586 nb_pixel_total : 21882 time to create 1 rle with old method : 0.022592782974243164 time for calcul the mask position with numpy : 0.023928403854370117 nb_pixel_total : 11942 time to create 1 rle with old method : 0.012864112854003906 time for calcul the mask position with numpy : 0.02411055564880371 nb_pixel_total : 14888 time to create 1 rle with old method : 0.016504764556884766 time for calcul the mask position with numpy : 0.023675203323364258 nb_pixel_total : 16582 time to create 1 rle with old method : 0.017624616622924805 time for calcul the mask position with numpy : 0.02429795265197754 nb_pixel_total : 44125 time to create 1 rle with old method : 0.04724478721618652 time for calcul the mask position with numpy : 0.024253129959106445 nb_pixel_total : 24287 time to create 1 rle with old method : 0.02625870704650879 time for calcul the mask position with numpy : 0.024493694305419922 nb_pixel_total : 86724 time to create 1 rle with old method : 0.09050488471984863 create new chi : 2.714428663253784 time to delete rle : 0.07962489128112793 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10022 TO DO : save crop sub photo not yet done ! save time : 0.7708139419555664 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 1.452505111694336 time for calcul the mask position with numpy : 0.42638397216796875 nb_pixel_total : 7605195 time to create 1 rle with new method : 0.7641568183898926 time for calcul the mask position with numpy : 0.023507356643676758 nb_pixel_total : 34607 time to create 1 rle with old method : 0.0363926887512207 time for calcul the mask position with numpy : 0.023395061492919922 nb_pixel_total : 27887 time to create 1 rle with old method : 0.029996633529663086 time for calcul the mask position with numpy : 0.024840354919433594 nb_pixel_total : 26827 time to create 1 rle with old method : 0.028921842575073242 time for calcul the mask position with numpy : 0.02445697784423828 nb_pixel_total : 17205 time to create 1 rle with old method : 0.018152236938476562 time for calcul the mask position with numpy : 0.024599075317382812 nb_pixel_total : 154561 time to create 1 rle with new method : 0.6272614002227783 time for calcul the mask position with numpy : 0.02364826202392578 nb_pixel_total : 17968 time to create 1 rle with old method : 0.0193939208984375 time for calcul the mask position with numpy : 0.023966550827026367 nb_pixel_total : 119627 time to create 1 rle with old method : 0.1201026439666748 time for calcul the mask position with numpy : 0.02286386489868164 nb_pixel_total : 44038 time to create 1 rle with old method : 0.04389381408691406 time for calcul the mask position with numpy : 0.023777246475219727 nb_pixel_total : 25421 time to create 1 rle with old method : 0.0264127254486084 time for calcul the mask position with numpy : 0.023616313934326172 nb_pixel_total : 43396 time to create 1 rle with old method : 0.04504799842834473 time for calcul the mask position with numpy : 0.026558637619018555 nb_pixel_total : 29133 time to create 1 rle with old method : 0.030275583267211914 time for calcul the mask position with numpy : 0.047332763671875 nb_pixel_total : 25412 time to create 1 rle with old method : 0.026414155960083008 time for calcul the mask position with numpy : 0.037602901458740234 nb_pixel_total : 23056 time to create 1 rle with old method : 0.03375506401062012 time for calcul the mask position with numpy : 0.04326987266540527 nb_pixel_total : 14127 time to create 1 rle with old method : 0.01716017723083496 time for calcul the mask position with numpy : 0.026148319244384766 nb_pixel_total : 85940 time to create 1 rle with old method : 0.09123015403747559 create new chi : 2.873814821243286 time to delete rle : 0.0013968944549560547 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10488 TO DO : save crop sub photo not yet done ! save time : 0.6304874420166016 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 2.785574436187744 time for calcul the mask position with numpy : 0.5410840511322021 nb_pixel_total : 7388083 time to create 1 rle with new method : 0.7968378067016602 time for calcul the mask position with numpy : 0.02320551872253418 nb_pixel_total : 12898 time to create 1 rle with old method : 0.013480663299560547 time for calcul the mask position with numpy : 0.025075912475585938 nb_pixel_total : 71582 time to create 1 rle with old method : 0.07785940170288086 time for calcul the mask position with numpy : 0.02493453025817871 nb_pixel_total : 12039 time to create 1 rle with old method : 0.012910842895507812 time for calcul the mask position with numpy : 0.025770902633666992 nb_pixel_total : 99671 time to create 1 rle with old method : 0.1072530746459961 time for calcul the mask position with numpy : 0.027096033096313477 nb_pixel_total : 47017 time to create 1 rle with old method : 0.07074427604675293 time for calcul the mask position with numpy : 0.024651288986206055 nb_pixel_total : 28294 time to create 1 rle with old method : 0.030174970626831055 time for calcul the mask position with numpy : 0.024069786071777344 nb_pixel_total : 31469 time to create 1 rle with old method : 0.03349709510803223 time for calcul the mask position with numpy : 0.023576974868774414 nb_pixel_total : 35857 time to create 1 rle with old method : 0.03811502456665039 time for calcul the mask position with numpy : 0.02436232566833496 nb_pixel_total : 21254 time to create 1 rle with old method : 0.021811485290527344 time for calcul the mask position with numpy : 0.025323867797851562 nb_pixel_total : 249032 time to create 1 rle with new method : 0.5204935073852539 time for calcul the mask position with numpy : 0.023650169372558594 nb_pixel_total : 28176 time to create 1 rle with old method : 0.030542373657226562 time for calcul the mask position with numpy : 0.02317047119140625 nb_pixel_total : 24801 time to create 1 rle with old method : 0.027146339416503906 time for calcul the mask position with numpy : 0.023216724395751953 nb_pixel_total : 37813 time to create 1 rle with old method : 0.039722442626953125 time for calcul the mask position with numpy : 0.02574896812438965 nb_pixel_total : 33593 time to create 1 rle with old method : 0.036721229553222656 time for calcul the mask position with numpy : 0.027428865432739258 nb_pixel_total : 58544 time to create 1 rle with old method : 0.06367373466491699 time for calcul the mask position with numpy : 0.028894662857055664 nb_pixel_total : 20105 time to create 1 rle with old method : 0.030449867248535156 time for calcul the mask position with numpy : 0.029714107513427734 nb_pixel_total : 94172 time to create 1 rle with old method : 0.10888957977294922 create new chi : 3.096405029296875 time to delete rle : 0.002856731414794922 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 12124 TO DO : save crop sub photo not yet done ! save time : 0.690990686416626 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 1.003631830215454 time for calcul the mask position with numpy : 0.4481832981109619 nb_pixel_total : 7509523 time to create 1 rle with new method : 0.2631855010986328 time for calcul the mask position with numpy : 0.026932239532470703 nb_pixel_total : 6262 time to create 1 rle with old method : 0.0067708492279052734 time for calcul the mask position with numpy : 0.029406309127807617 nb_pixel_total : 186882 time to create 1 rle with new method : 0.15269064903259277 time for calcul the mask position with numpy : 0.023552417755126953 nb_pixel_total : 121087 time to create 1 rle with old method : 0.1585540771484375 time for calcul the mask position with numpy : 0.025171995162963867 nb_pixel_total : 23921 time to create 1 rle with old method : 0.027063846588134766 time for calcul the mask position with numpy : 0.027022838592529297 nb_pixel_total : 5817 time to create 1 rle with old method : 0.0070002079010009766 time for calcul the mask position with numpy : 0.02549886703491211 nb_pixel_total : 8555 time to create 1 rle with old method : 0.009690523147583008 time for calcul the mask position with numpy : 0.02500295639038086 nb_pixel_total : 21684 time to create 1 rle with old method : 0.023078441619873047 time for calcul the mask position with numpy : 0.02388620376586914 nb_pixel_total : 8658 time to create 1 rle with old method : 0.00991964340209961 time for calcul the mask position with numpy : 0.025480270385742188 nb_pixel_total : 87042 time to create 1 rle with old method : 0.09294557571411133 time for calcul the mask position with numpy : 0.025370359420776367 nb_pixel_total : 60356 time to create 1 rle with old method : 0.06577801704406738 time for calcul the mask position with numpy : 0.039374589920043945 nb_pixel_total : 254613 time to create 1 rle with new method : 0.1664719581604004 create new chi : 1.7973685264587402 time to delete rle : 0.0015404224395751953 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9737 TO DO : save crop sub photo not yet done ! save time : 0.582075834274292 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 2.457547664642334 time for calcul the mask position with numpy : 0.37923622131347656 nb_pixel_total : 7362681 time to create 1 rle with new method : 0.7016723155975342 time for calcul the mask position with numpy : 0.024544477462768555 nb_pixel_total : 15616 time to create 1 rle with old method : 0.016643762588500977 time for calcul the mask position with numpy : 0.0288546085357666 nb_pixel_total : 261785 time to create 1 rle with new method : 0.5273523330688477 time for calcul the mask position with numpy : 0.023981571197509766 nb_pixel_total : 52316 time to create 1 rle with old method : 0.05411028861999512 time for calcul the mask position with numpy : 0.0235445499420166 nb_pixel_total : 2181 time to create 1 rle with old method : 0.0024373531341552734 time for calcul the mask position with numpy : 0.023064136505126953 nb_pixel_total : 48375 time to create 1 rle with old method : 0.05006527900695801 time for calcul the mask position with numpy : 0.02342677116394043 nb_pixel_total : 68347 time to create 1 rle with old method : 0.07088541984558105 time for calcul the mask position with numpy : 0.024418115615844727 nb_pixel_total : 24379 time to create 1 rle with old method : 0.02572464942932129 time for calcul the mask position with numpy : 0.023512601852416992 nb_pixel_total : 24892 time to create 1 rle with old method : 0.0268857479095459 time for calcul the mask position with numpy : 0.02427363395690918 nb_pixel_total : 21303 time to create 1 rle with old method : 0.02243804931640625 time for calcul the mask position with numpy : 0.027547597885131836 nb_pixel_total : 28930 time to create 1 rle with old method : 0.04586434364318848 time for calcul the mask position with numpy : 0.025841236114501953 nb_pixel_total : 71048 time to create 1 rle with old method : 0.07238960266113281 time for calcul the mask position with numpy : 0.02286076545715332 nb_pixel_total : 26226 time to create 1 rle with old method : 0.02692723274230957 time for calcul the mask position with numpy : 0.0233154296875 nb_pixel_total : 8593 time to create 1 rle with old method : 0.00883626937866211 time for calcul the mask position with numpy : 0.022841215133666992 nb_pixel_total : 66584 time to create 1 rle with old method : 0.06607604026794434 time for calcul the mask position with numpy : 0.036940813064575195 nb_pixel_total : 25868 time to create 1 rle with old method : 0.02749800682067871 time for calcul the mask position with numpy : 0.039820194244384766 nb_pixel_total : 12198 time to create 1 rle with old method : 0.013250589370727539 time for calcul the mask position with numpy : 0.03942990303039551 nb_pixel_total : 52894 time to create 1 rle with old method : 0.05410122871398926 time for calcul the mask position with numpy : 0.038332462310791016 nb_pixel_total : 9976 time to create 1 rle with old method : 0.010455131530761719 time for calcul the mask position with numpy : 0.035390615463256836 nb_pixel_total : 23636 time to create 1 rle with old method : 0.024354934692382812 time for calcul the mask position with numpy : 0.039049625396728516 nb_pixel_total : 41211 time to create 1 rle with old method : 0.04123187065124512 time for calcul the mask position with numpy : 0.023967266082763672 nb_pixel_total : 45361 time to create 1 rle with old method : 0.04688620567321777 create new chi : 2.9750585556030273 time to delete rle : 0.0036725997924804688 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16115 TO DO : save crop sub photo not yet done ! save time : 0.9302167892456055 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 1.6593821048736572 time for calcul the mask position with numpy : 0.39683008193969727 nb_pixel_total : 7832719 time to create 1 rle with new method : 0.7012333869934082 time for calcul the mask position with numpy : 0.02620553970336914 nb_pixel_total : 11781 time to create 1 rle with old method : 0.017275571823120117 time for calcul the mask position with numpy : 0.02462005615234375 nb_pixel_total : 24074 time to create 1 rle with old method : 0.024953126907348633 time for calcul the mask position with numpy : 0.024007081985473633 nb_pixel_total : 27596 time to create 1 rle with old method : 0.02857494354248047 time for calcul the mask position with numpy : 0.024118661880493164 nb_pixel_total : 26328 time to create 1 rle with old method : 0.027398109436035156 time for calcul the mask position with numpy : 0.023609638214111328 nb_pixel_total : 15016 time to create 1 rle with old method : 0.01569199562072754 time for calcul the mask position with numpy : 0.02388143539428711 nb_pixel_total : 17350 time to create 1 rle with old method : 0.0178835391998291 time for calcul the mask position with numpy : 0.023516416549682617 nb_pixel_total : 51122 time to create 1 rle with old method : 0.05423593521118164 time for calcul the mask position with numpy : 0.023918867111206055 nb_pixel_total : 18607 time to create 1 rle with old method : 0.020087242126464844 time for calcul the mask position with numpy : 0.023799896240234375 nb_pixel_total : 14587 time to create 1 rle with old method : 0.015364646911621094 time for calcul the mask position with numpy : 0.02229475975036621 nb_pixel_total : 20954 time to create 1 rle with old method : 0.021587610244750977 time for calcul the mask position with numpy : 0.021854162216186523 nb_pixel_total : 28576 time to create 1 rle with old method : 0.029702186584472656 time for calcul the mask position with numpy : 0.022610187530517578 nb_pixel_total : 6948 time to create 1 rle with old method : 0.007169485092163086 time for calcul the mask position with numpy : 0.0232088565826416 nb_pixel_total : 62141 time to create 1 rle with old method : 0.06375813484191895 time for calcul the mask position with numpy : 0.022283554077148438 nb_pixel_total : 44368 time to create 1 rle with old method : 0.04378461837768555 time for calcul the mask position with numpy : 0.022983074188232422 nb_pixel_total : 51441 time to create 1 rle with old method : 0.05362296104431152 time for calcul the mask position with numpy : 0.02222609519958496 nb_pixel_total : 23429 time to create 1 rle with old method : 0.02342081069946289 time for calcul the mask position with numpy : 0.02303481101989746 nb_pixel_total : 17363 time to create 1 rle with old method : 0.018111467361450195 create new chi : 2.034322500228882 time to delete rle : 0.0015685558319091797 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 9485 TO DO : save crop sub photo not yet done ! save time : 0.630648136138916 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 0.7721748352050781 time for calcul the mask position with numpy : 0.5750336647033691 nb_pixel_total : 7503773 time to create 1 rle with new method : 0.4628918170928955 time for calcul the mask position with numpy : 0.024374008178710938 nb_pixel_total : 81619 time to create 1 rle with old method : 0.08853626251220703 time for calcul the mask position with numpy : 0.02520895004272461 nb_pixel_total : 23619 time to create 1 rle with old method : 0.02601313591003418 time for calcul the mask position with numpy : 0.026372432708740234 nb_pixel_total : 122695 time to create 1 rle with old method : 0.12999749183654785 time for calcul the mask position with numpy : 0.023350000381469727 nb_pixel_total : 3880 time to create 1 rle with old method : 0.004229307174682617 time for calcul the mask position with numpy : 0.024044513702392578 nb_pixel_total : 56022 time to create 1 rle with old method : 0.06024742126464844 time for calcul the mask position with numpy : 0.02718973159790039 nb_pixel_total : 27096 time to create 1 rle with old method : 0.028827905654907227 time for calcul the mask position with numpy : 0.024162769317626953 nb_pixel_total : 18283 time to create 1 rle with old method : 0.0199432373046875 time for calcul the mask position with numpy : 0.02404928207397461 nb_pixel_total : 37553 time to create 1 rle with old method : 0.03941488265991211 time for calcul the mask position with numpy : 0.02475452423095703 nb_pixel_total : 188606 time to create 1 rle with new method : 0.4289705753326416 time for calcul the mask position with numpy : 0.023868799209594727 nb_pixel_total : 9009 time to create 1 rle with old method : 0.009547948837280273 time for calcul the mask position with numpy : 0.02298283576965332 nb_pixel_total : 48200 time to create 1 rle with old method : 0.04912137985229492 time for calcul the mask position with numpy : 0.02297234535217285 nb_pixel_total : 31046 time to create 1 rle with old method : 0.03247833251953125 time for calcul the mask position with numpy : 0.023741483688354492 nb_pixel_total : 26328 time to create 1 rle with old method : 0.028252840042114258 time for calcul the mask position with numpy : 0.02426910400390625 nb_pixel_total : 66424 time to create 1 rle with old method : 0.07005548477172852 time for calcul the mask position with numpy : 0.02420973777770996 nb_pixel_total : 50247 time to create 1 rle with old method : 0.05774807929992676 create new chi : 2.5524990558624268 time to delete rle : 0.002010345458984375 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 12286 TO DO : save crop sub photo not yet done ! save time : 0.8276832103729248 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 1.3143861293792725 time for calcul the mask position with numpy : 0.5694005489349365 nb_pixel_total : 7658069 time to create 1 rle with new method : 0.6491451263427734 time for calcul the mask position with numpy : 0.02380681037902832 nb_pixel_total : 20695 time to create 1 rle with old method : 0.02235555648803711 time for calcul the mask position with numpy : 0.023319005966186523 nb_pixel_total : 11971 time to create 1 rle with old method : 0.013290882110595703 time for calcul the mask position with numpy : 0.023104429244995117 nb_pixel_total : 20295 time to create 1 rle with old method : 0.021162748336791992 time for calcul the mask position with numpy : 0.023304224014282227 nb_pixel_total : 10373 time to create 1 rle with old method : 0.011556625366210938 time for calcul the mask position with numpy : 0.022968769073486328 nb_pixel_total : 16480 time to create 1 rle with old method : 0.01721477508544922 time for calcul the mask position with numpy : 0.022856473922729492 nb_pixel_total : 77003 time to create 1 rle with old method : 0.08081674575805664 time for calcul the mask position with numpy : 0.023461103439331055 nb_pixel_total : 66487 time to create 1 rle with old method : 0.06650710105895996 time for calcul the mask position with numpy : 0.02233290672302246 nb_pixel_total : 13149 time to create 1 rle with old method : 0.01325082778930664 time for calcul the mask position with numpy : 0.022508621215820312 nb_pixel_total : 33710 time to create 1 rle with old method : 0.03499579429626465 time for calcul the mask position with numpy : 0.023197174072265625 nb_pixel_total : 44161 time to create 1 rle with old method : 0.045203447341918945 time for calcul the mask position with numpy : 0.022356033325195312 nb_pixel_total : 24158 time to create 1 rle with old method : 0.03257417678833008 time for calcul the mask position with numpy : 0.02553534507751465 nb_pixel_total : 31718 time to create 1 rle with old method : 0.04607701301574707 time for calcul the mask position with numpy : 0.025008440017700195 nb_pixel_total : 39279 time to create 1 rle with old method : 0.04093742370605469 time for calcul the mask position with numpy : 0.023372411727905273 nb_pixel_total : 20883 time to create 1 rle with old method : 0.022329092025756836 time for calcul the mask position with numpy : 0.02523517608642578 nb_pixel_total : 115133 time to create 1 rle with old method : 0.11878538131713867 time for calcul the mask position with numpy : 0.02437138557434082 nb_pixel_total : 32231 time to create 1 rle with old method : 0.03381514549255371 time for calcul the mask position with numpy : 0.023804187774658203 nb_pixel_total : 58605 time to create 1 rle with old method : 0.06080174446105957 create new chi : 2.3411898612976074 time to delete rle : 0.0014491081237792969 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10330 TO DO : save crop sub photo not yet done ! save time : 1.0048506259918213 nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 0.9183018207550049 time for calcul the mask position with numpy : 0.37510108947753906 nb_pixel_total : 7837305 time to create 1 rle with new method : 0.5624945163726807 time for calcul the mask position with numpy : 0.022853851318359375 nb_pixel_total : 58574 time to create 1 rle with old method : 0.05948328971862793 time for calcul the mask position with numpy : 0.022797346115112305 nb_pixel_total : 12671 time to create 1 rle with old method : 0.012962102890014648 time for calcul the mask position with numpy : 0.02252483367919922 nb_pixel_total : 10597 time to create 1 rle with old method : 0.010913372039794922 time for calcul the mask position with numpy : 0.02278900146484375 nb_pixel_total : 35024 time to create 1 rle with old method : 0.035423994064331055 time for calcul the mask position with numpy : 0.022821426391601562 nb_pixel_total : 32121 time to create 1 rle with old method : 0.03365802764892578 time for calcul the mask position with numpy : 0.023643016815185547 nb_pixel_total : 19533 time to create 1 rle with old method : 0.020449161529541016 time for calcul the mask position with numpy : 0.024604320526123047 nb_pixel_total : 18092 time to create 1 rle with old method : 0.018713951110839844 time for calcul the mask position with numpy : 0.024817943572998047 nb_pixel_total : 21781 time to create 1 rle with old method : 0.024129867553710938 time for calcul the mask position with numpy : 0.023601055145263672 nb_pixel_total : 28949 time to create 1 rle with old method : 0.030622005462646484 time for calcul the mask position with numpy : 0.02388620376586914 nb_pixel_total : 32360 time to create 1 rle with old method : 0.034162282943725586 time for calcul the mask position with numpy : 0.023444175720214844 nb_pixel_total : 7109 time to create 1 rle with old method : 0.007842540740966797 time for calcul the mask position with numpy : 0.02347850799560547 nb_pixel_total : 24607 time to create 1 rle with old method : 0.02606654167175293 time for calcul the mask position with numpy : 0.023642778396606445 nb_pixel_total : 37064 time to create 1 rle with old method : 0.03837776184082031 time for calcul the mask position with numpy : 0.02498483657836914 nb_pixel_total : 21893 time to create 1 rle with old method : 0.023171424865722656 time for calcul the mask position with numpy : 0.023629188537597656 nb_pixel_total : 22172 time to create 1 rle with old method : 0.023252010345458984 time for calcul the mask position with numpy : 0.02387213706970215 nb_pixel_total : 74548 time to create 1 rle with old method : 0.07721114158630371 create new chi : 1.8365540504455566 time to delete rle : 0.0013592243194580078 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 8544 TO DO : save crop sub photo not yet done ! save time : 0.618105411529541 map_output_result : {1334894212: (0.0, 'Should be the crop_list due to order', 0.0), 1334894203: (0.0, 'Should be the crop_list due to order', 0.0), 1334894151: (0.0, 'Should be the crop_list due to order', 0.0), 1334894094: (0.0, 'Should be the crop_list due to order', 0.0), 1334894008: (0.0, 'Should be the crop_list due to order', 0.0), 1334893901: (0.0, 'Should be the crop_list due to order', 0.0), 1334893655: (0.0, 'Should be the crop_list due to order', 0.0), 1334893647: (0.0, 'Should be the crop_list due to order', 0.0), 1334893633: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1334894212, 1334894203, 1334894151, 1334894094, 1334894008, 1334893901, 1334893655, 1334893647, 1334893633] Looping around the photos to save general results len do output : 9 /1334894212.Didn't retrieve data . /1334894203.Didn't retrieve data . /1334894151.Didn't retrieve data . /1334894094.Didn't retrieve data . /1334894008.Didn't retrieve data . /1334893901.Didn't retrieve data . /1334893655.Didn't retrieve data . /1334893647.Didn't retrieve data . /1334893633.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894212', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894203', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894151', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894094', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894008', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893901', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893655', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893647', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893633', None, None, None, None, None, '2551267') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.012324810028076172 save_final save missing photos in datou_result : time spend for datou_step_exec : 43.973936319351196 time spend to save output : 0.012743473052978516 total time spend for step 3 : 43.986679792404175 step4:ventilate_hashtags_in_portfolio Wed Feb 5 13:43:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20255775 get user id for portfolio 20255775 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20255775 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','environnement','background','papier','carton','metal','pehd','flou','mal_croppe','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20255775 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','environnement','background','papier','carton','metal','pehd','flou','mal_croppe','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20255775 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','environnement','background','papier','carton','metal','pehd','flou','mal_croppe','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20257956,20257957,20257958,20257959,20257960,20257961,20257962,20257963,20257964,20257965,20257966?tags=pet_fonce,environnement,background,papier,carton,metal,pehd,flou,mal_croppe,autre,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1334894212, 1334894203, 1334894151, 1334894094, 1334894008, 1334893901, 1334893655, 1334893647, 1334893633] Looping around the photos to save general results len do output : 1 /20255775. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894212', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894203', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894151', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894094', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894008', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893901', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893655', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893647', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893633', None, None, None, None, None, '2551267') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014703035354614258 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6245696544647217 time spend to save output : 0.014993667602539062 total time spend for step 4 : 1.6395633220672607 step5:final Wed Feb 5 13:43:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1334894212: ('0.08379314825531547',), 1334894203: ('0.08379314825531547',), 1334894151: ('0.08379314825531547',), 1334894094: ('0.08379314825531547',), 1334894008: ('0.08379314825531547',), 1334893901: ('0.08379314825531547',), 1334893655: ('0.08379314825531547',), 1334893647: ('0.08379314825531547',), 1334893633: ('0.08379314825531547',)} new output for save of step final : {1334894212: ('0.08379314825531547',), 1334894203: ('0.08379314825531547',), 1334894151: ('0.08379314825531547',), 1334894094: ('0.08379314825531547',), 1334894008: ('0.08379314825531547',), 1334893901: ('0.08379314825531547',), 1334893655: ('0.08379314825531547',), 1334893647: ('0.08379314825531547',), 1334893633: ('0.08379314825531547',)} [1334894212, 1334894203, 1334894151, 1334894094, 1334894008, 1334893901, 1334893655, 1334893647, 1334893633] Looping around the photos to save general results len do output : 9 /1334894212.Didn't retrieve data . /1334894203.Didn't retrieve data . /1334894151.Didn't retrieve data . /1334894094.Didn't retrieve data . /1334894008.Didn't retrieve data . /1334893901.Didn't retrieve data . /1334893655.Didn't retrieve data . /1334893647.Didn't retrieve data . /1334893633.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894212', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894203', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894151', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894094', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894008', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893901', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893655', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893647', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893633', None, None, None, None, None, '2551267') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.012273073196411133 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10430550575256348 time spend to save output : 0.012818574905395508 total time spend for step 5 : 0.11712408065795898 step6:blur_detection Wed Feb 5 13:43:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f.jpg resize: (2160, 3840) 1334894212 -5.291752179879836 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa.jpg resize: (2160, 3840) 1334894203 -5.298154834643539 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a.jpg resize: (2160, 3840) 1334894151 -5.211239344351246 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b.jpg resize: (2160, 3840) 1334894094 -5.58689885087173 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389.jpg resize: (2160, 3840) 1334894008 -6.11245678989778 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb.jpg resize: (2160, 3840) 1334893901 -5.5537601688534775 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf.jpg resize: (2160, 3840) 1334893655 -5.884968022941137 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319.jpg resize: (2160, 3840) 1334893647 -5.260453913226004 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4.jpg resize: (2160, 3840) 1334893633 -4.9061850009352765 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996772_0.png resize: (572, 621) 1334933239 -2.9813503218255204 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996761_0.png resize: (377, 410) 1334933240 -1.7826163382681424 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996763_0.png resize: (264, 226) 1334933241 -1.5747331888995737 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996768_0.png resize: (232, 162) 1334933242 -2.7448352717537685 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996767_0.png resize: (154, 191) 1334933243 -0.7520442584735261 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996762_0.png resize: (148, 241) 1334933244 -0.42581633600845314 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996774_0.png resize: (204, 76) 1334933245 -2.9889521478829955 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996765_0.png resize: (173, 135) 1334933246 -2.562867754789031 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996773_0.png resize: (199, 151) 1334933247 -5.122551739389949 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996769_0.png resize: (262, 230) 1334933248 -4.088558215150257 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996789_0.png resize: (263, 193) 1334933249 -3.9852275397296517 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996775_0.png resize: (372, 392) 1334933250 -1.4601993797796744 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996780_0.png resize: (261, 225) 1334933251 -1.4388329795613544 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996783_0.png resize: (391, 461) 1334933252 -3.469406162639956 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996781_0.png resize: (235, 199) 1334933253 -1.527365143734323 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996788_0.png resize: (227, 208) 1334933254 -3.875738308869336 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996778_0.png resize: (157, 194) 1334933255 -0.9028796480894181 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996779_0.png resize: (206, 212) 1334933256 -2.9517830694034175 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996777_0.png resize: (149, 221) 1334933257 -0.34103549726655175 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996784_0.png resize: (179, 146) 1334933258 -3.376997964780838 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996787_0.png resize: (250, 186) 1334933259 -3.926309319252362 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996776_0.png resize: (161, 134) 1334933260 -2.5281132082969635 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996797_0.png resize: (645, 591) 1334933261 -3.1316733730062323 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996790_0.png resize: (470, 319) 1334933262 -2.213469138624963 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996792_0.png resize: (259, 278) 1334933263 -2.5662112722832218 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996794_0.png resize: (239, 225) 1334933264 -1.6936081711327882 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996799_0.png resize: (285, 242) 1334933265 -2.845527830507942 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996795_0.png resize: (162, 221) 1334933266 -0.2123418640872514 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996805_0.png resize: (446, 256) 1334933267 -3.4956318339147483 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996793_0.png resize: (237, 192) 1334933268 -2.2745551389568526 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996804_0.png resize: (99, 164) 1334933269 -3.62379086861694 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996798_0.png resize: (146, 199) 1334933270 -2.9846726011847036 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996806_0.png resize: (154, 107) 1334933271 -0.35509277615854334 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996802_0.png resize: (354, 288) 1334933272 -1.8892054517807184 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996796_0.png resize: (236, 205) 1334933273 -3.172752930782583 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996814_0.png resize: (173, 190) 1334933274 -3.1594263752499363 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996816_0.png resize: (787, 355) 1334933275 -2.969790245664828 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996813_0.png resize: (285, 393) 1334933276 -1.9416078111536228 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996817_0.png resize: (117, 115) 1334933277 -2.990336607299013 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996811_0.png resize: (330, 138) 1334933278 -3.23317183170382 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996815_0.png resize: (415, 473) 1334933279 -2.846407652629359 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996812_0.png resize: (103, 122) 1334933280 -2.2772115687651753 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996807_0.png resize: (531, 739) 1334933281 -3.568754826017021 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996808_0.png resize: (244, 295) 1334933282 -0.8660388974126648 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996810_0.png resize: (102, 127) 1334933283 -2.677880121439651 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996819_0.png resize: (501, 104) 1334933284 -3.2113030128980324 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996828_0.png resize: (599, 250) 1334933285 -3.577356970708211 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996835_0.png resize: (300, 70) 1334933286 -4.110661176287293 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996831_0.png resize: (209, 306) 1334933287 -2.9312701168412207 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996833_0.png resize: (293, 369) 1334933288 -3.7394060674661755 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996826_0.png resize: (156, 114) 1334933289 -3.1465709563262405 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996837_0.png resize: (729, 856) 1334933290 -3.821623433996461 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996827_0.png resize: (232, 150) 1334933291 -1.5495705113764005 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996821_0.png resize: (115, 147) 1334933292 -2.3932762725311862 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996818_0.png resize: (333, 274) 1334933293 -2.0784481884019352 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996829_0.png resize: (182, 228) 1334933294 -3.5780492927932563 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996822_0.png resize: (340, 392) 1334933295 -3.56294592370546 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996834_0.png resize: (216, 305) 1334933296 -2.7153811485055863 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996823_0.png resize: (196, 131) 1334933297 -2.980120970624161 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996820_0.png resize: (223, 201) 1334933298 -2.9389290107709654 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996825_0.png resize: (442, 274) 1334933299 -2.203747424014771 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996838_0.png resize: (220, 147) 1334933300 -3.7602112437025146 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996832_0.png resize: (449, 79) 1334933302 -2.9848677778948987 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996842_0.png resize: (280, 261) 1334933303 -3.016922464501241 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996848_0.png resize: (178, 193) 1334933304 -4.431700417977406 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996846_0.png resize: (192, 157) 1334933305 -3.7004958853724377 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996847_0.png resize: (68, 264) 1334933306 -3.5091196442529577 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996854_0.png resize: (110, 308) 1334933307 -4.018342419833337 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996844_0.png resize: (177, 317) 1334933308 -3.163873508086106 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996843_0.png resize: (347, 391) 1334933309 -3.475366723668391 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996853_0.png resize: (260, 201) 1334933310 -3.3731441778975486 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996839_0.png resize: (181, 146) 1334933311 -3.0195449814007596 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996841_0.png resize: (226, 520) 1334933312 -2.7611003107735477 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996851_0.png resize: (123, 145) 1334933313 -0.9851791744889181 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996852_0.png resize: (238, 294) 1334933314 -3.1349623633926784 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996845_0.png resize: (239, 171) 1334933315 -3.835044930210507 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996866_0.png resize: (354, 220) 1334933316 -0.9117919694966906 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996865_0.png resize: (305, 158) 1334933317 -2.7469650627719604 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996857_0.png resize: (456, 353) 1334933318 -3.8002553093469422 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996859_0.png resize: (251, 267) 1334933319 -2.553657660356074 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996861_0.png resize: (96, 117) 1334933320 -1.8717524824541365 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996860_0.png resize: (304, 265) 1334933321 -2.7228146203141526 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996862_0.png resize: (621, 463) 1334933322 -0.03994388683206644 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996869_0.png resize: (259, 483) 1334933323 -2.01015495067941 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996864_0.png resize: (173, 166) 1334933324 -1.203726425329618 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996868_0.png resize: (472, 370) 1334933325 -3.7825784385153813 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996863_0.png resize: (211, 227) 1334933326 -1.1492122393660562 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996870_0.png resize: (395, 357) 1334933327 -3.664148188432431 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996858_0.png resize: (240, 170) 1334933328 -3.4815663240568044 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996877_0.png resize: (117, 240) 1334933329 -3.7359342513257214 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996874_0.png resize: (134, 207) 1334933330 -3.8658414931487894 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996872_0.png resize: (181, 268) 1334933331 -3.8785694587044848 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996881_0.png resize: (398, 298) 1334933332 -3.428010403343909 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996878_0.png resize: (308, 318) 1334933333 -3.232783645784626 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996887_0.png resize: (153, 230) 1334933334 -3.2234346882224503 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996873_0.png resize: (318, 500) 1334933335 -3.14166219626762 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996882_0.png resize: (293, 394) 1334933336 -3.7155261859517896 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996871_0.png resize: (316, 294) 1334933337 -2.3538624112883824 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996885_0.png resize: (148, 180) 1334933338 -2.5123487593288507 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996876_0.png resize: (205, 239) 1334933339 -2.4009340263029024 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996883_0.png resize: (139, 165) 1334933340 -2.20365226130497 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996889_0.png resize: (172, 164) 1334933341 -3.4232680317284627 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996894_0.png resize: (178, 236) 1334933342 -3.9131545067280653 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996897_0.png resize: (132, 189) 1334933343 -4.320128238519142 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996890_0.png resize: (188, 188) 1334933344 -3.422482812987074 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996892_0.png resize: (188, 166) 1334933345 -3.2895869844140657 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996896_0.png resize: (174, 144) 1334933346 -2.00232593905568 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996902_0.png resize: (113, 134) 1334933347 -3.0107411754780515 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996888_0.png resize: (341, 462) 1334933348 -3.237256136886588 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996891_0.png resize: (187, 352) 1334933349 -3.528890075817563 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996899_0.png resize: (210, 327) 1334933350 -3.359987513288655 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996901_0.png resize: (97, 167) 1334933351 -3.5370820587458502 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996903_0.png resize: (301, 267) 1334933352 -3.9077465025597347 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996895_0.png resize: (267, 243) 1334933353 -3.3333531229362974 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996898_0.png resize: (130, 248) 1334933354 -4.456340455649992 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996893_0.png resize: (86, 111) 1334933355 -3.2499494145667693 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996764_0.png resize: (143, 146) 1334933371 -1.2307921601469354 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996766_0.png resize: (149, 119) 1334933372 -3.8325790192733162 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996771_0.png resize: (363, 253) 1334933373 -4.254054873542379 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996785_0.png resize: (523, 590) 1334933374 -2.757585765354716 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996786_0.png resize: (143, 153) 1334933375 -1.1725836500692108 treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996782_0.png resize: (327, 212) 1334933376 -4.256869541717652 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996800_0.png resize: (167, 249) 1334933377 -1.0573850292634994 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996791_0.png resize: (167, 162) 1334933378 -1.8315898808172528 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996801_0.png resize: (233, 211) 1334933379 -4.143825187712238 treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996809_0.png resize: (344, 394) 1334933380 -2.6921229479852054 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996836_0.png resize: (293, 231) 1334933382 -2.594983898212419 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996824_0.png resize: (199, 201) 1334933383 -2.545282521590733 treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996830_0.png resize: (240, 145) 1334933384 -3.718570847214302 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996855_0.png resize: (138, 136) 1334933385 -3.6846646928377824 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996849_0.png resize: (286, 347) 1334933386 -3.197699124975991 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996840_0.png resize: (185, 186) 1334933387 -2.978045487458118 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996867_0.png resize: (99, 56) 1334933388 -1.4659910962674914 treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996856_0.png resize: (288, 290) 1334933389 -3.1517757112193925 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996875_0.png resize: (275, 223) 1334933390 -3.8272315247718924 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996884_0.png resize: (137, 94) 1334933393 -2.248083858875453 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996880_0.png resize: (126, 140) 1334933395 -2.5659852382993127 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996886_0.png resize: (163, 91) 1334933396 -0.7341474763844789 treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996879_0.png resize: (343, 152) 1334933397 -3.1746313943806896 treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996850_0.png resize: (141, 149) 1334933398 -3.6849066864642586 treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996770_0.png resize: (231, 146) 1334933402 -3.4139722617452444 treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996803_0.png resize: (310, 435) 1334933403 -4.262972836739288 treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996900_0.png resize: (280, 187) 1334933404 -4.685241691265617 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 152 time used for this insertion : 0.01882147789001465 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 152 time used for this insertion : 0.031183719635009766 save missing photos in datou_result : time spend for datou_step_exec : 31.254305124282837 time spend to save output : 0.05542492866516113 total time spend for step 6 : 31.309730052947998 step7:brightness Wed Feb 5 13:44:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f.jpg treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa.jpg treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a.jpg treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b.jpg treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389.jpg treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb.jpg treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf.jpg treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319.jpg treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4.jpg treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996772_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996761_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996763_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996768_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996767_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996762_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996774_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996765_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996773_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996769_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996789_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996775_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996780_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996783_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996781_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996788_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996778_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996779_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996777_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996784_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996787_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996776_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996797_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996790_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996792_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996794_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996799_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996795_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996805_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996793_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996804_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996798_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996806_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996802_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996796_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996814_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996816_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996813_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996817_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996811_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996815_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996812_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996807_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996808_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996810_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996819_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996828_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996835_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996831_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996833_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996826_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996837_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996827_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996821_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996818_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996829_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996822_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996834_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996823_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996820_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996825_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996838_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996832_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996842_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996848_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996846_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996847_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996854_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996844_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996843_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996853_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996839_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996841_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996851_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996852_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996845_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996866_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996865_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996857_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996859_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996861_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996860_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996862_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996869_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996864_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996868_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996863_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996870_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996858_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996877_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996874_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996872_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996881_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996878_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996887_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996873_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996882_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996871_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996885_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996876_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996883_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996889_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996894_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996897_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996890_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996892_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996896_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996902_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996888_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996891_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996899_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996901_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996903_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996895_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996898_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996893_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996764_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996766_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996771_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996785_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996786_0.png treat image : temp/1738759229_3810365_1334894203_7ec0f0b46c3434d539cdfebbb9746bfa_rle_crop_3655996782_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996800_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996791_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996801_0.png treat image : temp/1738759229_3810365_1334894094_a0a74195612ef91db189043454f6f67b_rle_crop_3655996809_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996836_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996824_0.png treat image : temp/1738759229_3810365_1334894008_1b12085484eaea0037259535be290389_rle_crop_3655996830_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996855_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996849_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996840_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996867_0.png treat image : temp/1738759229_3810365_1334893655_ccea668ea96f2c27000c29982a1e47bf_rle_crop_3655996856_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996875_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996884_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996880_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996886_0.png treat image : temp/1738759229_3810365_1334893647_fcc7d50233cf93f4b249867355704319_rle_crop_3655996879_0.png treat image : temp/1738759229_3810365_1334893901_67051968dc43bc92c5a06145f21bd9eb_rle_crop_3655996850_0.png treat image : temp/1738759229_3810365_1334894212_6a62b92796c619cb0fec808d4cf2d21f_rle_crop_3655996770_0.png treat image : temp/1738759229_3810365_1334894151_6cb0819d75c9ecb5891da9390352f98a_rle_crop_3655996803_0.png treat image : temp/1738759229_3810365_1334893633_ceb406a1ed365262a679f005cafecda4_rle_crop_3655996900_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 152 time used for this insertion : 0.02306652069091797 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 152 time used for this insertion : 0.029500722885131836 save missing photos in datou_result : time spend for datou_step_exec : 9.644706726074219 time spend to save output : 0.057762861251831055 total time spend for step 7 : 9.70246958732605 step8:velours_tree Wed Feb 5 13:44:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.0804297924041748 time spend to save output : 3.8623809814453125e-05 total time spend for step 8 : 0.08046841621398926 step9:send_mail_cod Wed Feb 5 13:44:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20255775_05-02-2025_13_44_16.pdf 20257956 imagette202579561738759456 20257958 imagette202579581738759456 20257959 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202579591738759456 20257960 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202579601738759457 20257961 change filename to text .imagette202579611738759459 20257962 imagette202579621738759459 20257963 imagette202579631738759459 20257964 imagette202579641738759459 20257965 imagette202579651738759459 20257966 change filename to text .change filename to text .change filename to text .imagette202579661738759459 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20255775 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20257956,20257957,20257958,20257959,20257960,20257961,20257962,20257963,20257964,20257965,20257966?tags=pet_fonce,environnement,background,papier,carton,metal,pehd,flou,mal_croppe,autre,pet_clair args[1334894212] : ((1334894212, -5.291752179879836, 492609224), (1334894212, -0.17927434082261456, 496442774), '0.08379314825531547') We are sending mail with results at report@fotonower.com args[1334894203] : ((1334894203, -5.298154834643539, 492609224), (1334894203, -0.1878368346354827, 496442774), '0.08379314825531547') We are sending mail with results at report@fotonower.com args[1334894151] : ((1334894151, -5.211239344351246, 492609224), (1334894151, -0.14092466940437717, 496442774), '0.08379314825531547') We are sending mail with results at report@fotonower.com args[1334894094] : ((1334894094, -5.58689885087173, 492609224), (1334894094, 0.5726114940670698, 2107752395), '0.08379314825531547') We are sending mail with results at report@fotonower.com args[1334894008] : ((1334894008, -6.11245678989778, 492609224), (1334894008, 0.72936255571285, 2107752395), '0.08379314825531547') We are sending mail with results at report@fotonower.com args[1334893901] : ((1334893901, -5.5537601688534775, 492609224), (1334893901, -0.164635010970338, 496442774), '0.08379314825531547') We are sending mail with results at report@fotonower.com args[1334893655] : ((1334893655, -5.884968022941137, 492609224), (1334893655, 0.5361808101305585, 2107752395), '0.08379314825531547') We are sending mail with results at report@fotonower.com args[1334893647] : ((1334893647, -5.260453913226004, 492609224), (1334893647, 0.027604533923469433, 2107752395), '0.08379314825531547') We are sending mail with results at report@fotonower.com args[1334893633] : ((1334893633, -4.9061850009352765, 492609224), (1334893633, -0.7105291555013067, 501862349), '0.08379314825531547') We are sending mail with results at report@fotonower.com refus_total : 0.08379314825531547 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20255775 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255775_05-02-2025_13_44_16.pdf results_Auto_P20255775_05-02-2025_13_44_16.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255775_05-02-2025_13_44_16.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20255775','results_Auto_P20255775_05-02-2025_13_44_16.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255775_05-02-2025_13_44_16.pdf','pdf','','0.52','0.08379314825531547') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20255775

https://www.fotonower.com/image?json=false&list_photos_id=1334894212
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334894203
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334894151
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334894094
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334894008
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334893901
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334893655
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334893647
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334893633
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.38%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/20257959?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20257960?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20257961?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20257966?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255775_05-02-2025_13_44_16.pdf.

Lien vers velours :https://www.fotonower.com/velours/20257956,20257957,20257958,20257959,20257960,20257961,20257962,20257963,20257964,20257965,20257966?tags=pet_fonce,environnement,background,papier,carton,metal,pehd,flou,mal_croppe,autre,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 05 Feb 2025 12:44:21 GMT Content-Length: 0 Connection: close X-Message-Id: HJrTCjivSxWqcaZfFYyNnA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1334894212, 1334894203, 1334894151, 1334894094, 1334894008, 1334893901, 1334893655, 1334893647, 1334893633] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894212', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894203', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894151', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894094', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894008', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893901', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893655', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893647', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893633', None, None, None, None, None, '2551267') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01349782943725586 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.2681519985198975 time spend to save output : 0.013701677322387695 total time spend for step 9 : 5.281853675842285 step10:split_time_score Wed Feb 5 13:44:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05022025 20255775 Nombre de photos uploadées : 9 / 23040 (0%) 05022025 20255775 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 05022025 20255775 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004734992980957031 elapsed_time : insert_dashboard_record_day_entry 0.023300647735595703 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.014657525968493172 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20254250_05-02-2025_13_35_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20254250 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20254250 AND mptpi.`type`=3726 To do Qualite : 0.10689558952760635 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20247543_05-02-2025_08_51_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20247543 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20247543 AND mptpi.`type`=3594 To do Qualite : 0.04574998454115179 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20253024_05-02-2025_13_42_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20253024 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20253024 AND mptpi.`type`=3726 To do Qualite : 0.08379314825531547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255775_05-02-2025_13_44_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20255775 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20255775 AND mptpi.`type`=3594 To do Qualite : 0.01122176723197168 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255776_05-02-2025_12_54_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20255776 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20255776 AND mptpi.`type`=3726 To do Qualite : 0.028732499017821062 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255777_05-02-2025_12_50_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20255777 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20255777 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05022025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1334894212, 1334894203, 1334894151, 1334894094, 1334894008, 1334893901, 1334893655, 1334893647, 1334893633] Looping around the photos to save general results len do output : 1 /20255775Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894212', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894203', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894151', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894094', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334894008', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893901', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893655', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893647', None, None, None, None, None, '2551267') ('3318', None, None, None, None, None, None, None, '2551267') ('3318', '20255775', '1334893633', None, None, None, None, None, '2551267') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01398324966430664 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.528364896774292 time spend to save output : 0.014185905456542969 total time spend for step 10 : 0.542550802230835 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 132.02user 61.59system 3:56.90elapsed 81%CPU (0avgtext+0avgdata 5367480maxresident)k 3576inputs+104008outputs (4major+10477495minor)pagefaults 0swaps