python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1813751 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2597817'] with mtr_portfolio_ids : ['20656278'] and first list_photo_ids : [] new path : /proc/1813751/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.313216209411621 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Feb 19 00:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4497 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-19 00:40:34.110832: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-19 00:40:34.135115: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-19 00:40:34.136789: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fcb74000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-19 00:40:34.136842: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-19 00:40:34.139951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-19 00:40:34.400918: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xfd7e5a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-19 00:40:34.400966: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-19 00:40:34.401755: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-19 00:40:34.402080: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-19 00:40:34.404246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-19 00:40:34.406558: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-19 00:40:34.406938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-19 00:40:34.409188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-19 00:40:34.410233: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-19 00:40:34.414894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-19 00:40:34.416106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-19 00:40:34.416187: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-19 00:40:34.416805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-19 00:40:34.416821: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-19 00:40:34.416829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-19 00:40:34.417787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4045 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-19 00:40:34.741441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-19 00:40:34.741552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-19 00:40:34.741568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-19 00:40:34.741582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-19 00:40:34.741596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-19 00:40:34.741610: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-19 00:40:34.741623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-19 00:40:34.741637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-19 00:40:34.742487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-19 00:40:34.743509: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-19 00:40:34.743542: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-19 00:40:34.743557: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-19 00:40:34.743571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-19 00:40:34.743584: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-19 00:40:34.743598: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-19 00:40:34.743612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-19 00:40:34.743626: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-19 00:40:34.744510: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-19 00:40:34.744542: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-19 00:40:34.744551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-19 00:40:34.744558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-19 00:40:34.745438: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4045 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-19 00:40:45.080748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-19 00:40:45.255746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-19 00:40:46.511889: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.346017: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-19 00:40:47.420896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.420974: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.421857: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.421876: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.428227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.428250: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.428930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.428946: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.453205: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.453263: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.453295: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-19 00:40:47.454446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.454473: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.455656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.455687: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.462678: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.462704: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.463587: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.463616: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.464459: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.464479: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-19 00:40:47.465134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.473013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.473696: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.489803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.490698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.491612: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.492807: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.497321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.498065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.498748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.499457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.500669: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.510866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.511605: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.521008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.521726: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.522583: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.523278: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.523977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-19 00:40:47.524668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3706585088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 1814183 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3304 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4497 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0015344619750976562 nb_pixel_total : 43922 time to create 1 rle with old method : 0.05895090103149414 length of segment : 280 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 8820 time to create 1 rle with old method : 0.012781620025634766 length of segment : 118 time for calcul the mask position with numpy : 0.0013730525970458984 nb_pixel_total : 62832 time to create 1 rle with old method : 0.08426260948181152 length of segment : 351 time for calcul the mask position with numpy : 0.002416372299194336 nb_pixel_total : 68894 time to create 1 rle with old method : 0.09118270874023438 length of segment : 819 time for calcul the mask position with numpy : 0.0008015632629394531 nb_pixel_total : 38137 time to create 1 rle with old method : 0.05021238327026367 length of segment : 235 time for calcul the mask position with numpy : 0.06639957427978516 nb_pixel_total : 514741 time to create 1 rle with new method : 0.03386521339416504 length of segment : 600 time for calcul the mask position with numpy : 0.0010640621185302734 nb_pixel_total : 53170 time to create 1 rle with old method : 0.06102180480957031 length of segment : 194 time for calcul the mask position with numpy : 0.0005514621734619141 nb_pixel_total : 18582 time to create 1 rle with old method : 0.019103050231933594 length of segment : 211 time for calcul the mask position with numpy : 0.00021028518676757812 nb_pixel_total : 5398 time to create 1 rle with old method : 0.006061553955078125 length of segment : 100 time for calcul the mask position with numpy : 0.0008244514465332031 nb_pixel_total : 37749 time to create 1 rle with old method : 0.0389404296875 length of segment : 367 time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 65861 time to create 1 rle with old method : 0.07416415214538574 length of segment : 293 time for calcul the mask position with numpy : 0.0010790824890136719 nb_pixel_total : 60397 time to create 1 rle with old method : 0.06597256660461426 length of segment : 222 time for calcul the mask position with numpy : 0.0010554790496826172 nb_pixel_total : 33314 time to create 1 rle with old method : 0.03495144844055176 length of segment : 472 time for calcul the mask position with numpy : 0.0005407333374023438 nb_pixel_total : 27663 time to create 1 rle with old method : 0.030056238174438477 length of segment : 173 time for calcul the mask position with numpy : 0.004367351531982422 nb_pixel_total : 172149 time to create 1 rle with new method : 0.014255523681640625 length of segment : 249 time for calcul the mask position with numpy : 0.0006570816040039062 nb_pixel_total : 20645 time to create 1 rle with old method : 0.02126312255859375 length of segment : 199 time for calcul the mask position with numpy : 0.0008273124694824219 nb_pixel_total : 35515 time to create 1 rle with old method : 0.04099249839782715 length of segment : 365 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 12209 time to create 1 rle with old method : 0.0140838623046875 length of segment : 75 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 22905 time to create 1 rle with old method : 0.025743961334228516 length of segment : 145 time for calcul the mask position with numpy : 0.00035643577575683594 nb_pixel_total : 9213 time to create 1 rle with old method : 0.010438680648803711 length of segment : 221 time for calcul the mask position with numpy : 0.0024042129516601562 nb_pixel_total : 90390 time to create 1 rle with old method : 0.10091280937194824 length of segment : 415 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 29172 time to create 1 rle with old method : 0.03301429748535156 length of segment : 238 time for calcul the mask position with numpy : 0.009439706802368164 nb_pixel_total : 286745 time to create 1 rle with new method : 0.0548253059387207 length of segment : 1312 time for calcul the mask position with numpy : 0.0010669231414794922 nb_pixel_total : 39217 time to create 1 rle with old method : 0.04334115982055664 length of segment : 483 time for calcul the mask position with numpy : 0.001079559326171875 nb_pixel_total : 33189 time to create 1 rle with old method : 0.035790205001831055 length of segment : 295 time for calcul the mask position with numpy : 0.00028395652770996094 nb_pixel_total : 7023 time to create 1 rle with old method : 0.008343696594238281 length of segment : 118 time for calcul the mask position with numpy : 0.0004763603210449219 nb_pixel_total : 19236 time to create 1 rle with old method : 0.022129058837890625 length of segment : 170 time for calcul the mask position with numpy : 0.0006046295166015625 nb_pixel_total : 19879 time to create 1 rle with old method : 0.021126985549926758 length of segment : 261 time for calcul the mask position with numpy : 0.00023317337036132812 nb_pixel_total : 11175 time to create 1 rle with old method : 0.011974573135375977 length of segment : 127 time for calcul the mask position with numpy : 0.009220361709594727 nb_pixel_total : 426284 time to create 1 rle with new method : 0.025959014892578125 length of segment : 720 time for calcul the mask position with numpy : 0.00029540061950683594 nb_pixel_total : 9866 time to create 1 rle with old method : 0.011810064315795898 length of segment : 120 time for calcul the mask position with numpy : 0.0010120868682861328 nb_pixel_total : 53097 time to create 1 rle with old method : 0.061275482177734375 length of segment : 329 time for calcul the mask position with numpy : 0.00039649009704589844 nb_pixel_total : 16536 time to create 1 rle with old method : 0.019257307052612305 length of segment : 133 time for calcul the mask position with numpy : 0.0009720325469970703 nb_pixel_total : 38525 time to create 1 rle with old method : 0.04066205024719238 length of segment : 320 time for calcul the mask position with numpy : 0.00017380714416503906 nb_pixel_total : 5441 time to create 1 rle with old method : 0.006624460220336914 length of segment : 99 time for calcul the mask position with numpy : 0.0002543926239013672 nb_pixel_total : 11742 time to create 1 rle with old method : 0.01434636116027832 length of segment : 81 time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 18109 time to create 1 rle with old method : 0.018938541412353516 length of segment : 191 time for calcul the mask position with numpy : 0.001538991928100586 nb_pixel_total : 32658 time to create 1 rle with old method : 0.03502178192138672 length of segment : 282 time for calcul the mask position with numpy : 0.0008432865142822266 nb_pixel_total : 21402 time to create 1 rle with old method : 0.023041248321533203 length of segment : 163 time for calcul the mask position with numpy : 0.0018014907836914062 nb_pixel_total : 60719 time to create 1 rle with old method : 0.06588363647460938 length of segment : 570 time for calcul the mask position with numpy : 0.0003139972686767578 nb_pixel_total : 14874 time to create 1 rle with old method : 0.01600790023803711 length of segment : 126 time for calcul the mask position with numpy : 0.0007662773132324219 nb_pixel_total : 31410 time to create 1 rle with old method : 0.03421831130981445 length of segment : 208 time for calcul the mask position with numpy : 0.00047850608825683594 nb_pixel_total : 24144 time to create 1 rle with old method : 0.02718639373779297 length of segment : 223 time for calcul the mask position with numpy : 0.0006425380706787109 nb_pixel_total : 29533 time to create 1 rle with old method : 0.03278088569641113 length of segment : 251 time for calcul the mask position with numpy : 0.0018906593322753906 nb_pixel_total : 106556 time to create 1 rle with old method : 0.11051082611083984 length of segment : 347 time for calcul the mask position with numpy : 0.0005426406860351562 nb_pixel_total : 31657 time to create 1 rle with old method : 0.033846139907836914 length of segment : 268 time for calcul the mask position with numpy : 0.000583648681640625 nb_pixel_total : 11797 time to create 1 rle with old method : 0.012790441513061523 length of segment : 129 time for calcul the mask position with numpy : 0.0022242069244384766 nb_pixel_total : 102384 time to create 1 rle with old method : 0.11476349830627441 length of segment : 418 time for calcul the mask position with numpy : 0.005089521408081055 nb_pixel_total : 111467 time to create 1 rle with old method : 0.1163930892944336 length of segment : 476 time for calcul the mask position with numpy : 0.0007417201995849609 nb_pixel_total : 18633 time to create 1 rle with old method : 0.021325349807739258 length of segment : 105 time for calcul the mask position with numpy : 0.0006172657012939453 nb_pixel_total : 17882 time to create 1 rle with old method : 0.01931929588317871 length of segment : 109 time for calcul the mask position with numpy : 0.0003883838653564453 nb_pixel_total : 6163 time to create 1 rle with old method : 0.008820772171020508 length of segment : 101 time for calcul the mask position with numpy : 0.0007550716400146484 nb_pixel_total : 15852 time to create 1 rle with old method : 0.026253223419189453 length of segment : 99 time for calcul the mask position with numpy : 0.0008504390716552734 nb_pixel_total : 17309 time to create 1 rle with old method : 0.018494606018066406 length of segment : 171 time for calcul the mask position with numpy : 0.0003705024719238281 nb_pixel_total : 4725 time to create 1 rle with old method : 0.006001949310302734 length of segment : 190 time for calcul the mask position with numpy : 0.0004761219024658203 nb_pixel_total : 24180 time to create 1 rle with old method : 0.028625965118408203 length of segment : 240 time for calcul the mask position with numpy : 0.00174713134765625 nb_pixel_total : 115702 time to create 1 rle with old method : 0.12659859657287598 length of segment : 358 time for calcul the mask position with numpy : 0.0007293224334716797 nb_pixel_total : 30214 time to create 1 rle with old method : 0.03372526168823242 length of segment : 357 time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 4660 time to create 1 rle with old method : 0.005911588668823242 length of segment : 74 time for calcul the mask position with numpy : 0.0004444122314453125 nb_pixel_total : 20675 time to create 1 rle with old method : 0.023653268814086914 length of segment : 208 time for calcul the mask position with numpy : 0.0003833770751953125 nb_pixel_total : 23707 time to create 1 rle with old method : 0.02611088752746582 length of segment : 226 time for calcul the mask position with numpy : 0.0006852149963378906 nb_pixel_total : 46704 time to create 1 rle with old method : 0.055269718170166016 length of segment : 296 time for calcul the mask position with numpy : 0.000579833984375 nb_pixel_total : 30448 time to create 1 rle with old method : 0.03372645378112793 length of segment : 225 time for calcul the mask position with numpy : 0.0007343292236328125 nb_pixel_total : 44741 time to create 1 rle with old method : 0.05264115333557129 length of segment : 248 time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 12604 time to create 1 rle with old method : 0.014046907424926758 length of segment : 140 time for calcul the mask position with numpy : 0.0011563301086425781 nb_pixel_total : 75966 time to create 1 rle with old method : 0.08117938041687012 length of segment : 331 time for calcul the mask position with numpy : 0.0007576942443847656 nb_pixel_total : 47205 time to create 1 rle with old method : 0.05458950996398926 length of segment : 309 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 19247 time to create 1 rle with old method : 0.021328210830688477 length of segment : 115 time for calcul the mask position with numpy : 0.0006127357482910156 nb_pixel_total : 33601 time to create 1 rle with old method : 0.03696608543395996 length of segment : 249 time for calcul the mask position with numpy : 0.0002465248107910156 nb_pixel_total : 15372 time to create 1 rle with old method : 0.016180753707885742 length of segment : 147 time for calcul the mask position with numpy : 0.00021147727966308594 nb_pixel_total : 11805 time to create 1 rle with old method : 0.012504100799560547 length of segment : 157 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 31512 time to create 1 rle with old method : 0.032900094985961914 length of segment : 231 time for calcul the mask position with numpy : 0.0002269744873046875 nb_pixel_total : 11082 time to create 1 rle with old method : 0.012157678604125977 length of segment : 145 time for calcul the mask position with numpy : 0.004788398742675781 nb_pixel_total : 343598 time to create 1 rle with new method : 0.026430130004882812 length of segment : 381 time for calcul the mask position with numpy : 0.001926422119140625 nb_pixel_total : 102789 time to create 1 rle with old method : 0.12468361854553223 length of segment : 264 time for calcul the mask position with numpy : 0.003459930419921875 nb_pixel_total : 133326 time to create 1 rle with old method : 0.15350627899169922 length of segment : 424 time for calcul the mask position with numpy : 0.0005123615264892578 nb_pixel_total : 9772 time to create 1 rle with old method : 0.012835979461669922 length of segment : 83 time for calcul the mask position with numpy : 0.002581357955932617 nb_pixel_total : 131765 time to create 1 rle with old method : 0.15284252166748047 length of segment : 441 time for calcul the mask position with numpy : 0.0009145736694335938 nb_pixel_total : 17936 time to create 1 rle with old method : 0.019086599349975586 length of segment : 182 time for calcul the mask position with numpy : 0.0009889602661132812 nb_pixel_total : 22503 time to create 1 rle with old method : 0.028366565704345703 length of segment : 240 time for calcul the mask position with numpy : 0.0015587806701660156 nb_pixel_total : 48153 time to create 1 rle with old method : 0.04835391044616699 length of segment : 338 time for calcul the mask position with numpy : 0.0010068416595458984 nb_pixel_total : 27738 time to create 1 rle with old method : 0.029169797897338867 length of segment : 197 time for calcul the mask position with numpy : 0.007955551147460938 nb_pixel_total : 264834 time to create 1 rle with new method : 0.018837690353393555 length of segment : 817 time for calcul the mask position with numpy : 0.002051115036010742 nb_pixel_total : 69112 time to create 1 rle with old method : 0.07128047943115234 length of segment : 212 time for calcul the mask position with numpy : 0.002888202667236328 nb_pixel_total : 98399 time to create 1 rle with old method : 0.10534453392028809 length of segment : 413 time for calcul the mask position with numpy : 0.0016703605651855469 nb_pixel_total : 67966 time to create 1 rle with old method : 0.08031725883483887 length of segment : 395 time for calcul the mask position with numpy : 0.00589442253112793 nb_pixel_total : 206930 time to create 1 rle with new method : 0.01105499267578125 length of segment : 671 time for calcul the mask position with numpy : 0.0006773471832275391 nb_pixel_total : 15882 time to create 1 rle with old method : 0.018000125885009766 length of segment : 165 time for calcul the mask position with numpy : 0.0015001296997070312 nb_pixel_total : 55215 time to create 1 rle with old method : 0.06152009963989258 length of segment : 344 time for calcul the mask position with numpy : 0.000911712646484375 nb_pixel_total : 30693 time to create 1 rle with old method : 0.03552722930908203 length of segment : 164 time for calcul the mask position with numpy : 0.004784107208251953 nb_pixel_total : 129739 time to create 1 rle with old method : 0.14075946807861328 length of segment : 806 time for calcul the mask position with numpy : 0.0009076595306396484 nb_pixel_total : 20148 time to create 1 rle with old method : 0.022472143173217773 length of segment : 165 time for calcul the mask position with numpy : 0.0010156631469726562 nb_pixel_total : 19808 time to create 1 rle with old method : 0.02386951446533203 length of segment : 237 time for calcul the mask position with numpy : 0.0010590553283691406 nb_pixel_total : 20455 time to create 1 rle with old method : 0.02322983741760254 length of segment : 218 time for calcul the mask position with numpy : 0.0012998580932617188 nb_pixel_total : 34253 time to create 1 rle with old method : 0.03912758827209473 length of segment : 237 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 18938 time to create 1 rle with old method : 0.02098846435546875 length of segment : 207 time for calcul the mask position with numpy : 0.0014278888702392578 nb_pixel_total : 30889 time to create 1 rle with old method : 0.034490346908569336 length of segment : 275 time for calcul the mask position with numpy : 0.003253459930419922 nb_pixel_total : 71442 time to create 1 rle with old method : 0.0782172679901123 length of segment : 516 time for calcul the mask position with numpy : 0.0013780593872070312 nb_pixel_total : 19375 time to create 1 rle with old method : 0.02311539649963379 length of segment : 262 time for calcul the mask position with numpy : 0.0020189285278320312 nb_pixel_total : 63564 time to create 1 rle with old method : 0.07426834106445312 length of segment : 440 time for calcul the mask position with numpy : 0.0004291534423828125 nb_pixel_total : 6874 time to create 1 rle with old method : 0.008603811264038086 length of segment : 95 time for calcul the mask position with numpy : 0.0039670467376708984 nb_pixel_total : 98808 time to create 1 rle with old method : 0.11379289627075195 length of segment : 365 time for calcul the mask position with numpy : 0.0009558200836181641 nb_pixel_total : 18661 time to create 1 rle with old method : 0.021805763244628906 length of segment : 183 time for calcul the mask position with numpy : 0.0006597042083740234 nb_pixel_total : 15008 time to create 1 rle with old method : 0.016814470291137695 length of segment : 196 time for calcul the mask position with numpy : 0.0016200542449951172 nb_pixel_total : 46543 time to create 1 rle with old method : 0.05148482322692871 length of segment : 268 time for calcul the mask position with numpy : 0.0006768703460693359 nb_pixel_total : 15829 time to create 1 rle with old method : 0.017439842224121094 length of segment : 144 time for calcul the mask position with numpy : 0.0003883838653564453 nb_pixel_total : 16149 time to create 1 rle with old method : 0.017889738082885742 length of segment : 147 time for calcul the mask position with numpy : 0.00031304359436035156 nb_pixel_total : 6407 time to create 1 rle with old method : 0.006841182708740234 length of segment : 96 time for calcul the mask position with numpy : 0.0005645751953125 nb_pixel_total : 7524 time to create 1 rle with old method : 0.008671045303344727 length of segment : 104 time for calcul the mask position with numpy : 0.004507303237915039 nb_pixel_total : 76086 time to create 1 rle with old method : 0.0829005241394043 length of segment : 301 time for calcul the mask position with numpy : 0.006247758865356445 nb_pixel_total : 144860 time to create 1 rle with old method : 0.15289855003356934 length of segment : 609 time for calcul the mask position with numpy : 0.0004360675811767578 nb_pixel_total : 11559 time to create 1 rle with old method : 0.012038946151733398 length of segment : 131 time for calcul the mask position with numpy : 0.0021140575408935547 nb_pixel_total : 42902 time to create 1 rle with old method : 0.046489715576171875 length of segment : 296 time for calcul the mask position with numpy : 0.00032806396484375 nb_pixel_total : 6922 time to create 1 rle with old method : 0.007975578308105469 length of segment : 110 time for calcul the mask position with numpy : 0.00043773651123046875 nb_pixel_total : 9256 time to create 1 rle with old method : 0.009795188903808594 length of segment : 110 time for calcul the mask position with numpy : 0.0015223026275634766 nb_pixel_total : 36319 time to create 1 rle with old method : 0.03748798370361328 length of segment : 317 time for calcul the mask position with numpy : 0.0002932548522949219 nb_pixel_total : 7412 time to create 1 rle with old method : 0.008025884628295898 length of segment : 96 time for calcul the mask position with numpy : 0.0003750324249267578 nb_pixel_total : 5719 time to create 1 rle with old method : 0.006521701812744141 length of segment : 89 time for calcul the mask position with numpy : 0.002979755401611328 nb_pixel_total : 44789 time to create 1 rle with old method : 0.05406498908996582 length of segment : 352 time for calcul the mask position with numpy : 0.002098560333251953 nb_pixel_total : 53107 time to create 1 rle with old method : 0.056580543518066406 length of segment : 398 time for calcul the mask position with numpy : 0.0011701583862304688 nb_pixel_total : 31626 time to create 1 rle with old method : 0.0354158878326416 length of segment : 327 time for calcul the mask position with numpy : 0.010817766189575195 nb_pixel_total : 153863 time to create 1 rle with new method : 0.035729169845581055 length of segment : 819 time for calcul the mask position with numpy : 0.0005054473876953125 nb_pixel_total : 17180 time to create 1 rle with old method : 0.018862485885620117 length of segment : 204 time for calcul the mask position with numpy : 0.0010981559753417969 nb_pixel_total : 33278 time to create 1 rle with old method : 0.03735661506652832 length of segment : 416 time for calcul the mask position with numpy : 0.0004189014434814453 nb_pixel_total : 12036 time to create 1 rle with old method : 0.013630151748657227 length of segment : 135 time for calcul the mask position with numpy : 0.0005910396575927734 nb_pixel_total : 21239 time to create 1 rle with old method : 0.02405714988708496 length of segment : 173 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 6675 time to create 1 rle with old method : 0.007957696914672852 length of segment : 86 time for calcul the mask position with numpy : 0.0011298656463623047 nb_pixel_total : 21597 time to create 1 rle with old method : 0.024693727493286133 length of segment : 210 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 10289 time to create 1 rle with old method : 0.01161050796508789 length of segment : 166 time for calcul the mask position with numpy : 0.0008985996246337891 nb_pixel_total : 32050 time to create 1 rle with old method : 0.034264564514160156 length of segment : 283 time for calcul the mask position with numpy : 0.00037789344787597656 nb_pixel_total : 11929 time to create 1 rle with old method : 0.01393890380859375 length of segment : 132 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 18331 time to create 1 rle with old method : 0.02139568328857422 length of segment : 288 time for calcul the mask position with numpy : 0.0001850128173828125 nb_pixel_total : 5339 time to create 1 rle with old method : 0.0060367584228515625 length of segment : 81 time for calcul the mask position with numpy : 0.00012230873107910156 nb_pixel_total : 4129 time to create 1 rle with old method : 0.004487276077270508 length of segment : 106 time for calcul the mask position with numpy : 0.0012674331665039062 nb_pixel_total : 41322 time to create 1 rle with old method : 0.043118953704833984 length of segment : 246 time for calcul the mask position with numpy : 0.00209808349609375 nb_pixel_total : 82797 time to create 1 rle with old method : 0.09015107154846191 length of segment : 263 time for calcul the mask position with numpy : 0.0014710426330566406 nb_pixel_total : 41285 time to create 1 rle with old method : 0.04508399963378906 length of segment : 252 time for calcul the mask position with numpy : 0.0020253658294677734 nb_pixel_total : 91350 time to create 1 rle with old method : 0.09483838081359863 length of segment : 240 time for calcul the mask position with numpy : 0.0012543201446533203 nb_pixel_total : 30562 time to create 1 rle with old method : 0.03617978096008301 length of segment : 289 time for calcul the mask position with numpy : 0.0015206336975097656 nb_pixel_total : 54877 time to create 1 rle with old method : 0.06110692024230957 length of segment : 287 time for calcul the mask position with numpy : 0.00142669677734375 nb_pixel_total : 50703 time to create 1 rle with old method : 0.05550575256347656 length of segment : 536 time for calcul the mask position with numpy : 0.002048969268798828 nb_pixel_total : 38310 time to create 1 rle with old method : 0.040117502212524414 length of segment : 299 time for calcul the mask position with numpy : 0.002015352249145508 nb_pixel_total : 60362 time to create 1 rle with old method : 0.0618891716003418 length of segment : 256 time for calcul the mask position with numpy : 0.003756284713745117 nb_pixel_total : 123368 time to create 1 rle with old method : 0.15385770797729492 length of segment : 674 time for calcul the mask position with numpy : 0.0003745555877685547 nb_pixel_total : 12672 time to create 1 rle with old method : 0.01401066780090332 length of segment : 139 time for calcul the mask position with numpy : 0.010979652404785156 nb_pixel_total : 261018 time to create 1 rle with new method : 0.037691354751586914 length of segment : 1741 time for calcul the mask position with numpy : 0.02638697624206543 nb_pixel_total : 654084 time to create 1 rle with new method : 0.267040491104126 length of segment : 1081 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 8585 time to create 1 rle with old method : 0.009939908981323242 length of segment : 65 time for calcul the mask position with numpy : 0.00040149688720703125 nb_pixel_total : 12326 time to create 1 rle with old method : 0.013640880584716797 length of segment : 273 time for calcul the mask position with numpy : 0.0018188953399658203 nb_pixel_total : 86979 time to create 1 rle with old method : 0.09243011474609375 length of segment : 537 time for calcul the mask position with numpy : 0.0019295215606689453 nb_pixel_total : 83071 time to create 1 rle with old method : 0.09475302696228027 length of segment : 565 time for calcul the mask position with numpy : 0.005780220031738281 nb_pixel_total : 273288 time to create 1 rle with new method : 0.01950836181640625 length of segment : 1262 time for calcul the mask position with numpy : 0.005212545394897461 nb_pixel_total : 290643 time to create 1 rle with new method : 0.02302718162536621 length of segment : 1461 time for calcul the mask position with numpy : 0.0004138946533203125 nb_pixel_total : 7019 time to create 1 rle with old method : 0.008000850677490234 length of segment : 159 time spent for convertir_results : 14.083227634429932 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 154 chid ids of type : 3594 Number RLEs to save : 46945 save missing photos in datou_result : time spend for datou_step_exec : 75.14386630058289 time spend to save output : 5.209583520889282 total time spend for step 1 : 80.35344982147217 step2:crop_condition Wed Feb 19 00:41:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 154 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 85 About to insert : list_path_to_insert length 85 new photo from crops ! About to upload 85 photos upload in portfolio : 3736932 init cache_photo without model_param we have 85 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739922131_1813751 we have uploaded 85 photos in the portfolio 3736932 time of upload the photos Elapsed time : 22.239802837371826 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 3736932 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739922168_1813751 we have uploaded 43 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.325644969940186 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739922182_1813751 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.861609697341919 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739922194_1813751 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.699389696121216 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739922202_1813751 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8477208614349365 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739922206_1813751 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6623249053955078 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1338302703, 1338302675, 1338302672, 1338302668, 1338302663, 1338302650, 1338302648, 1338302631, 1338302627, 1338302622, 1338302620] Looping around the photos to save general results len do output : 154 /1338421523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338421897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302703', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302675', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302672', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302668', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302663', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302650', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302648', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302631', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302627', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302622', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302620', None, None, None, None, None, '2597817') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 473 time used for this insertion : 0.41109347343444824 save_final save missing photos in datou_result : time spend for datou_step_exec : 95.91789531707764 time spend to save output : 0.41823387145996094 total time spend for step 2 : 96.3361291885376 step3:rle_unique_nms_with_priority Wed Feb 19 00:43:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 154 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 3.493248462677002 time for calcul the mask position with numpy : 1.1471705436706543 nb_pixel_total : 6997498 time to create 1 rle with new method : 2.0108466148376465 time for calcul the mask position with numpy : 0.020188331604003906 nb_pixel_total : 8820 time to create 1 rle with old method : 0.009141683578491211 time for calcul the mask position with numpy : 0.01952362060546875 nb_pixel_total : 43922 time to create 1 rle with old method : 0.043823957443237305 create new chi : 3.2833316326141357 time to delete rle : 0.013808727264404297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2956 TO DO : save crop sub photo not yet done ! save time : 0.6781413555145264 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 4.268704891204834 time for calcul the mask position with numpy : 0.8324356079101562 nb_pixel_total : 6365636 time to create 1 rle with new method : 1.0504505634307861 time for calcul the mask position with numpy : 0.030071496963500977 nb_pixel_total : 514741 time to create 1 rle with new method : 1.18446683883667 time for calcul the mask position with numpy : 0.021057605743408203 nb_pixel_total : 38137 time to create 1 rle with old method : 0.039977073669433594 time for calcul the mask position with numpy : 0.021386146545410156 nb_pixel_total : 68894 time to create 1 rle with old method : 0.07339143753051758 time for calcul the mask position with numpy : 0.02300262451171875 nb_pixel_total : 62832 time to create 1 rle with old method : 0.06497859954833984 create new chi : 3.403219699859619 time to delete rle : 0.0007996559143066406 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 6170 TO DO : save crop sub photo not yet done ! save time : 0.3923966884613037 nb_obj : 30 nb_hashtags : 3 time to prepare the origin masks : 3.8227667808532715 time for calcul the mask position with numpy : 0.33063578605651855 nb_pixel_total : 5380880 time to create 1 rle with new method : 1.8736014366149902 time for calcul the mask position with numpy : 0.027308940887451172 nb_pixel_total : 65861 time to create 1 rle with old method : 0.06780529022216797 time for calcul the mask position with numpy : 0.026561260223388672 nb_pixel_total : 12209 time to create 1 rle with old method : 0.012980222702026367 time for calcul the mask position with numpy : 0.027868986129760742 nb_pixel_total : 9828 time to create 1 rle with old method : 0.011340618133544922 time for calcul the mask position with numpy : 0.027556180953979492 nb_pixel_total : 53170 time to create 1 rle with old method : 0.05542802810668945 time for calcul the mask position with numpy : 0.02663397789001465 nb_pixel_total : 37749 time to create 1 rle with old method : 0.038744449615478516 time for calcul the mask position with numpy : 0.027805089950561523 nb_pixel_total : 27663 time to create 1 rle with old method : 0.03069615364074707 time for calcul the mask position with numpy : 0.027962207794189453 nb_pixel_total : 38525 time to create 1 rle with old method : 0.0399324893951416 time for calcul the mask position with numpy : 0.026826858520507812 nb_pixel_total : 5305 time to create 1 rle with old method : 0.005652904510498047 time for calcul the mask position with numpy : 0.02662515640258789 nb_pixel_total : 18582 time to create 1 rle with old method : 0.020548105239868164 time for calcul the mask position with numpy : 0.027584552764892578 nb_pixel_total : 53097 time to create 1 rle with old method : 0.05319809913635254 time for calcul the mask position with numpy : 0.02673625946044922 nb_pixel_total : 39217 time to create 1 rle with old method : 0.04041790962219238 time for calcul the mask position with numpy : 0.026575326919555664 nb_pixel_total : 33314 time to create 1 rle with old method : 0.03537487983703613 time for calcul the mask position with numpy : 0.02658557891845703 nb_pixel_total : 5398 time to create 1 rle with old method : 0.006080150604248047 time for calcul the mask position with numpy : 0.026458740234375 nb_pixel_total : 9866 time to create 1 rle with old method : 0.010895729064941406 time for calcul the mask position with numpy : 0.026901960372924805 nb_pixel_total : 35515 time to create 1 rle with old method : 0.037911415100097656 time for calcul the mask position with numpy : 0.02714085578918457 nb_pixel_total : 29172 time to create 1 rle with old method : 0.03136563301086426 time for calcul the mask position with numpy : 0.02659130096435547 nb_pixel_total : 9213 time to create 1 rle with old method : 0.010276079177856445 time for calcul the mask position with numpy : 0.026868104934692383 nb_pixel_total : 33189 time to create 1 rle with old method : 0.03604459762573242 time for calcul the mask position with numpy : 0.028969287872314453 nb_pixel_total : 285868 time to create 1 rle with new method : 2.897722005844116 time for calcul the mask position with numpy : 0.026859521865844727 nb_pixel_total : 20645 time to create 1 rle with old method : 0.021778583526611328 time for calcul the mask position with numpy : 0.02718353271484375 nb_pixel_total : 11175 time to create 1 rle with old method : 0.011669635772705078 time for calcul the mask position with numpy : 0.027154922485351562 nb_pixel_total : 16536 time to create 1 rle with old method : 0.017549514770507812 time for calcul the mask position with numpy : 0.026611804962158203 nb_pixel_total : 22905 time to create 1 rle with old method : 0.023912429809570312 time for calcul the mask position with numpy : 0.029712677001953125 nb_pixel_total : 426284 time to create 1 rle with new method : 2.704041004180908 time for calcul the mask position with numpy : 0.02849578857421875 nb_pixel_total : 90390 time to create 1 rle with old method : 0.09428858757019043 time for calcul the mask position with numpy : 0.029244661331176758 nb_pixel_total : 19236 time to create 1 rle with old method : 0.021805286407470703 time for calcul the mask position with numpy : 0.028959274291992188 nb_pixel_total : 19879 time to create 1 rle with old method : 0.022028207778930664 time for calcul the mask position with numpy : 0.029000043869018555 nb_pixel_total : 60397 time to create 1 rle with old method : 0.0644369125366211 time for calcul the mask position with numpy : 0.029647350311279297 nb_pixel_total : 172149 time to create 1 rle with new method : 0.9070889949798584 time for calcul the mask position with numpy : 0.029105663299560547 nb_pixel_total : 7023 time to create 1 rle with old method : 0.007965087890625 create new chi : 10.461890697479248 time to delete rle : 0.002353668212890625 batch 1 Loaded 61 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19078 TO DO : save crop sub photo not yet done ! save time : 1.1158990859985352 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 15.806470155715942 time for calcul the mask position with numpy : 0.8127861022949219 nb_pixel_total : 6396999 time to create 1 rle with new method : 0.7122507095336914 time for calcul the mask position with numpy : 0.032679080963134766 nb_pixel_total : 3839 time to create 1 rle with old method : 0.004334211349487305 time for calcul the mask position with numpy : 0.03239703178405762 nb_pixel_total : 17309 time to create 1 rle with old method : 0.018262147903442383 time for calcul the mask position with numpy : 0.019509553909301758 nb_pixel_total : 6151 time to create 1 rle with old method : 0.006472110748291016 time for calcul the mask position with numpy : 0.02112722396850586 nb_pixel_total : 6163 time to create 1 rle with old method : 0.006917476654052734 time for calcul the mask position with numpy : 0.021069765090942383 nb_pixel_total : 17882 time to create 1 rle with old method : 0.018798828125 time for calcul the mask position with numpy : 0.020603656768798828 nb_pixel_total : 18633 time to create 1 rle with old method : 0.019550800323486328 time for calcul the mask position with numpy : 0.02073073387145996 nb_pixel_total : 111443 time to create 1 rle with old method : 0.11202692985534668 time for calcul the mask position with numpy : 0.020769357681274414 nb_pixel_total : 102384 time to create 1 rle with old method : 0.10142397880554199 time for calcul the mask position with numpy : 0.020981788635253906 nb_pixel_total : 11797 time to create 1 rle with old method : 0.012310028076171875 time for calcul the mask position with numpy : 0.020525693893432617 nb_pixel_total : 31657 time to create 1 rle with old method : 0.03278493881225586 time for calcul the mask position with numpy : 0.02090597152709961 nb_pixel_total : 106556 time to create 1 rle with old method : 0.11418604850769043 time for calcul the mask position with numpy : 0.020198822021484375 nb_pixel_total : 29533 time to create 1 rle with old method : 0.03109908103942871 time for calcul the mask position with numpy : 0.021199464797973633 nb_pixel_total : 24144 time to create 1 rle with old method : 0.025477886199951172 time for calcul the mask position with numpy : 0.021127700805664062 nb_pixel_total : 31410 time to create 1 rle with old method : 0.031162500381469727 time for calcul the mask position with numpy : 0.02016901969909668 nb_pixel_total : 14874 time to create 1 rle with old method : 0.015115737915039062 time for calcul the mask position with numpy : 0.02039027214050293 nb_pixel_total : 47297 time to create 1 rle with old method : 0.05030989646911621 time for calcul the mask position with numpy : 0.0196993350982666 nb_pixel_total : 21402 time to create 1 rle with old method : 0.021475791931152344 time for calcul the mask position with numpy : 0.019975662231445312 nb_pixel_total : 32658 time to create 1 rle with old method : 0.03449511528015137 time for calcul the mask position with numpy : 0.020234107971191406 nb_pixel_total : 18109 time to create 1 rle with old method : 0.018797636032104492 create new chi : 2.647429943084717 time to delete rle : 0.0014050006866455078 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10423 TO DO : save crop sub photo not yet done ! save time : 2.4524197578430176 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 8.7567720413208 time for calcul the mask position with numpy : 0.6774613857269287 nb_pixel_total : 6564237 time to create 1 rle with new method : 0.8077173233032227 time for calcul the mask position with numpy : 0.02038288116455078 nb_pixel_total : 33601 time to create 1 rle with old method : 0.03482842445373535 time for calcul the mask position with numpy : 0.02135300636291504 nb_pixel_total : 19247 time to create 1 rle with old method : 0.021709918975830078 time for calcul the mask position with numpy : 0.0242154598236084 nb_pixel_total : 3554 time to create 1 rle with old method : 0.004601716995239258 time for calcul the mask position with numpy : 0.021750926971435547 nb_pixel_total : 75966 time to create 1 rle with old method : 0.08331918716430664 time for calcul the mask position with numpy : 0.020433425903320312 nb_pixel_total : 12604 time to create 1 rle with old method : 0.01435232162475586 time for calcul the mask position with numpy : 0.02140331268310547 nb_pixel_total : 44741 time to create 1 rle with old method : 0.04874467849731445 time for calcul the mask position with numpy : 0.022443056106567383 nb_pixel_total : 30448 time to create 1 rle with old method : 0.03384542465209961 time for calcul the mask position with numpy : 0.023148059844970703 nb_pixel_total : 46704 time to create 1 rle with old method : 0.05503034591674805 time for calcul the mask position with numpy : 0.020724773406982422 nb_pixel_total : 23707 time to create 1 rle with old method : 0.02589273452758789 time for calcul the mask position with numpy : 0.021316051483154297 nb_pixel_total : 20675 time to create 1 rle with old method : 0.026880741119384766 time for calcul the mask position with numpy : 0.021906137466430664 nb_pixel_total : 4660 time to create 1 rle with old method : 0.0054950714111328125 time for calcul the mask position with numpy : 0.0211334228515625 nb_pixel_total : 30214 time to create 1 rle with old method : 0.03245735168457031 time for calcul the mask position with numpy : 0.02279496192932129 nb_pixel_total : 115702 time to create 1 rle with old method : 0.12119722366333008 time for calcul the mask position with numpy : 0.020969629287719727 nb_pixel_total : 24180 time to create 1 rle with old method : 0.024950742721557617 create new chi : 2.361788272857666 time to delete rle : 0.0013537406921386719 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8682 TO DO : save crop sub photo not yet done ! save time : 0.7302627563476562 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 5.000342845916748 time for calcul the mask position with numpy : 0.716355562210083 nb_pixel_total : 6388261 time to create 1 rle with new method : 0.8681039810180664 time for calcul the mask position with numpy : 0.02169060707092285 nb_pixel_total : 2723 time to create 1 rle with old method : 0.003344297409057617 time for calcul the mask position with numpy : 0.02099895477294922 nb_pixel_total : 9772 time to create 1 rle with old method : 0.011033773422241211 time for calcul the mask position with numpy : 0.022193193435668945 nb_pixel_total : 133326 time to create 1 rle with old method : 0.14324450492858887 time for calcul the mask position with numpy : 0.02155017852783203 nb_pixel_total : 102789 time to create 1 rle with old method : 0.10537910461425781 time for calcul the mask position with numpy : 0.0233001708984375 nb_pixel_total : 343598 time to create 1 rle with new method : 1.7212696075439453 time for calcul the mask position with numpy : 0.021032333374023438 nb_pixel_total : 11082 time to create 1 rle with old method : 0.011821985244750977 time for calcul the mask position with numpy : 0.0216217041015625 nb_pixel_total : 31512 time to create 1 rle with old method : 0.0342254638671875 time for calcul the mask position with numpy : 0.021660566329956055 nb_pixel_total : 11805 time to create 1 rle with old method : 0.013428926467895508 time for calcul the mask position with numpy : 0.021742582321166992 nb_pixel_total : 15372 time to create 1 rle with old method : 0.017338991165161133 create new chi : 3.901057720184326 time to delete rle : 0.0009129047393798828 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 6186 TO DO : save crop sub photo not yet done ! save time : 0.6952962875366211 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 9.670733451843262 time for calcul the mask position with numpy : 1.7600429058074951 nb_pixel_total : 6140410 time to create 1 rle with new method : 1.8563594818115234 time for calcul the mask position with numpy : 0.021206140518188477 nb_pixel_total : 30693 time to create 1 rle with old method : 0.03291916847229004 time for calcul the mask position with numpy : 0.03373861312866211 nb_pixel_total : 55215 time to create 1 rle with old method : 0.05788087844848633 time for calcul the mask position with numpy : 0.032393455505371094 nb_pixel_total : 15882 time to create 1 rle with old method : 0.01594066619873047 time for calcul the mask position with numpy : 0.03348493576049805 nb_pixel_total : 197028 time to create 1 rle with new method : 1.0838940143585205 time for calcul the mask position with numpy : 0.033208608627319336 nb_pixel_total : 67966 time to create 1 rle with old method : 0.07124996185302734 time for calcul the mask position with numpy : 0.021648645401000977 nb_pixel_total : 98399 time to create 1 rle with old method : 0.10233879089355469 time for calcul the mask position with numpy : 0.021247148513793945 nb_pixel_total : 69112 time to create 1 rle with old method : 0.07383584976196289 time for calcul the mask position with numpy : 0.02242588996887207 nb_pixel_total : 259205 time to create 1 rle with new method : 2.4086859226226807 time for calcul the mask position with numpy : 0.0233461856842041 nb_pixel_total : 27738 time to create 1 rle with old method : 0.03185892105102539 time for calcul the mask position with numpy : 0.02633190155029297 nb_pixel_total : 48153 time to create 1 rle with old method : 0.05190324783325195 time for calcul the mask position with numpy : 0.021242618560791016 nb_pixel_total : 22503 time to create 1 rle with old method : 0.0251009464263916 time for calcul the mask position with numpy : 0.02126169204711914 nb_pixel_total : 17936 time to create 1 rle with old method : 0.020139217376708984 create new chi : 7.989476919174194 time to delete rle : 0.0015420913696289062 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9882 TO DO : save crop sub photo not yet done ! save time : 1.0983052253723145 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 10.162712335586548 time for calcul the mask position with numpy : 0.819584846496582 nb_pixel_total : 6414276 time to create 1 rle with new method : 0.3612346649169922 time for calcul the mask position with numpy : 0.031272172927856445 nb_pixel_total : 6407 time to create 1 rle with old method : 0.00719904899597168 time for calcul the mask position with numpy : 0.020803213119506836 nb_pixel_total : 1443 time to create 1 rle with old method : 0.0018546581268310547 time for calcul the mask position with numpy : 0.0223691463470459 nb_pixel_total : 15829 time to create 1 rle with old method : 0.016672134399414062 time for calcul the mask position with numpy : 0.023134231567382812 nb_pixel_total : 44323 time to create 1 rle with old method : 0.05507230758666992 time for calcul the mask position with numpy : 0.02340531349182129 nb_pixel_total : 15008 time to create 1 rle with old method : 0.016263484954833984 time for calcul the mask position with numpy : 0.020670175552368164 nb_pixel_total : 18661 time to create 1 rle with old method : 0.0208890438079834 time for calcul the mask position with numpy : 0.021817684173583984 nb_pixel_total : 98808 time to create 1 rle with old method : 0.10407495498657227 time for calcul the mask position with numpy : 0.02083277702331543 nb_pixel_total : 6874 time to create 1 rle with old method : 0.007434368133544922 time for calcul the mask position with numpy : 0.021815061569213867 nb_pixel_total : 63564 time to create 1 rle with old method : 0.068267822265625 time for calcul the mask position with numpy : 0.021511077880859375 nb_pixel_total : 19375 time to create 1 rle with old method : 0.02072596549987793 time for calcul the mask position with numpy : 0.022744178771972656 nb_pixel_total : 71442 time to create 1 rle with old method : 0.07842373847961426 time for calcul the mask position with numpy : 0.02137613296508789 nb_pixel_total : 30889 time to create 1 rle with old method : 0.03267621994018555 time for calcul the mask position with numpy : 0.020771265029907227 nb_pixel_total : 18938 time to create 1 rle with old method : 0.019878625869750977 time for calcul the mask position with numpy : 0.020705461502075195 nb_pixel_total : 34253 time to create 1 rle with old method : 0.03593111038208008 time for calcul the mask position with numpy : 0.021514892578125 nb_pixel_total : 20455 time to create 1 rle with old method : 0.02151203155517578 time for calcul the mask position with numpy : 0.020959854125976562 nb_pixel_total : 19808 time to create 1 rle with old method : 0.02162909507751465 time for calcul the mask position with numpy : 0.021555662155151367 nb_pixel_total : 20148 time to create 1 rle with old method : 0.022218942642211914 time for calcul the mask position with numpy : 0.021893024444580078 nb_pixel_total : 129739 time to create 1 rle with old method : 0.1309370994567871 create new chi : 2.302051544189453 time to delete rle : 0.0017685890197753906 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 11670 TO DO : save crop sub photo not yet done ! save time : 1.4190714359283447 nb_obj : 26 nb_hashtags : 4 time to prepare the origin masks : 3.449965000152588 time for calcul the mask position with numpy : 0.6253676414489746 nb_pixel_total : 6235531 time to create 1 rle with new method : 0.6717708110809326 time for calcul the mask position with numpy : 0.03076314926147461 nb_pixel_total : 6922 time to create 1 rle with old method : 0.007580280303955078 time for calcul the mask position with numpy : 0.02960038185119629 nb_pixel_total : 144860 time to create 1 rle with old method : 0.15907979011535645 time for calcul the mask position with numpy : 0.028233051300048828 nb_pixel_total : 5719 time to create 1 rle with old method : 0.006121158599853516 time for calcul the mask position with numpy : 0.0279543399810791 nb_pixel_total : 53107 time to create 1 rle with old method : 0.05709481239318848 time for calcul the mask position with numpy : 0.0280153751373291 nb_pixel_total : 11929 time to create 1 rle with old method : 0.013543367385864258 time for calcul the mask position with numpy : 0.028345584869384766 nb_pixel_total : 153863 time to create 1 rle with new method : 1.149048089981079 time for calcul the mask position with numpy : 0.02709341049194336 nb_pixel_total : 4129 time to create 1 rle with old method : 0.004512786865234375 time for calcul the mask position with numpy : 0.026877880096435547 nb_pixel_total : 41567 time to create 1 rle with old method : 0.04707527160644531 time for calcul the mask position with numpy : 0.02937793731689453 nb_pixel_total : 7412 time to create 1 rle with old method : 0.009948492050170898 time for calcul the mask position with numpy : 0.0351102352142334 nb_pixel_total : 76086 time to create 1 rle with old method : 0.08110475540161133 time for calcul the mask position with numpy : 0.028767824172973633 nb_pixel_total : 18331 time to create 1 rle with old method : 0.020490646362304688 time for calcul the mask position with numpy : 0.028598785400390625 nb_pixel_total : 9256 time to create 1 rle with old method : 0.010781288146972656 time for calcul the mask position with numpy : 0.02856731414794922 nb_pixel_total : 5339 time to create 1 rle with old method : 0.006482839584350586 time for calcul the mask position with numpy : 0.02864813804626465 nb_pixel_total : 29724 time to create 1 rle with old method : 0.034442901611328125 time for calcul the mask position with numpy : 0.029227018356323242 nb_pixel_total : 11559 time to create 1 rle with old method : 0.014526605606079102 time for calcul the mask position with numpy : 0.028692007064819336 nb_pixel_total : 17180 time to create 1 rle with old method : 0.018796920776367188 time for calcul the mask position with numpy : 0.028141021728515625 nb_pixel_total : 21239 time to create 1 rle with old method : 0.022935867309570312 time for calcul the mask position with numpy : 0.028733253479003906 nb_pixel_total : 31045 time to create 1 rle with old method : 0.03255152702331543 time for calcul the mask position with numpy : 0.02831888198852539 nb_pixel_total : 32050 time to create 1 rle with old method : 0.03490328788757324 time for calcul the mask position with numpy : 0.0287630558013916 nb_pixel_total : 36319 time to create 1 rle with old method : 0.04098367691040039 time for calcul the mask position with numpy : 0.02779221534729004 nb_pixel_total : 42902 time to create 1 rle with old method : 0.045946359634399414 time for calcul the mask position with numpy : 0.027830123901367188 nb_pixel_total : 7524 time to create 1 rle with old method : 0.008296489715576172 time for calcul the mask position with numpy : 0.02720189094543457 nb_pixel_total : 6675 time to create 1 rle with old method : 0.007773637771606445 time for calcul the mask position with numpy : 0.026975154876708984 nb_pixel_total : 8942 time to create 1 rle with old method : 0.010107994079589844 time for calcul the mask position with numpy : 0.028661012649536133 nb_pixel_total : 21597 time to create 1 rle with old method : 0.02387857437133789 time for calcul the mask position with numpy : 0.028538942337036133 nb_pixel_total : 9433 time to create 1 rle with old method : 0.011098623275756836 create new chi : 3.9776363372802734 time to delete rle : 0.0036242008209228516 batch 1 Loaded 53 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 14384 TO DO : save crop sub photo not yet done ! save time : 0.9423437118530273 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 9.955659627914429 time for calcul the mask position with numpy : 0.4439396858215332 nb_pixel_total : 5525581 time to create 1 rle with new method : 0.5745513439178467 time for calcul the mask position with numpy : 0.022649765014648438 nb_pixel_total : 12326 time to create 1 rle with old method : 0.013503074645996094 time for calcul the mask position with numpy : 0.026044368743896484 nb_pixel_total : 8290 time to create 1 rle with old method : 0.00945591926574707 time for calcul the mask position with numpy : 0.025243759155273438 nb_pixel_total : 616984 time to create 1 rle with new method : 1.0307579040527344 time for calcul the mask position with numpy : 0.023444175720214844 nb_pixel_total : 261018 time to create 1 rle with new method : 0.7197999954223633 time for calcul the mask position with numpy : 0.02657151222229004 nb_pixel_total : 12672 time to create 1 rle with old method : 0.016156911849975586 time for calcul the mask position with numpy : 0.024904251098632812 nb_pixel_total : 123368 time to create 1 rle with old method : 0.13437247276306152 time for calcul the mask position with numpy : 0.02260136604309082 nb_pixel_total : 60362 time to create 1 rle with old method : 0.0657036304473877 time for calcul the mask position with numpy : 0.022745132446289062 nb_pixel_total : 38310 time to create 1 rle with old method : 0.04389357566833496 time for calcul the mask position with numpy : 0.02456974983215332 nb_pixel_total : 49136 time to create 1 rle with old method : 0.054326772689819336 time for calcul the mask position with numpy : 0.02328777313232422 nb_pixel_total : 54877 time to create 1 rle with old method : 0.06026816368103027 time for calcul the mask position with numpy : 0.021860361099243164 nb_pixel_total : 30562 time to create 1 rle with old method : 0.03579211235046387 time for calcul the mask position with numpy : 0.023175477981567383 nb_pixel_total : 91350 time to create 1 rle with old method : 0.09868526458740234 time for calcul the mask position with numpy : 0.02118682861328125 nb_pixel_total : 41285 time to create 1 rle with old method : 0.044063568115234375 time for calcul the mask position with numpy : 0.022220134735107422 nb_pixel_total : 82797 time to create 1 rle with old method : 0.08635354042053223 time for calcul the mask position with numpy : 0.020327329635620117 nb_pixel_total : 41322 time to create 1 rle with old method : 0.044699907302856445 create new chi : 3.9142494201660156 time to delete rle : 0.00263214111328125 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 14914 TO DO : save crop sub photo not yet done ! save time : 1.1015560626983643 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 5.783124208450317 time for calcul the mask position with numpy : 0.6403284072875977 nb_pixel_total : 6570530 time to create 1 rle with new method : 0.9712162017822266 time for calcul the mask position with numpy : 0.0218505859375 nb_pixel_total : 7019 time to create 1 rle with old method : 0.007755756378173828 time for calcul the mask position with numpy : 0.021442651748657227 nb_pixel_total : 29353 time to create 1 rle with old method : 0.03200125694274902 time for calcul the mask position with numpy : 0.024904966354370117 nb_pixel_total : 273288 time to create 1 rle with new method : 2.13032865524292 time for calcul the mask position with numpy : 0.023485183715820312 nb_pixel_total : 83071 time to create 1 rle with old method : 0.09718942642211914 time for calcul the mask position with numpy : 0.023110151290893555 nb_pixel_total : 86979 time to create 1 rle with old method : 0.09868288040161133 create new chi : 4.158487319946289 time to delete rle : 0.0013108253479003906 batch 1 Loaded 11 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8894 TO DO : save crop sub photo not yet done ! save time : 0.8876848220825195 map_output_result : {1338302703: (0.0, 'Should be the crop_list due to order', 0.0), 1338302675: (0.0, 'Should be the crop_list due to order', 0.0), 1338302672: (0.0, 'Should be the crop_list due to order', 0.0), 1338302668: (0.0, 'Should be the crop_list due to order', 0.0), 1338302663: (0.0, 'Should be the crop_list due to order', 0.0), 1338302650: (0.0, 'Should be the crop_list due to order', 0.0), 1338302648: (0.0, 'Should be the crop_list due to order', 0.0), 1338302631: (0.0, 'Should be the crop_list due to order', 0.0), 1338302627: (0.0, 'Should be the crop_list due to order', 0.0), 1338302622: (0.0, 'Should be the crop_list due to order', 0.0), 1338302620: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1338302703, 1338302675, 1338302672, 1338302668, 1338302663, 1338302650, 1338302648, 1338302631, 1338302627, 1338302622, 1338302620] Looping around the photos to save general results len do output : 11 /1338302703.Didn't retrieve data . /1338302675.Didn't retrieve data . /1338302672.Didn't retrieve data . /1338302668.Didn't retrieve data . /1338302663.Didn't retrieve data . /1338302650.Didn't retrieve data . /1338302648.Didn't retrieve data . /1338302631.Didn't retrieve data . /1338302627.Didn't retrieve data . /1338302622.Didn't retrieve data . /1338302620.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302703', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302675', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302672', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302668', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302663', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302650', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302648', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302631', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302627', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302622', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302620', None, None, None, None, None, '2597817') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.014323234558105469 save_final save missing photos in datou_result : time spend for datou_step_exec : 141.69731640815735 time spend to save output : 0.014844894409179688 total time spend for step 3 : 141.71216130256653 step4:ventilate_hashtags_in_portfolio Wed Feb 19 00:45:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20656278 get user id for portfolio 20656278 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656278 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','mal_croppe','papier','autre','pet_fonce','pehd','metal','pet_clair','carton','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656278 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','mal_croppe','papier','autre','pet_fonce','pehd','metal','pet_clair','carton','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656278 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','mal_croppe','papier','autre','pet_fonce','pehd','metal','pet_clair','carton','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20658394,20658395,20658396,20658397,20658398,20658399,20658400,20658401,20658402,20658403,20658404?tags=background,environnement,mal_croppe,papier,autre,pet_fonce,pehd,metal,pet_clair,carton,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1338302703, 1338302675, 1338302672, 1338302668, 1338302663, 1338302650, 1338302648, 1338302631, 1338302627, 1338302622, 1338302620] Looping around the photos to save general results len do output : 1 /20656278. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302703', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302675', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302672', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302668', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302663', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302650', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302648', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302631', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302627', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302622', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302620', None, None, None, None, None, '2597817') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01557016372680664 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0160326957702637 time spend to save output : 0.01578378677368164 total time spend for step 4 : 2.0318164825439453 step5:final Wed Feb 19 00:45:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1338302703: ('0.11054170431851196',), 1338302675: ('0.11054170431851196',), 1338302672: ('0.11054170431851196',), 1338302668: ('0.11054170431851196',), 1338302663: ('0.11054170431851196',), 1338302650: ('0.11054170431851196',), 1338302648: ('0.11054170431851196',), 1338302631: ('0.11054170431851196',), 1338302627: ('0.11054170431851196',), 1338302622: ('0.11054170431851196',), 1338302620: ('0.11054170431851196',)} new output for save of step final : {1338302703: ('0.11054170431851196',), 1338302675: ('0.11054170431851196',), 1338302672: ('0.11054170431851196',), 1338302668: ('0.11054170431851196',), 1338302663: ('0.11054170431851196',), 1338302650: ('0.11054170431851196',), 1338302648: ('0.11054170431851196',), 1338302631: ('0.11054170431851196',), 1338302627: ('0.11054170431851196',), 1338302622: ('0.11054170431851196',), 1338302620: ('0.11054170431851196',)} [1338302703, 1338302675, 1338302672, 1338302668, 1338302663, 1338302650, 1338302648, 1338302631, 1338302627, 1338302622, 1338302620] Looping around the photos to save general results len do output : 11 /1338302703.Didn't retrieve data . /1338302675.Didn't retrieve data . /1338302672.Didn't retrieve data . /1338302668.Didn't retrieve data . /1338302663.Didn't retrieve data . /1338302650.Didn't retrieve data . /1338302648.Didn't retrieve data . /1338302631.Didn't retrieve data . /1338302627.Didn't retrieve data . /1338302622.Didn't retrieve data . /1338302620.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302703', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302675', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302672', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302668', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302663', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302650', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302648', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302631', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302627', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302622', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302620', None, None, None, None, None, '2597817') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.22544169425964355 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3480691909790039 time spend to save output : 0.22605395317077637 total time spend for step 5 : 0.5741231441497803 step6:blur_detection Wed Feb 19 00:45:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739922028_1813751_1338302703_dbb644dc207ef34defb48b5eb79833c2.jpg resize: (2160, 3264) 1338302703 -3.977432424335429 treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a.jpg resize: (2160, 3264) 1338302675 -3.2552944884000086 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7.jpg resize: (2160, 3264) 1338302672 -2.6918065759191903 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa.jpg resize: (2160, 3264) 1338302668 -2.7291004107701395 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419.jpg resize: (2160, 3264) 1338302663 -1.9361086601152118 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a.jpg resize: (2160, 3264) 1338302650 -4.645049066613965 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640.jpg resize: (2160, 3264) 1338302648 -2.6322609978737304 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836.jpg resize: (2160, 3264) 1338302631 -4.073863900325814 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7.jpg resize: (2160, 3264) 1338302627 -4.449877054888779 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d.jpg resize: (2160, 3264) 1338302622 -1.754573129890553 treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208.jpg resize: (2160, 3264) 1338302620 -2.0190384211152503 treat image : temp/1739922028_1813751_1338302703_dbb644dc207ef34defb48b5eb79833c2_rle_crop_3679509411_0.png resize: (118, 99) 1338421523 -1.80687341720589 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509438_0.png resize: (127, 120) 1338421525 -2.5773077888086697 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509422_0.png resize: (371, 195) 1338421526 -2.475059251694991 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509429_0.png resize: (160, 119) 1338421527 -3.3683564451724113 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509417_0.png resize: (207, 178) 1338421528 -1.1581200098536062 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509442_0.png resize: (133, 227) 1338421529 -1.6127037461527571 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509432_0.png resize: (829, 945) 1338421530 -0.546928080830028 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509430_0.png resize: (415, 416) 1338421531 -1.4939386474363157 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509441_0.png resize: (253, 299) 1338421532 -3.1124131568788855 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509433_0.png resize: (298, 305) 1338421533 0.003255766254341398 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509425_0.png resize: (167, 282) 1338421534 -3.684081485176402 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509431_0.png resize: (238, 186) 1338421535 -1.7810231336398172 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509449_0.png resize: (339, 292) 1338421536 -2.3088465416005404 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509447_0.png resize: (282, 169) 1338421537 -0.7321983591389393 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509464_0.png resize: (119, 96) 1338421538 -2.953503294621751 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509463_0.png resize: (169, 152) 1338421539 -1.520580762401792 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509450_0.png resize: (126, 169) 1338421540 -3.0405384464577923 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509459_0.png resize: (83, 268) 1338421541 -2.4978626428981325 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509451_0.png resize: (186, 237) 1338421542 -0.9913800414162625 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509448_0.png resize: (155, 208) 1338421543 -1.2395745614482205 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509461_0.png resize: (99, 83) 1338421544 -0.9396943614833175 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509446_0.png resize: (171, 131) 1338421545 -0.5995780360845441 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509453_0.png resize: (246, 159) 1338421546 -3.9168622644411384 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509456_0.png resize: (116, 171) 1338421547 -2.4737530044249785 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509478_0.png resize: (239, 242) 1338421548 -2.899797512679583 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509476_0.png resize: (275, 256) 1338421549 -1.65023446445007 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509475_0.png resize: (323, 331) 1338421550 -2.225638820652683 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509466_0.png resize: (356, 462) 1338421551 -0.4189681908326921 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509469_0.png resize: (190, 154) 1338421552 -3.4105822178799996 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509465_0.png resize: (239, 131) 1338421553 -1.4098754569551182 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509467_0.png resize: (291, 283) 1338421554 -2.2622664494860576 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509471_0.png resize: (244, 290) 1338421555 -1.6163647777808252 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509482_0.png resize: (142, 141) 1338421556 -3.274100742972294 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509480_0.png resize: (156, 106) 1338421557 -2.8114306424209268 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509486_0.png resize: (83, 133) 1338421561 -0.9047129312762546 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509485_0.png resize: (416, 438) 1338421564 -2.3533767613421315 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509495_0.png resize: (387, 288) 1338421567 -3.4332968949108595 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509488_0.png resize: (182, 197) 1338421569 -2.7454210637391436 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509491_0.png resize: (197, 251) 1338421571 -0.5337581123483094 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509497_0.png resize: (163, 208) 1338421574 -3.506516938183957 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509493_0.png resize: (198, 448) 1338421578 -3.8458644915634617 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509499_0.png resize: (164, 296) 1338421580 -2.8767490571460406 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509490_0.png resize: (297, 261) 1338421582 -1.8245627056241847 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509489_0.png resize: (240, 136) 1338421585 0.04909173012462804 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509502_0.png resize: (237, 120) 1338421586 -1.4498101469809095 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509505_0.png resize: (207, 118) 1338421587 -2.064994408029293 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509509_0.png resize: (397, 281) 1338421588 -1.2329880590632285 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509510_0.png resize: (92, 112) 1338421589 -1.0916929960482311 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509507_0.png resize: (476, 272) 1338421590 -2.751369799780909 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509514_0.png resize: (212, 307) 1338421591 -2.9443800836391483 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509501_0.png resize: (165, 173) 1338421592 -2.374946100873492 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509515_0.png resize: (140, 176) 1338421593 -2.101390110860144 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509517_0.png resize: (96, 84) 1338421594 -0.7389056033333817 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509504_0.png resize: (225, 223) 1338421595 -1.7171688531798066 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509511_0.png resize: (335, 538) 1338421596 -3.6567143891075413 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509513_0.png resize: (196, 138) 1338421597 -3.6834970011715606 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509506_0.png resize: (275, 155) 1338421598 -3.2573681343321192 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509520_0.png resize: (575, 379) 1338421599 -2.040736044163636 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509538_0.png resize: (113, 144) 1338421600 -2.5320276538510433 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509537_0.png resize: (171, 299) 1338421601 -3.067951330019537 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509529_0.png resize: (372, 201) 1338421602 -2.8404461761568625 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509532_0.png resize: (203, 126) 1338421603 -2.3534200839053137 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509536_0.png resize: (85, 100) 1338421604 -2.9442734962335337 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509522_0.png resize: (271, 269) 1338421605 -3.2358345038964975 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509534_0.png resize: (130, 126) 1338421606 -1.2965244415814274 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509533_0.png resize: (279, 247) 1338421607 -3.833548010399091 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509523_0.png resize: (110, 85) 1338421608 -2.3362313899078835 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509541_0.png resize: (194, 186) 1338421609 -2.7863490115093765 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509542_0.png resize: (79, 85) 1338421610 0.4320839498192796 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509524_0.png resize: (110, 112) 1338421611 -4.132345371115742 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509525_0.png resize: (313, 199) 1338421612 -3.7659269374584423 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509535_0.png resize: (172, 147) 1338421613 -3.970041120132365 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509518_0.png resize: (104, 94) 1338421614 -2.8662704292247296 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509526_0.png resize: (96, 121) 1338421615 0.9028864911909931 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509556_0.png resize: (818, 1228) 1338421616 -0.8055296102294572 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509545_0.png resize: (256, 480) 1338421617 -1.3066059560742225 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509546_0.png resize: (250, 255) 1338421618 -1.9031706598785765 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509550_0.png resize: (455, 223) 1338421619 -2.3250628921569962 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509548_0.png resize: (289, 192) 1338421620 -1.7854832998946708 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509554_0.png resize: (139, 124) 1338421621 -0.851036815932272 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509549_0.png resize: (287, 306) 1338421622 0.09625314803281293 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509544_0.png resize: (244, 284) 1338421623 -1.02208663152209 treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509559_0.png resize: (536, 261) 1338421625 -2.109758087175898 treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509563_0.png resize: (159, 91) 1338421627 -2.8287064064206753 treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509561_0.png resize: (668, 650) 1338421630 -1.7940557096190535 treat image : temp/1739922028_1813751_1338302703_dbb644dc207ef34defb48b5eb79833c2_rle_crop_3679509410_0.png resize: (278, 312) 1338421814 -2.2852663752006546 treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a_rle_crop_3679509412_0.png resize: (339, 252) 1338421815 -3.682437562699549 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509419_0.png resize: (295, 221) 1338421816 -3.422340625590581 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509445_0.png resize: (80, 224) 1338421817 -3.1287569139483615 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509444_0.png resize: (99, 105) 1338421818 -2.5425276350883714 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509418_0.png resize: (96, 91) 1338421819 -2.8309891810883197 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509443_0.png resize: (303, 198) 1338421820 -2.8027876167041827 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509440_0.png resize: (117, 114) 1338421821 -1.4212491589154916 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509436_0.png resize: (167, 158) 1338421822 -2.377118497725795 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509439_0.png resize: (718, 943) 1338421823 -1.457862849183698 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509437_0.png resize: (236, 157) 1338421824 -2.7648157762525547 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509435_0.png resize: (118, 87) 1338421825 -1.8358035205700967 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509434_0.png resize: (256, 240) 1338421826 -2.52321463224065 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509426_0.png resize: (274, 218) 1338421827 -2.6744546938213474 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509428_0.png resize: (141, 221) 1338421828 -1.5531407530181032 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509460_0.png resize: (107, 207) 1338421829 -1.0334784727402646 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509462_0.png resize: (77, 286) 1338421830 -2.057343155347497 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509454_0.png resize: (347, 388) 1338421831 -1.5445253379131756 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509473_0.png resize: (245, 248) 1338421832 -1.1503721602347188 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509474_0.png resize: (140, 111) 1338421833 -1.2446745678961766 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509468_0.png resize: (73, 126) 1338421834 -2.422953207655247 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509472_0.png resize: (218, 166) 1338421835 -2.678674405034527 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509487_0.png resize: (403, 446) 1338421836 -2.400563056796291 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509479_0.png resize: (147, 139) 1338421837 -2.082994650267938 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509492_0.png resize: (763, 549) 1338421838 -3.9877297687663305 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509494_0.png resize: (413, 362) 1338421839 -2.2007426727631207 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509496_0.png resize: (479, 677) 1338421840 -0.7581308019969418 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509500_0.png resize: (561, 347) 1338421841 -1.9417188681205817 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509512_0.png resize: (179, 167) 1338421842 -2.1561400262647976 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509503_0.png resize: (218, 179) 1338421843 -2.7020232772253903 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509508_0.png resize: (238, 121) 1338421844 -2.3443269787756664 treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509516_0.png resize: (133, 207) 1338421845 -2.2113381335058806 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509521_0.png resize: (112, 129) 1338421846 -2.504725922551804 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509530_0.png resize: (230, 250) 1338421847 -3.4237551877102583 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509540_0.png resize: (132, 142) 1338421848 -2.345042824486014 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509527_0.png resize: (89, 92) 1338421849 -4.367787413935919 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509557_0.png resize: (59, 261) 1338421850 -2.320167278838764 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509552_0.png resize: (256, 385) 1338421851 -0.3282455305502846 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509553_0.png resize: (663, 328) 1338421852 -1.9383969499252875 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509551_0.png resize: (297, 292) 1338421853 -0.18068522269032594 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509558_0.png resize: (273, 104) 1338421854 -3.2396733349897446 treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509562_0.png resize: (811, 645) 1338421855 -1.7317207966283403 treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509560_0.png resize: (516, 241) 1338421856 -1.4288936992919257 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509477_0.png resize: (114, 237) 1338421857 -3.508900553673407 treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a_rle_crop_3679509414_0.png resize: (233, 235) 1338421870 -3.31406649728734 treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a_rle_crop_3679509415_0.png resize: (529, 1349) 1338421871 -3.7791685451389228 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509427_0.png resize: (73, 208) 1338421872 -2.3986464355018238 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509416_0.png resize: (171, 464) 1338421873 -1.9947730505430417 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509424_0.png resize: (245, 1122) 1338421874 -1.471939063012701 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509423_0.png resize: (161, 223) 1338421875 -3.6388780216032823 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509420_0.png resize: (292, 281) 1338421876 -2.7770944933012687 treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509421_0.png resize: (219, 343) 1338421877 -1.7046843769758662 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509458_0.png resize: (465, 334) 1338421878 -3.447975049270823 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509455_0.png resize: (268, 152) 1338421879 -0.9330197927345347 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509457_0.png resize: (397, 440) 1338421880 -1.752428122324092 treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509470_0.png resize: (226, 152) 1338421881 -2.3395353842580637 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509483_0.png resize: (307, 1701) 1338421882 -1.9209080400821543 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509484_0.png resize: (247, 504) 1338421883 -1.3352987965359968 treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509498_0.png resize: (285, 300) 1338421884 -1.4326067959693247 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509531_0.png resize: (819, 581) 1338421885 -3.4978185349637045 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509539_0.png resize: (248, 174) 1338421886 -3.3939917542738924 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509528_0.png resize: (301, 508) 1338421887 -3.990660778386319 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509519_0.png resize: (299, 393) 1338421888 -4.2462771877182846 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509547_0.png resize: (240, 473) 1338421889 -3.3853381375357716 treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509555_0.png resize: (842, 743) 1338421890 -2.6920210139064134 treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a_rle_crop_3679509413_0.png resize: (819, 304) 1338421893 -3.6442842296809173 treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509481_0.png resize: (231, 183) 1338421894 -2.1103580734274816 treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509452_0.png resize: (223, 129) 1338421896 -2.078331873770141 treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509543_0.png resize: (106, 57) 1338421897 -2.0556788766205387 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 165 time used for this insertion : 0.07394123077392578 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 165 time used for this insertion : 0.3884551525115967 save missing photos in datou_result : time spend for datou_step_exec : 46.367475509643555 time spend to save output : 0.4693021774291992 total time spend for step 6 : 46.836777687072754 step7:brightness Wed Feb 19 00:46:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739922028_1813751_1338302703_dbb644dc207ef34defb48b5eb79833c2.jpg treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a.jpg treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7.jpg treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa.jpg treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419.jpg treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a.jpg treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640.jpg treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836.jpg treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7.jpg treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d.jpg treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208.jpg treat image : temp/1739922028_1813751_1338302703_dbb644dc207ef34defb48b5eb79833c2_rle_crop_3679509411_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509438_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509422_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509429_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509417_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509442_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509432_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509430_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509441_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509433_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509425_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509431_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509449_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509447_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509464_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509463_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509450_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509459_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509451_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509448_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509461_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509446_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509453_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509456_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509478_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509476_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509475_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509466_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509469_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509465_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509467_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509471_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509482_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509480_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509486_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509485_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509495_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509488_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509491_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509497_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509493_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509499_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509490_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509489_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509502_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509505_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509509_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509510_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509507_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509514_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509501_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509515_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509517_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509504_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509511_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509513_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509506_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509520_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509538_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509537_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509529_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509532_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509536_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509522_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509534_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509533_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509523_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509541_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509542_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509524_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509525_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509535_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509518_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509526_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509556_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509545_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509546_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509550_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509548_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509554_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509549_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509544_0.png treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509559_0.png treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509563_0.png treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509561_0.png treat image : temp/1739922028_1813751_1338302703_dbb644dc207ef34defb48b5eb79833c2_rle_crop_3679509410_0.png treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a_rle_crop_3679509412_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509419_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509445_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509444_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509418_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509443_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509440_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509436_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509439_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509437_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509435_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509434_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509426_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509428_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509460_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509462_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509454_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509473_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509474_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509468_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509472_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509487_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509479_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509492_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509494_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509496_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509500_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509512_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509503_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509508_0.png treat image : temp/1739922028_1813751_1338302631_f76684ce5a8905d68176bbbef4ec3836_rle_crop_3679509516_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509521_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509530_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509540_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509527_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509557_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509552_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509553_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509551_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509558_0.png treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509562_0.png treat image : temp/1739922028_1813751_1338302620_2936890db66b9d272da2fa381e74d208_rle_crop_3679509560_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509477_0.png treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a_rle_crop_3679509414_0.png treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a_rle_crop_3679509415_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509427_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509416_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509424_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509423_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509420_0.png treat image : temp/1739922028_1813751_1338302672_20ffce97b6479ea63222af89a023b8c7_rle_crop_3679509421_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509458_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509455_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509457_0.png treat image : temp/1739922028_1813751_1338302663_fa7b4ae7bdce7d604e219d301a725419_rle_crop_3679509470_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509483_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509484_0.png treat image : temp/1739922028_1813751_1338302648_12367331a46dd104e8a001a1ba959640_rle_crop_3679509498_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509531_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509539_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509528_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509519_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509547_0.png treat image : temp/1739922028_1813751_1338302622_74fe53f0462e99d20ba02f3669150f4d_rle_crop_3679509555_0.png treat image : temp/1739922028_1813751_1338302675_f79d11d5ad544352fa5abcb894068b0a_rle_crop_3679509413_0.png treat image : temp/1739922028_1813751_1338302650_163f3aa49c0f4cb66094d9acf527376a_rle_crop_3679509481_0.png treat image : temp/1739922028_1813751_1338302668_c9e09f6ece0ed3d831e8a91e346758fa_rle_crop_3679509452_0.png treat image : temp/1739922028_1813751_1338302627_c0e3b2af937c6e44d699b08453ab74d7_rle_crop_3679509543_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 165 time used for this insertion : 0.019430160522460938 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 165 time used for this insertion : 0.06999397277832031 save missing photos in datou_result : time spend for datou_step_exec : 10.402629137039185 time spend to save output : 0.09534287452697754 total time spend for step 7 : 10.497972011566162 step8:velours_tree Wed Feb 19 00:46:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.21042943000793457 time spend to save output : 4.076957702636719e-05 total time spend for step 8 : 0.21047019958496094 step9:send_mail_cod Wed Feb 19 00:46:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20656278_19-02-2025_00_46_49.pdf 20658394 imagette206583941739922409 20658396 imagette206583961739922409 20658397 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206583971739922409 20658398 change filename to text .change filename to text .imagette206583981739922410 20658399 change filename to text .change filename to text .imagette206583991739922410 20658400 imagette206584001739922410 20658401 change filename to text .imagette206584011739922410 20658402 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206584021739922410 20658403 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206584031739922412 20658404 imagette206584041739922414 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20656278 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20658394,20658395,20658396,20658397,20658398,20658399,20658400,20658401,20658402,20658403,20658404?tags=background,environnement,mal_croppe,papier,autre,pet_fonce,pehd,metal,pet_clair,carton,flou args[1338302703] : ((1338302703, -3.977432424335429, 492609224), (1338302703, -0.07139992058019215, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302675] : ((1338302675, -3.2552944884000086, 492609224), (1338302675, -0.1406864300858428, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302672] : ((1338302672, -2.6918065759191903, 492609224), (1338302672, -0.2900477747983286, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302668] : ((1338302668, -2.7291004107701395, 492609224), (1338302668, -0.29334058454496287, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302663] : ((1338302663, -1.9361086601152118, 492688767), (1338302663, -0.2070647466069711, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302650] : ((1338302650, -4.645049066613965, 492609224), (1338302650, 0.002525805832747512, 2107752395), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302648] : ((1338302648, -2.6322609978737304, 492609224), (1338302648, -0.2731530584192152, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302631] : ((1338302631, -4.073863900325814, 492609224), (1338302631, -0.36375999593977754, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302627] : ((1338302627, -4.449877054888779, 492609224), (1338302627, -0.39385332247750204, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302622] : ((1338302622, -1.754573129890553, 492688767), (1338302622, -0.26958088563300614, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com args[1338302620] : ((1338302620, -2.0190384211152503, 492609224), (1338302620, -0.3272272907784301, 496442774), '0.11054170431851196') We are sending mail with results at report@fotonower.com refus_total : 0.11054170431851196 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20656278 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 error for generate pdf : 'background' message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20656278

https://www.fotonower.com/image?json=false&list_photos_id=1338302703
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302675
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302672
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302668
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302663
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302650
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302648
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302631
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302627
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302622
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338302620
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.05%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/20658397?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20658398?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20658399?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20658401?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20658402?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20658403?limit=200
Lien vers velours :https://www.fotonower.com/velours/20658394,20658395,20658396,20658397,20658398,20658399,20658400,20658401,20658402,20658403,20658404?tags=background,environnement,mal_croppe,papier,autre,pet_fonce,pehd,metal,pet_clair,carton,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 18 Feb 2025 23:46:54 GMT Content-Length: 0 Connection: close X-Message-Id: KmnxAo0jQoK7zalLqecw3Q Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1338302703, 1338302675, 1338302672, 1338302668, 1338302663, 1338302650, 1338302648, 1338302631, 1338302627, 1338302622, 1338302620] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302703', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302675', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302672', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302668', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302663', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302650', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302648', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302631', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302627', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302622', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302620', None, None, None, None, None, '2597817') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.012966156005859375 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.598121404647827 time spend to save output : 0.013217687606811523 total time spend for step 9 : 5.611339092254639 step10:split_time_score Wed Feb 19 00:46:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 18022025 20656278 Nombre de photos uploadées : 11 / 23040 (0%) 18022025 20656278 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 18022025 20656278 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 6.4373016357421875e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006067752838134766 elapsed_time : insert_dashboard_record_day_entry 0.057286739349365234 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15147575472608016 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656270 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656270 AND mptpi.`type`=3594 To do Qualite : 0.13344219487563547 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656272 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656272 AND mptpi.`type`=3594 To do Qualite : 0.05161465064052396 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656275 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656275 AND mptpi.`type`=3726 To do Qualite : 0.17670167256717503 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656276 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656276 AND mptpi.`type`=3594 To do Qualite : 0.11054170431851196 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656278 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656278 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656285 order by id desc limit 1 Qualite : 0.056029600838106944 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656288 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656288 AND mptpi.`type`=3726 To do Qualite : 0.18347533457827583 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656296 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656296 AND mptpi.`type`=3594 To do Qualite : 0.14315199870762146 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656297 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656297 AND mptpi.`type`=3594 To do Qualite : 0.1236803711646696 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656300 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656300 AND mptpi.`type`=3594 To do Qualite : 0.05733613433293486 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656307 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656307 AND mptpi.`type`=3726 To do Qualite : 0.1353382296205519 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656308 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656308 AND mptpi.`type`=3594 To do Qualite : 0.14370025178687454 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656310 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656310 AND mptpi.`type`=3594 To do Qualite : 0.12531199605386817 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656312 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656312 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'18022025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1338302703, 1338302675, 1338302672, 1338302668, 1338302663, 1338302650, 1338302648, 1338302631, 1338302627, 1338302622, 1338302620] Looping around the photos to save general results len do output : 1 /20656278Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302703', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302675', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302672', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302668', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302663', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302650', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302648', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302631', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302627', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302622', None, None, None, None, None, '2597817') ('3318', None, None, None, None, None, None, None, '2597817') ('3318', '20656278', '1338302620', None, None, None, None, None, '2597817') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.015945911407470703 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.271725177764893 time spend to save output : 0.016204118728637695 total time spend for step 10 : 12.28792929649353 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 154.68user 174.06system 6:41.76elapsed 81%CPU (0avgtext+0avgdata 5662580maxresident)k 657864inputs+108936outputs (950major+13570176minor)pagefaults 0swaps