python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2432784 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2584393'] with mtr_portfolio_ids : ['20528871'] and first list_photo_ids : [] new path : /proc/2432784/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 3.6598498821258545 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Feb 14 01:00:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5580 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-14 01:00:36.191561: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-14 01:00:36.223100: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-14 01:00:36.225701: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fee9c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-14 01:00:36.225742: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-14 01:00:36.232190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-14 01:00:36.501611: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3d82c770 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-14 01:00:36.501684: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-14 01:00:36.503015: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 01:00:36.506430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 01:00:36.541249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 01:00:36.564135: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 01:00:36.568733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 01:00:36.610282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 01:00:36.616843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 01:00:36.686205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 01:00:36.688187: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 01:00:36.688925: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 01:00:36.690856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 01:00:36.690883: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 01:00:36.690930: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 01:00:36.692775: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5103 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-14 01:00:37.055795: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 01:00:37.055899: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 01:00:37.055921: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 01:00:37.055943: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 01:00:37.055964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 01:00:37.055988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 01:00:37.056012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 01:00:37.056037: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 01:00:37.057294: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 01:00:37.058697: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 01:00:37.058759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 01:00:37.058779: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 01:00:37.058796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 01:00:37.058813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 01:00:37.058830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 01:00:37.058847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 01:00:37.058865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 01:00:37.060011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 01:00:37.060047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 01:00:37.060057: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 01:00:37.060065: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 01:00:37.061115: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5103 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-14 01:00:51.622940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 01:00:52.002956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 01:00:53.719935: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:53.720646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.522481: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-14 01:00:54.603121: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.603211: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.604455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.604485: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.611979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.612016: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.612746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.612761: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.643514: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.643548: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.643575: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-14 01:00:54.644284: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.644301: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.645003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.645019: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.652346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.652366: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.653011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.653025: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.653677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.653691: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-14 01:00:54.654333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.662144: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.662794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.684918: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.685819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.686826: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.687765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.691948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.692594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.693236: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.693901: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.695462: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.705234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.705881: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.717501: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.718154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.718867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.719573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.720228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-14 01:00:54.721008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 79 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 67 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 63 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 79 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 94 Detection mask done ! Trying to reset tf kernel 2433710 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3194 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4387 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0016024112701416016 nb_pixel_total : 29168 time to create 1 rle with old method : 0.03842639923095703 length of segment : 215 time for calcul the mask position with numpy : 0.0017209053039550781 nb_pixel_total : 24152 time to create 1 rle with old method : 0.027131319046020508 length of segment : 187 time for calcul the mask position with numpy : 0.002754688262939453 nb_pixel_total : 44344 time to create 1 rle with old method : 0.04812002182006836 length of segment : 275 time for calcul the mask position with numpy : 0.0007758140563964844 nb_pixel_total : 18115 time to create 1 rle with old method : 0.019405126571655273 length of segment : 242 time for calcul the mask position with numpy : 0.0003116130828857422 nb_pixel_total : 12579 time to create 1 rle with old method : 0.01390385627746582 length of segment : 157 time for calcul the mask position with numpy : 0.0008816719055175781 nb_pixel_total : 11951 time to create 1 rle with old method : 0.013146400451660156 length of segment : 138 time for calcul the mask position with numpy : 0.0006804466247558594 nb_pixel_total : 13411 time to create 1 rle with old method : 0.015325546264648438 length of segment : 117 time for calcul the mask position with numpy : 0.003972768783569336 nb_pixel_total : 68017 time to create 1 rle with old method : 0.07224273681640625 length of segment : 387 time for calcul the mask position with numpy : 0.0018012523651123047 nb_pixel_total : 41683 time to create 1 rle with old method : 0.04890871047973633 length of segment : 284 time for calcul the mask position with numpy : 0.00035309791564941406 nb_pixel_total : 12023 time to create 1 rle with old method : 0.013222455978393555 length of segment : 205 time for calcul the mask position with numpy : 0.0013196468353271484 nb_pixel_total : 22465 time to create 1 rle with old method : 0.024415254592895508 length of segment : 150 time for calcul the mask position with numpy : 0.0010683536529541016 nb_pixel_total : 43697 time to create 1 rle with old method : 0.049443721771240234 length of segment : 214 time for calcul the mask position with numpy : 0.00039649009704589844 nb_pixel_total : 11701 time to create 1 rle with old method : 0.019001007080078125 length of segment : 149 time for calcul the mask position with numpy : 0.0017552375793457031 nb_pixel_total : 11590 time to create 1 rle with old method : 0.015155553817749023 length of segment : 234 time for calcul the mask position with numpy : 0.000766754150390625 nb_pixel_total : 14829 time to create 1 rle with old method : 0.01637411117553711 length of segment : 206 time for calcul the mask position with numpy : 0.0006890296936035156 nb_pixel_total : 9078 time to create 1 rle with old method : 0.010470151901245117 length of segment : 124 time for calcul the mask position with numpy : 0.0004303455352783203 nb_pixel_total : 16790 time to create 1 rle with old method : 0.018761157989501953 length of segment : 163 time for calcul the mask position with numpy : 0.0015492439270019531 nb_pixel_total : 27331 time to create 1 rle with old method : 0.02911972999572754 length of segment : 327 time for calcul the mask position with numpy : 0.0003974437713623047 nb_pixel_total : 17007 time to create 1 rle with old method : 0.018648386001586914 length of segment : 174 time for calcul the mask position with numpy : 0.0011837482452392578 nb_pixel_total : 23307 time to create 1 rle with old method : 0.02933502197265625 length of segment : 210 time for calcul the mask position with numpy : 0.0006000995635986328 nb_pixel_total : 10103 time to create 1 rle with old method : 0.011248588562011719 length of segment : 139 time for calcul the mask position with numpy : 0.0008242130279541016 nb_pixel_total : 33452 time to create 1 rle with old method : 0.03614091873168945 length of segment : 222 time for calcul the mask position with numpy : 0.000843048095703125 nb_pixel_total : 37099 time to create 1 rle with old method : 0.042708396911621094 length of segment : 220 time for calcul the mask position with numpy : 0.0014734268188476562 nb_pixel_total : 32860 time to create 1 rle with old method : 0.03568601608276367 length of segment : 332 time for calcul the mask position with numpy : 0.0002551078796386719 nb_pixel_total : 12222 time to create 1 rle with old method : 0.013117551803588867 length of segment : 135 time for calcul the mask position with numpy : 0.00043892860412597656 nb_pixel_total : 16718 time to create 1 rle with old method : 0.01817941665649414 length of segment : 181 time for calcul the mask position with numpy : 0.00046372413635253906 nb_pixel_total : 17193 time to create 1 rle with old method : 0.018712520599365234 length of segment : 158 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 5616 time to create 1 rle with old method : 0.006273508071899414 length of segment : 90 time for calcul the mask position with numpy : 0.0004048347473144531 nb_pixel_total : 5125 time to create 1 rle with old method : 0.005682468414306641 length of segment : 85 time for calcul the mask position with numpy : 0.0003139972686767578 nb_pixel_total : 12316 time to create 1 rle with old method : 0.013192415237426758 length of segment : 130 time for calcul the mask position with numpy : 0.0005223751068115234 nb_pixel_total : 7461 time to create 1 rle with old method : 0.008181571960449219 length of segment : 96 time for calcul the mask position with numpy : 0.0006620883941650391 nb_pixel_total : 11138 time to create 1 rle with old method : 0.012473583221435547 length of segment : 167 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 4608 time to create 1 rle with old method : 0.005178928375244141 length of segment : 71 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 9283 time to create 1 rle with old method : 0.010144948959350586 length of segment : 141 time for calcul the mask position with numpy : 0.0013463497161865234 nb_pixel_total : 18483 time to create 1 rle with old method : 0.024532079696655273 length of segment : 186 time for calcul the mask position with numpy : 0.0005049705505371094 nb_pixel_total : 9448 time to create 1 rle with old method : 0.01088094711303711 length of segment : 113 time for calcul the mask position with numpy : 0.0006103515625 nb_pixel_total : 20028 time to create 1 rle with old method : 0.022388458251953125 length of segment : 233 time for calcul the mask position with numpy : 0.003189563751220703 nb_pixel_total : 69560 time to create 1 rle with old method : 0.07469630241394043 length of segment : 399 time for calcul the mask position with numpy : 0.005426168441772461 nb_pixel_total : 77082 time to create 1 rle with old method : 0.08276176452636719 length of segment : 325 time for calcul the mask position with numpy : 0.0018963813781738281 nb_pixel_total : 76202 time to create 1 rle with old method : 0.08275961875915527 length of segment : 384 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 12024 time to create 1 rle with old method : 0.01323246955871582 length of segment : 164 time for calcul the mask position with numpy : 0.0006196498870849609 nb_pixel_total : 6955 time to create 1 rle with old method : 0.008028507232666016 length of segment : 135 time for calcul the mask position with numpy : 0.00020551681518554688 nb_pixel_total : 7338 time to create 1 rle with old method : 0.008388996124267578 length of segment : 97 time for calcul the mask position with numpy : 0.0009315013885498047 nb_pixel_total : 32453 time to create 1 rle with old method : 0.03464674949645996 length of segment : 316 time for calcul the mask position with numpy : 0.00061798095703125 nb_pixel_total : 9320 time to create 1 rle with old method : 0.010100126266479492 length of segment : 171 time for calcul the mask position with numpy : 0.0005691051483154297 nb_pixel_total : 9185 time to create 1 rle with old method : 0.009903430938720703 length of segment : 184 time for calcul the mask position with numpy : 0.0007891654968261719 nb_pixel_total : 12610 time to create 1 rle with old method : 0.01401972770690918 length of segment : 120 time for calcul the mask position with numpy : 0.0015499591827392578 nb_pixel_total : 69426 time to create 1 rle with old method : 0.07304668426513672 length of segment : 458 time for calcul the mask position with numpy : 0.003280162811279297 nb_pixel_total : 90803 time to create 1 rle with old method : 0.09644317626953125 length of segment : 466 time for calcul the mask position with numpy : 0.0028421878814697266 nb_pixel_total : 121741 time to create 1 rle with old method : 0.13038086891174316 length of segment : 398 time for calcul the mask position with numpy : 0.0008060932159423828 nb_pixel_total : 36771 time to create 1 rle with old method : 0.03934764862060547 length of segment : 339 time for calcul the mask position with numpy : 0.0003199577331542969 nb_pixel_total : 9450 time to create 1 rle with old method : 0.010356664657592773 length of segment : 225 time for calcul the mask position with numpy : 0.0008630752563476562 nb_pixel_total : 27701 time to create 1 rle with old method : 0.03171825408935547 length of segment : 328 time for calcul the mask position with numpy : 0.00022649765014648438 nb_pixel_total : 10450 time to create 1 rle with old method : 0.01172947883605957 length of segment : 80 time for calcul the mask position with numpy : 0.002408266067504883 nb_pixel_total : 104499 time to create 1 rle with old method : 0.1130516529083252 length of segment : 333 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 3137 time to create 1 rle with old method : 0.0035948753356933594 length of segment : 93 time for calcul the mask position with numpy : 0.00038361549377441406 nb_pixel_total : 18146 time to create 1 rle with old method : 0.020270347595214844 length of segment : 167 time for calcul the mask position with numpy : 0.0008759498596191406 nb_pixel_total : 23019 time to create 1 rle with old method : 0.025894641876220703 length of segment : 140 time for calcul the mask position with numpy : 0.0003540515899658203 nb_pixel_total : 8205 time to create 1 rle with old method : 0.009365320205688477 length of segment : 139 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 4096 time to create 1 rle with old method : 0.004614830017089844 length of segment : 121 time for calcul the mask position with numpy : 0.0006909370422363281 nb_pixel_total : 38273 time to create 1 rle with old method : 0.0414881706237793 length of segment : 250 time for calcul the mask position with numpy : 0.0008676052093505859 nb_pixel_total : 44291 time to create 1 rle with old method : 0.048766374588012695 length of segment : 311 time for calcul the mask position with numpy : 0.0007154941558837891 nb_pixel_total : 33856 time to create 1 rle with old method : 0.037062883377075195 length of segment : 261 time for calcul the mask position with numpy : 0.0013322830200195312 nb_pixel_total : 66816 time to create 1 rle with old method : 0.07594680786132812 length of segment : 242 time for calcul the mask position with numpy : 0.00022292137145996094 nb_pixel_total : 5463 time to create 1 rle with old method : 0.006391286849975586 length of segment : 119 time for calcul the mask position with numpy : 0.0004801750183105469 nb_pixel_total : 19089 time to create 1 rle with old method : 0.0216524600982666 length of segment : 187 time for calcul the mask position with numpy : 0.0020742416381835938 nb_pixel_total : 36820 time to create 1 rle with old method : 0.04086637496948242 length of segment : 472 time for calcul the mask position with numpy : 0.00044846534729003906 nb_pixel_total : 14968 time to create 1 rle with old method : 0.01710224151611328 length of segment : 130 time for calcul the mask position with numpy : 0.0007627010345458984 nb_pixel_total : 39085 time to create 1 rle with old method : 0.04187321662902832 length of segment : 297 time for calcul the mask position with numpy : 0.00023555755615234375 nb_pixel_total : 11793 time to create 1 rle with old method : 0.013002157211303711 length of segment : 140 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 9385 time to create 1 rle with old method : 0.010850667953491211 length of segment : 131 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 11198 time to create 1 rle with old method : 0.0123138427734375 length of segment : 126 time for calcul the mask position with numpy : 0.0036051273345947266 nb_pixel_total : 143928 time to create 1 rle with old method : 0.1575932502746582 length of segment : 541 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 4433 time to create 1 rle with old method : 0.004827260971069336 length of segment : 142 time for calcul the mask position with numpy : 0.0003590583801269531 nb_pixel_total : 16729 time to create 1 rle with old method : 0.018223285675048828 length of segment : 137 time for calcul the mask position with numpy : 0.0003299713134765625 nb_pixel_total : 13528 time to create 1 rle with old method : 0.014886856079101562 length of segment : 194 time for calcul the mask position with numpy : 0.0003592967987060547 nb_pixel_total : 16604 time to create 1 rle with old method : 0.018758773803710938 length of segment : 136 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 1698 time to create 1 rle with old method : 0.001970529556274414 length of segment : 52 time for calcul the mask position with numpy : 0.0006954669952392578 nb_pixel_total : 26438 time to create 1 rle with old method : 0.029398679733276367 length of segment : 180 time for calcul the mask position with numpy : 0.0004336833953857422 nb_pixel_total : 19335 time to create 1 rle with old method : 0.025501012802124023 length of segment : 149 time for calcul the mask position with numpy : 0.002267122268676758 nb_pixel_total : 80876 time to create 1 rle with old method : 0.1023092269897461 length of segment : 290 time for calcul the mask position with numpy : 0.0014145374298095703 nb_pixel_total : 40270 time to create 1 rle with old method : 0.048900604248046875 length of segment : 217 time for calcul the mask position with numpy : 0.0004894733428955078 nb_pixel_total : 16169 time to create 1 rle with old method : 0.020949125289916992 length of segment : 161 time for calcul the mask position with numpy : 0.0013358592987060547 nb_pixel_total : 66308 time to create 1 rle with old method : 0.07590341567993164 length of segment : 263 time for calcul the mask position with numpy : 0.0005621910095214844 nb_pixel_total : 17385 time to create 1 rle with old method : 0.019114971160888672 length of segment : 266 time for calcul the mask position with numpy : 0.003545999526977539 nb_pixel_total : 206130 time to create 1 rle with new method : 0.012224197387695312 length of segment : 420 time for calcul the mask position with numpy : 0.0012497901916503906 nb_pixel_total : 42764 time to create 1 rle with old method : 0.04966282844543457 length of segment : 311 time for calcul the mask position with numpy : 0.00027108192443847656 nb_pixel_total : 10326 time to create 1 rle with old method : 0.013573646545410156 length of segment : 122 time for calcul the mask position with numpy : 0.0018897056579589844 nb_pixel_total : 78545 time to create 1 rle with old method : 0.09765791893005371 length of segment : 476 time for calcul the mask position with numpy : 0.0003821849822998047 nb_pixel_total : 13232 time to create 1 rle with old method : 0.017596721649169922 length of segment : 114 time for calcul the mask position with numpy : 0.0015048980712890625 nb_pixel_total : 71999 time to create 1 rle with old method : 0.0953226089477539 length of segment : 275 time for calcul the mask position with numpy : 0.000598907470703125 nb_pixel_total : 11506 time to create 1 rle with old method : 0.014409542083740234 length of segment : 117 time for calcul the mask position with numpy : 0.0006949901580810547 nb_pixel_total : 8830 time to create 1 rle with old method : 0.01070094108581543 length of segment : 138 time for calcul the mask position with numpy : 0.0015370845794677734 nb_pixel_total : 60208 time to create 1 rle with old method : 0.06555676460266113 length of segment : 239 time for calcul the mask position with numpy : 0.002564668655395508 nb_pixel_total : 51954 time to create 1 rle with old method : 0.06392049789428711 length of segment : 347 time for calcul the mask position with numpy : 0.0012521743774414062 nb_pixel_total : 25461 time to create 1 rle with old method : 0.02815103530883789 length of segment : 262 time for calcul the mask position with numpy : 0.0011639595031738281 nb_pixel_total : 30059 time to create 1 rle with old method : 0.03267788887023926 length of segment : 240 time for calcul the mask position with numpy : 0.0014929771423339844 nb_pixel_total : 62480 time to create 1 rle with old method : 0.06688666343688965 length of segment : 311 time for calcul the mask position with numpy : 0.0019338130950927734 nb_pixel_total : 74088 time to create 1 rle with old method : 0.07654929161071777 length of segment : 321 time for calcul the mask position with numpy : 0.0022106170654296875 nb_pixel_total : 73007 time to create 1 rle with old method : 0.0866093635559082 length of segment : 399 time for calcul the mask position with numpy : 0.00026607513427734375 nb_pixel_total : 4165 time to create 1 rle with old method : 0.00478053092956543 length of segment : 93 time for calcul the mask position with numpy : 0.0011637210845947266 nb_pixel_total : 28982 time to create 1 rle with old method : 0.03862595558166504 length of segment : 272 time for calcul the mask position with numpy : 0.010137557983398438 nb_pixel_total : 259336 time to create 1 rle with new method : 0.017822742462158203 length of segment : 632 time for calcul the mask position with numpy : 0.0006890296936035156 nb_pixel_total : 30573 time to create 1 rle with old method : 0.03328418731689453 length of segment : 203 time for calcul the mask position with numpy : 0.0006785392761230469 nb_pixel_total : 9034 time to create 1 rle with old method : 0.010504722595214844 length of segment : 180 time for calcul the mask position with numpy : 0.0028839111328125 nb_pixel_total : 53902 time to create 1 rle with old method : 0.05769014358520508 length of segment : 319 time for calcul the mask position with numpy : 0.0015022754669189453 nb_pixel_total : 48605 time to create 1 rle with old method : 0.05638742446899414 length of segment : 384 time for calcul the mask position with numpy : 0.0008106231689453125 nb_pixel_total : 24555 time to create 1 rle with old method : 0.026639223098754883 length of segment : 147 time for calcul the mask position with numpy : 0.0030798912048339844 nb_pixel_total : 109067 time to create 1 rle with old method : 0.11306262016296387 length of segment : 571 time for calcul the mask position with numpy : 0.00032401084899902344 nb_pixel_total : 5028 time to create 1 rle with old method : 0.005561351776123047 length of segment : 114 time for calcul the mask position with numpy : 0.0003368854522705078 nb_pixel_total : 6942 time to create 1 rle with old method : 0.007256746292114258 length of segment : 114 time for calcul the mask position with numpy : 0.002317190170288086 nb_pixel_total : 73579 time to create 1 rle with old method : 0.07700490951538086 length of segment : 374 time for calcul the mask position with numpy : 0.0015087127685546875 nb_pixel_total : 47367 time to create 1 rle with old method : 0.05075478553771973 length of segment : 295 time for calcul the mask position with numpy : 0.003655672073364258 nb_pixel_total : 99704 time to create 1 rle with old method : 0.10551762580871582 length of segment : 420 time for calcul the mask position with numpy : 0.0188901424407959 nb_pixel_total : 185648 time to create 1 rle with new method : 0.13760113716125488 length of segment : 1163 time for calcul the mask position with numpy : 0.0008969306945800781 nb_pixel_total : 18756 time to create 1 rle with old method : 0.02262139320373535 length of segment : 146 time for calcul the mask position with numpy : 0.0017960071563720703 nb_pixel_total : 72557 time to create 1 rle with old method : 0.08024954795837402 length of segment : 307 time for calcul the mask position with numpy : 0.0009427070617675781 nb_pixel_total : 12962 time to create 1 rle with old method : 0.014460086822509766 length of segment : 215 time for calcul the mask position with numpy : 0.0015993118286132812 nb_pixel_total : 56599 time to create 1 rle with old method : 0.06361818313598633 length of segment : 347 time for calcul the mask position with numpy : 0.0013232231140136719 nb_pixel_total : 36509 time to create 1 rle with old method : 0.0408782958984375 length of segment : 224 time for calcul the mask position with numpy : 0.004581928253173828 nb_pixel_total : 145800 time to create 1 rle with old method : 0.21004509925842285 length of segment : 611 time for calcul the mask position with numpy : 0.0014395713806152344 nb_pixel_total : 20534 time to create 1 rle with old method : 0.03309917449951172 length of segment : 177 time for calcul the mask position with numpy : 0.002809286117553711 nb_pixel_total : 78839 time to create 1 rle with old method : 0.08681154251098633 length of segment : 267 time for calcul the mask position with numpy : 0.0010077953338623047 nb_pixel_total : 21552 time to create 1 rle with old method : 0.02509021759033203 length of segment : 182 time for calcul the mask position with numpy : 0.0007855892181396484 nb_pixel_total : 13506 time to create 1 rle with old method : 0.015153884887695312 length of segment : 163 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 4325 time to create 1 rle with old method : 0.005397319793701172 length of segment : 56 time for calcul the mask position with numpy : 0.0014545917510986328 nb_pixel_total : 36898 time to create 1 rle with old method : 0.04033041000366211 length of segment : 250 time for calcul the mask position with numpy : 0.0020394325256347656 nb_pixel_total : 56680 time to create 1 rle with old method : 0.06216073036193848 length of segment : 271 time for calcul the mask position with numpy : 0.005083560943603516 nb_pixel_total : 40178 time to create 1 rle with old method : 0.044542551040649414 length of segment : 367 time for calcul the mask position with numpy : 0.0004086494445800781 nb_pixel_total : 9947 time to create 1 rle with old method : 0.011395454406738281 length of segment : 81 time for calcul the mask position with numpy : 0.0009639263153076172 nb_pixel_total : 26844 time to create 1 rle with old method : 0.029529571533203125 length of segment : 233 time for calcul the mask position with numpy : 0.001514434814453125 nb_pixel_total : 38499 time to create 1 rle with old method : 0.04269814491271973 length of segment : 248 time for calcul the mask position with numpy : 0.008047103881835938 nb_pixel_total : 222392 time to create 1 rle with new method : 0.0166323184967041 length of segment : 757 time for calcul the mask position with numpy : 0.0004687309265136719 nb_pixel_total : 12292 time to create 1 rle with old method : 0.013501405715942383 length of segment : 124 time for calcul the mask position with numpy : 0.0009055137634277344 nb_pixel_total : 37265 time to create 1 rle with old method : 0.03885602951049805 length of segment : 231 time for calcul the mask position with numpy : 0.0009219646453857422 nb_pixel_total : 20538 time to create 1 rle with old method : 0.022014379501342773 length of segment : 217 time for calcul the mask position with numpy : 0.0007205009460449219 nb_pixel_total : 18482 time to create 1 rle with old method : 0.0200803279876709 length of segment : 232 time for calcul the mask position with numpy : 0.0016036033630371094 nb_pixel_total : 49493 time to create 1 rle with old method : 0.05007052421569824 length of segment : 349 time for calcul the mask position with numpy : 0.001558065414428711 nb_pixel_total : 47127 time to create 1 rle with old method : 0.05079960823059082 length of segment : 221 time for calcul the mask position with numpy : 0.0026106834411621094 nb_pixel_total : 75450 time to create 1 rle with old method : 0.08248090744018555 length of segment : 292 time for calcul the mask position with numpy : 0.002405881881713867 nb_pixel_total : 63702 time to create 1 rle with old method : 0.06997919082641602 length of segment : 247 time for calcul the mask position with numpy : 0.0006604194641113281 nb_pixel_total : 25175 time to create 1 rle with old method : 0.02812933921813965 length of segment : 216 time for calcul the mask position with numpy : 0.0070116519927978516 nb_pixel_total : 376617 time to create 1 rle with new method : 0.02194809913635254 length of segment : 937 time for calcul the mask position with numpy : 0.005414724349975586 nb_pixel_total : 268174 time to create 1 rle with new method : 0.013859987258911133 length of segment : 683 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 13716 time to create 1 rle with old method : 0.015351533889770508 length of segment : 152 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 11696 time to create 1 rle with old method : 0.013050317764282227 length of segment : 127 time for calcul the mask position with numpy : 0.001409292221069336 nb_pixel_total : 74583 time to create 1 rle with old method : 0.08114457130432129 length of segment : 152 time for calcul the mask position with numpy : 0.0002715587615966797 nb_pixel_total : 13078 time to create 1 rle with old method : 0.014662027359008789 length of segment : 120 time for calcul the mask position with numpy : 0.0005929470062255859 nb_pixel_total : 13876 time to create 1 rle with old method : 0.016017675399780273 length of segment : 209 time for calcul the mask position with numpy : 0.0009644031524658203 nb_pixel_total : 15781 time to create 1 rle with old method : 0.017792701721191406 length of segment : 196 time for calcul the mask position with numpy : 0.0014982223510742188 nb_pixel_total : 27614 time to create 1 rle with old method : 0.030876636505126953 length of segment : 192 time for calcul the mask position with numpy : 0.0010831356048583984 nb_pixel_total : 17742 time to create 1 rle with old method : 0.01919245719909668 length of segment : 265 time for calcul the mask position with numpy : 0.0010647773742675781 nb_pixel_total : 16218 time to create 1 rle with old method : 0.017905235290527344 length of segment : 115 time for calcul the mask position with numpy : 0.0014700889587402344 nb_pixel_total : 33942 time to create 1 rle with old method : 0.03719663619995117 length of segment : 256 time for calcul the mask position with numpy : 0.0007665157318115234 nb_pixel_total : 14263 time to create 1 rle with old method : 0.016069650650024414 length of segment : 138 time for calcul the mask position with numpy : 0.0010409355163574219 nb_pixel_total : 16250 time to create 1 rle with old method : 0.018338918685913086 length of segment : 151 time for calcul the mask position with numpy : 0.00035572052001953125 nb_pixel_total : 5026 time to create 1 rle with old method : 0.005708217620849609 length of segment : 93 time for calcul the mask position with numpy : 0.0012879371643066406 nb_pixel_total : 24377 time to create 1 rle with old method : 0.02719712257385254 length of segment : 179 time for calcul the mask position with numpy : 0.0005507469177246094 nb_pixel_total : 12087 time to create 1 rle with old method : 0.013200521469116211 length of segment : 111 time for calcul the mask position with numpy : 0.0026094913482666016 nb_pixel_total : 37709 time to create 1 rle with old method : 0.06118130683898926 length of segment : 228 time for calcul the mask position with numpy : 0.0005435943603515625 nb_pixel_total : 6669 time to create 1 rle with old method : 0.00772547721862793 length of segment : 188 time for calcul the mask position with numpy : 0.0005681514739990234 nb_pixel_total : 9453 time to create 1 rle with old method : 0.010614633560180664 length of segment : 132 time for calcul the mask position with numpy : 0.00025773048400878906 nb_pixel_total : 10925 time to create 1 rle with old method : 0.012305736541748047 length of segment : 126 time for calcul the mask position with numpy : 0.0006866455078125 nb_pixel_total : 11376 time to create 1 rle with old method : 0.01312565803527832 length of segment : 126 time for calcul the mask position with numpy : 0.006113290786743164 nb_pixel_total : 154175 time to create 1 rle with new method : 0.0079345703125 length of segment : 482 time for calcul the mask position with numpy : 0.002262592315673828 nb_pixel_total : 42874 time to create 1 rle with old method : 0.047217369079589844 length of segment : 190 time for calcul the mask position with numpy : 0.0009758472442626953 nb_pixel_total : 11485 time to create 1 rle with old method : 0.013005256652832031 length of segment : 189 time for calcul the mask position with numpy : 0.0005311965942382812 nb_pixel_total : 9409 time to create 1 rle with old method : 0.011062383651733398 length of segment : 96 time for calcul the mask position with numpy : 0.0016300678253173828 nb_pixel_total : 26004 time to create 1 rle with old method : 0.028887510299682617 length of segment : 211 time for calcul the mask position with numpy : 0.015895843505859375 nb_pixel_total : 236587 time to create 1 rle with new method : 0.025150299072265625 length of segment : 736 time for calcul the mask position with numpy : 0.0018558502197265625 nb_pixel_total : 35603 time to create 1 rle with old method : 0.038425445556640625 length of segment : 231 time for calcul the mask position with numpy : 0.0005574226379394531 nb_pixel_total : 7830 time to create 1 rle with old method : 0.008898735046386719 length of segment : 103 time for calcul the mask position with numpy : 0.0003769397735595703 nb_pixel_total : 8655 time to create 1 rle with old method : 0.009588956832885742 length of segment : 87 time for calcul the mask position with numpy : 0.0005559921264648438 nb_pixel_total : 11505 time to create 1 rle with old method : 0.012677431106567383 length of segment : 118 time for calcul the mask position with numpy : 0.0003039836883544922 nb_pixel_total : 6780 time to create 1 rle with old method : 0.007339954376220703 length of segment : 109 time for calcul the mask position with numpy : 0.0019762516021728516 nb_pixel_total : 34952 time to create 1 rle with old method : 0.0385434627532959 length of segment : 447 time for calcul the mask position with numpy : 0.0023794174194335938 nb_pixel_total : 25938 time to create 1 rle with old method : 0.028832197189331055 length of segment : 207 time for calcul the mask position with numpy : 0.0007796287536621094 nb_pixel_total : 8204 time to create 1 rle with old method : 0.009340763092041016 length of segment : 122 time for calcul the mask position with numpy : 0.00042724609375 nb_pixel_total : 7524 time to create 1 rle with old method : 0.008893251419067383 length of segment : 88 time for calcul the mask position with numpy : 0.0024805068969726562 nb_pixel_total : 38866 time to create 1 rle with old method : 0.04282546043395996 length of segment : 395 time for calcul the mask position with numpy : 0.0007450580596923828 nb_pixel_total : 11708 time to create 1 rle with old method : 0.013994455337524414 length of segment : 117 time for calcul the mask position with numpy : 0.005799770355224609 nb_pixel_total : 115896 time to create 1 rle with old method : 0.1276698112487793 length of segment : 434 time for calcul the mask position with numpy : 0.0035829544067382812 nb_pixel_total : 62210 time to create 1 rle with old method : 0.06741905212402344 length of segment : 336 time for calcul the mask position with numpy : 0.0006430149078369141 nb_pixel_total : 7928 time to create 1 rle with old method : 0.009393692016601562 length of segment : 84 time for calcul the mask position with numpy : 0.001081705093383789 nb_pixel_total : 16181 time to create 1 rle with old method : 0.017997026443481445 length of segment : 202 time for calcul the mask position with numpy : 0.0022878646850585938 nb_pixel_total : 10934 time to create 1 rle with old method : 0.012382984161376953 length of segment : 200 time for calcul the mask position with numpy : 0.003058195114135742 nb_pixel_total : 35800 time to create 1 rle with old method : 0.03961658477783203 length of segment : 347 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 6542 time to create 1 rle with old method : 0.007498502731323242 length of segment : 86 time for calcul the mask position with numpy : 0.0017676353454589844 nb_pixel_total : 19586 time to create 1 rle with old method : 0.022495031356811523 length of segment : 154 time for calcul the mask position with numpy : 0.0010805130004882812 nb_pixel_total : 13459 time to create 1 rle with old method : 0.015332460403442383 length of segment : 169 time for calcul the mask position with numpy : 0.0007202625274658203 nb_pixel_total : 7882 time to create 1 rle with old method : 0.009055376052856445 length of segment : 82 time for calcul the mask position with numpy : 0.003922939300537109 nb_pixel_total : 78013 time to create 1 rle with old method : 0.08540892601013184 length of segment : 247 time for calcul the mask position with numpy : 0.0027976036071777344 nb_pixel_total : 52781 time to create 1 rle with old method : 0.05649447441101074 length of segment : 313 time for calcul the mask position with numpy : 0.0014424324035644531 nb_pixel_total : 20057 time to create 1 rle with old method : 0.021942853927612305 length of segment : 192 time for calcul the mask position with numpy : 0.0005559921264648438 nb_pixel_total : 5414 time to create 1 rle with old method : 0.006651878356933594 length of segment : 112 time for calcul the mask position with numpy : 0.0011718273162841797 nb_pixel_total : 11034 time to create 1 rle with old method : 0.015337228775024414 length of segment : 173 time for calcul the mask position with numpy : 0.001771688461303711 nb_pixel_total : 17319 time to create 1 rle with old method : 0.02375173568725586 length of segment : 179 time for calcul the mask position with numpy : 0.001931905746459961 nb_pixel_total : 29686 time to create 1 rle with old method : 0.032579660415649414 length of segment : 235 time for calcul the mask position with numpy : 0.0008075237274169922 nb_pixel_total : 8939 time to create 1 rle with old method : 0.010716915130615234 length of segment : 137 time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 7625 time to create 1 rle with old method : 0.008741378784179688 length of segment : 104 time for calcul the mask position with numpy : 0.006553173065185547 nb_pixel_total : 94656 time to create 1 rle with old method : 0.1019136905670166 length of segment : 430 time for calcul the mask position with numpy : 0.0013308525085449219 nb_pixel_total : 22868 time to create 1 rle with old method : 0.025370121002197266 length of segment : 151 time for calcul the mask position with numpy : 0.0015716552734375 nb_pixel_total : 21169 time to create 1 rle with old method : 0.023751258850097656 length of segment : 265 time for calcul the mask position with numpy : 0.0010073184967041016 nb_pixel_total : 26411 time to create 1 rle with old method : 0.02890300750732422 length of segment : 197 time for calcul the mask position with numpy : 0.001016378402709961 nb_pixel_total : 18798 time to create 1 rle with old method : 0.020594120025634766 length of segment : 135 time for calcul the mask position with numpy : 0.002828836441040039 nb_pixel_total : 32596 time to create 1 rle with old method : 0.03585553169250488 length of segment : 329 time for calcul the mask position with numpy : 0.002079010009765625 nb_pixel_total : 84189 time to create 1 rle with old method : 0.09166526794433594 length of segment : 365 time for calcul the mask position with numpy : 0.0018763542175292969 nb_pixel_total : 29009 time to create 1 rle with old method : 0.03346848487854004 length of segment : 293 time for calcul the mask position with numpy : 0.0013904571533203125 nb_pixel_total : 27203 time to create 1 rle with old method : 0.029497623443603516 length of segment : 213 time for calcul the mask position with numpy : 0.0010068416595458984 nb_pixel_total : 12340 time to create 1 rle with old method : 0.014246702194213867 length of segment : 147 time for calcul the mask position with numpy : 0.0011830329895019531 nb_pixel_total : 12591 time to create 1 rle with old method : 0.014264822006225586 length of segment : 242 time for calcul the mask position with numpy : 0.0009255409240722656 nb_pixel_total : 9417 time to create 1 rle with old method : 0.011008024215698242 length of segment : 171 time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 3766 time to create 1 rle with old method : 0.0044443607330322266 length of segment : 91 time for calcul the mask position with numpy : 0.0006439685821533203 nb_pixel_total : 9902 time to create 1 rle with old method : 0.011272907257080078 length of segment : 98 time for calcul the mask position with numpy : 0.0015673637390136719 nb_pixel_total : 18314 time to create 1 rle with old method : 0.020542144775390625 length of segment : 142 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 6202 time to create 1 rle with old method : 0.006902217864990234 length of segment : 95 time for calcul the mask position with numpy : 0.0018544197082519531 nb_pixel_total : 27041 time to create 1 rle with old method : 0.030334949493408203 length of segment : 206 time for calcul the mask position with numpy : 0.0017747879028320312 nb_pixel_total : 30406 time to create 1 rle with old method : 0.03308987617492676 length of segment : 247 time for calcul the mask position with numpy : 0.0018644332885742188 nb_pixel_total : 18742 time to create 1 rle with old method : 0.020442485809326172 length of segment : 203 time for calcul the mask position with numpy : 0.0011301040649414062 nb_pixel_total : 12049 time to create 1 rle with old method : 0.013370752334594727 length of segment : 163 time for calcul the mask position with numpy : 0.0015163421630859375 nb_pixel_total : 18626 time to create 1 rle with old method : 0.020876407623291016 length of segment : 248 time for calcul the mask position with numpy : 0.006391763687133789 nb_pixel_total : 70976 time to create 1 rle with old method : 0.07669782638549805 length of segment : 364 time for calcul the mask position with numpy : 0.0021653175354003906 nb_pixel_total : 26594 time to create 1 rle with old method : 0.028064966201782227 length of segment : 364 time for calcul the mask position with numpy : 0.0005955696105957031 nb_pixel_total : 12565 time to create 1 rle with old method : 0.013568878173828125 length of segment : 130 time for calcul the mask position with numpy : 0.0013039112091064453 nb_pixel_total : 18986 time to create 1 rle with old method : 0.021041393280029297 length of segment : 150 time for calcul the mask position with numpy : 0.0003185272216796875 nb_pixel_total : 6272 time to create 1 rle with old method : 0.007081031799316406 length of segment : 110 time for calcul the mask position with numpy : 0.0023131370544433594 nb_pixel_total : 31607 time to create 1 rle with old method : 0.03786945343017578 length of segment : 305 time for calcul the mask position with numpy : 0.005666255950927734 nb_pixel_total : 49397 time to create 1 rle with old method : 0.052867889404296875 length of segment : 292 time for calcul the mask position with numpy : 0.0008249282836914062 nb_pixel_total : 17855 time to create 1 rle with old method : 0.0199432373046875 length of segment : 163 time for calcul the mask position with numpy : 0.0011322498321533203 nb_pixel_total : 12583 time to create 1 rle with old method : 0.015873193740844727 length of segment : 148 time for calcul the mask position with numpy : 0.003178119659423828 nb_pixel_total : 28997 time to create 1 rle with old method : 0.03345751762390137 length of segment : 215 time for calcul the mask position with numpy : 0.0015180110931396484 nb_pixel_total : 25808 time to create 1 rle with old method : 0.029316425323486328 length of segment : 139 time for calcul the mask position with numpy : 0.001416921615600586 nb_pixel_total : 26028 time to create 1 rle with old method : 0.02856159210205078 length of segment : 164 time for calcul the mask position with numpy : 0.0008568763732910156 nb_pixel_total : 12235 time to create 1 rle with old method : 0.013556957244873047 length of segment : 118 time for calcul the mask position with numpy : 0.0008492469787597656 nb_pixel_total : 11548 time to create 1 rle with old method : 0.013284444808959961 length of segment : 272 time for calcul the mask position with numpy : 0.0013921260833740234 nb_pixel_total : 21660 time to create 1 rle with old method : 0.023792743682861328 length of segment : 227 time for calcul the mask position with numpy : 0.0019855499267578125 nb_pixel_total : 23787 time to create 1 rle with old method : 0.026323318481445312 length of segment : 221 time for calcul the mask position with numpy : 0.0016257762908935547 nb_pixel_total : 24520 time to create 1 rle with old method : 0.027591466903686523 length of segment : 183 time for calcul the mask position with numpy : 0.0019049644470214844 nb_pixel_total : 29143 time to create 1 rle with old method : 0.03202390670776367 length of segment : 154 time for calcul the mask position with numpy : 0.0011241436004638672 nb_pixel_total : 15468 time to create 1 rle with old method : 0.019125699996948242 length of segment : 233 time for calcul the mask position with numpy : 0.0005848407745361328 nb_pixel_total : 11846 time to create 1 rle with old method : 0.013042926788330078 length of segment : 111 time for calcul the mask position with numpy : 0.002557516098022461 nb_pixel_total : 32611 time to create 1 rle with old method : 0.035123348236083984 length of segment : 333 time for calcul the mask position with numpy : 0.001020669937133789 nb_pixel_total : 17299 time to create 1 rle with old method : 0.019071578979492188 length of segment : 159 time for calcul the mask position with numpy : 0.0021169185638427734 nb_pixel_total : 19895 time to create 1 rle with old method : 0.022369384765625 length of segment : 268 time for calcul the mask position with numpy : 0.004880189895629883 nb_pixel_total : 42818 time to create 1 rle with old method : 0.04496645927429199 length of segment : 392 time for calcul the mask position with numpy : 0.0025091171264648438 nb_pixel_total : 39766 time to create 1 rle with old method : 0.042952775955200195 length of segment : 173 time for calcul the mask position with numpy : 0.0009028911590576172 nb_pixel_total : 32310 time to create 1 rle with old method : 0.03504204750061035 length of segment : 277 time for calcul the mask position with numpy : 0.0034241676330566406 nb_pixel_total : 57845 time to create 1 rle with old method : 0.06283688545227051 length of segment : 280 time for calcul the mask position with numpy : 0.0014796257019042969 nb_pixel_total : 15604 time to create 1 rle with old method : 0.017171859741210938 length of segment : 131 time for calcul the mask position with numpy : 0.0009741783142089844 nb_pixel_total : 20076 time to create 1 rle with old method : 0.023142576217651367 length of segment : 190 time for calcul the mask position with numpy : 0.0021140575408935547 nb_pixel_total : 18607 time to create 1 rle with old method : 0.021147727966308594 length of segment : 182 time spent for convertir_results : 21.500035762786865 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 251 chid ids of type : 3594 Number RLEs to save : 57706 save missing photos in datou_result : time spend for datou_step_exec : 121.02402997016907 time spend to save output : 10.922625541687012 total time spend for step 1 : 131.94665551185608 step2:crop_condition Fri Feb 14 01:02:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 251 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 192 About to insert : list_path_to_insert length 192 new photo from crops ! About to upload 192 photos upload in portfolio : 3736932 init cache_photo without model_param we have 192 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739491397_2432784 we have uploaded 192 photos in the portfolio 3736932 time of upload the photos Elapsed time : 45.58267283439636 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3736932 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739491453_2432784 we have uploaded 39 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.318960189819336 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739491465_2432784 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6217868328094482 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739491472_2432784 we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.689810276031494 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739491476_2432784 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6742846965789795 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739491479_2432784 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9188592433929443 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337460307, 1337460295, 1337460291, 1337460274, 1337340465, 1337340462, 1337340458, 1337340285, 1337340283, 1337340282] Looping around the photos to save general results len do output : 251 /1337476153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337476449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460307', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460295', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460291', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460274', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340465', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340462', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340458', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340285', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340283', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340282', None, None, None, None, None, '2584393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 763 time used for this insertion : 1.1549956798553467 save_final save missing photos in datou_result : time spend for datou_step_exec : 114.44589447975159 time spend to save output : 1.1650309562683105 total time spend for step 2 : 115.6109254360199 step3:rle_unique_nms_with_priority Fri Feb 14 01:04:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 251 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 48 nb_hashtags : 2 time to prepare the origin masks : 3.4901599884033203 time for calcul the mask position with numpy : 1.6769132614135742 nb_pixel_total : 6029298 time to create 1 rle with new method : 0.5732378959655762 time for calcul the mask position with numpy : 0.029833078384399414 nb_pixel_total : 11951 time to create 1 rle with old method : 0.013467073440551758 time for calcul the mask position with numpy : 0.029561996459960938 nb_pixel_total : 13411 time to create 1 rle with old method : 0.014850616455078125 time for calcul the mask position with numpy : 0.02976059913635254 nb_pixel_total : 14829 time to create 1 rle with old method : 0.017745256423950195 time for calcul the mask position with numpy : 0.029561996459960938 nb_pixel_total : 44344 time to create 1 rle with old method : 0.04830598831176758 time for calcul the mask position with numpy : 0.028986454010009766 nb_pixel_total : 24152 time to create 1 rle with old method : 0.02669239044189453 time for calcul the mask position with numpy : 0.028995752334594727 nb_pixel_total : 32860 time to create 1 rle with old method : 0.03597378730773926 time for calcul the mask position with numpy : 0.02880692481994629 nb_pixel_total : 936 time to create 1 rle with old method : 0.0012617111206054688 time for calcul the mask position with numpy : 0.029087066650390625 nb_pixel_total : 7461 time to create 1 rle with old method : 0.008108139038085938 time for calcul the mask position with numpy : 0.028181076049804688 nb_pixel_total : 11590 time to create 1 rle with old method : 0.012753725051879883 time for calcul the mask position with numpy : 0.02832317352294922 nb_pixel_total : 10103 time to create 1 rle with old method : 0.011279106140136719 time for calcul the mask position with numpy : 0.02872014045715332 nb_pixel_total : 4608 time to create 1 rle with old method : 0.004878044128417969 time for calcul the mask position with numpy : 0.027359962463378906 nb_pixel_total : 6481 time to create 1 rle with old method : 0.0072095394134521484 time for calcul the mask position with numpy : 0.02752089500427246 nb_pixel_total : 68017 time to create 1 rle with old method : 0.07021021842956543 time for calcul the mask position with numpy : 0.02848982810974121 nb_pixel_total : 77082 time to create 1 rle with old method : 0.09044384956359863 time for calcul the mask position with numpy : 0.029100656509399414 nb_pixel_total : 23307 time to create 1 rle with old method : 0.026517152786254883 time for calcul the mask position with numpy : 0.029690027236938477 nb_pixel_total : 22465 time to create 1 rle with old method : 0.02403712272644043 time for calcul the mask position with numpy : 0.028373241424560547 nb_pixel_total : 5125 time to create 1 rle with old method : 0.005672931671142578 time for calcul the mask position with numpy : 0.028275489807128906 nb_pixel_total : 27331 time to create 1 rle with old method : 0.02923417091369629 time for calcul the mask position with numpy : 0.02842259407043457 nb_pixel_total : 9320 time to create 1 rle with old method : 0.010313987731933594 time for calcul the mask position with numpy : 0.029184341430664062 nb_pixel_total : 12610 time to create 1 rle with old method : 0.015603780746459961 time for calcul the mask position with numpy : 0.028496265411376953 nb_pixel_total : 9185 time to create 1 rle with old method : 0.010441780090332031 time for calcul the mask position with numpy : 0.028609514236450195 nb_pixel_total : 41683 time to create 1 rle with old method : 0.04458737373352051 time for calcul the mask position with numpy : 0.028599023818969727 nb_pixel_total : 11138 time to create 1 rle with old method : 0.01197361946105957 time for calcul the mask position with numpy : 0.02824091911315918 nb_pixel_total : 12024 time to create 1 rle with old method : 0.013423681259155273 time for calcul the mask position with numpy : 0.02830648422241211 nb_pixel_total : 3813 time to create 1 rle with old method : 0.0045452117919921875 time for calcul the mask position with numpy : 0.028550148010253906 nb_pixel_total : 69560 time to create 1 rle with old method : 0.07471561431884766 time for calcul the mask position with numpy : 0.02898263931274414 nb_pixel_total : 9078 time to create 1 rle with old method : 0.01027226448059082 time for calcul the mask position with numpy : 0.02870035171508789 nb_pixel_total : 9448 time to create 1 rle with old method : 0.010754585266113281 time for calcul the mask position with numpy : 0.028801679611206055 nb_pixel_total : 18483 time to create 1 rle with old method : 0.020914077758789062 time for calcul the mask position with numpy : 0.028682470321655273 nb_pixel_total : 18115 time to create 1 rle with old method : 0.019570350646972656 time for calcul the mask position with numpy : 0.029205799102783203 nb_pixel_total : 43697 time to create 1 rle with old method : 0.051259517669677734 time for calcul the mask position with numpy : 0.028714895248413086 nb_pixel_total : 11701 time to create 1 rle with old method : 0.013493061065673828 time for calcul the mask position with numpy : 0.028687000274658203 nb_pixel_total : 12316 time to create 1 rle with old method : 0.013682365417480469 time for calcul the mask position with numpy : 0.028900861740112305 nb_pixel_total : 76202 time to create 1 rle with old method : 0.08208036422729492 time for calcul the mask position with numpy : 0.028949975967407227 nb_pixel_total : 17007 time to create 1 rle with old method : 0.019126415252685547 time for calcul the mask position with numpy : 0.028871536254882812 nb_pixel_total : 5616 time to create 1 rle with old method : 0.006323099136352539 time for calcul the mask position with numpy : 0.028527498245239258 nb_pixel_total : 12222 time to create 1 rle with old method : 0.012933492660522461 time for calcul the mask position with numpy : 0.029794692993164062 nb_pixel_total : 37099 time to create 1 rle with old method : 0.04105877876281738 time for calcul the mask position with numpy : 0.028605937957763672 nb_pixel_total : 16790 time to create 1 rle with old method : 0.019055604934692383 time for calcul the mask position with numpy : 0.029786348342895508 nb_pixel_total : 16718 time to create 1 rle with old method : 0.018048524856567383 time for calcul the mask position with numpy : 0.0304257869720459 nb_pixel_total : 20028 time to create 1 rle with old method : 0.021993398666381836 time for calcul the mask position with numpy : 0.028235197067260742 nb_pixel_total : 7338 time to create 1 rle with old method : 0.007922172546386719 time for calcul the mask position with numpy : 0.028796911239624023 nb_pixel_total : 12023 time to create 1 rle with old method : 0.013132095336914062 time for calcul the mask position with numpy : 0.03290534019470215 nb_pixel_total : 33452 time to create 1 rle with old method : 0.03647160530090332 time for calcul the mask position with numpy : 0.029412269592285156 nb_pixel_total : 12579 time to create 1 rle with old method : 0.014125823974609375 time for calcul the mask position with numpy : 0.029333829879760742 nb_pixel_total : 29168 time to create 1 rle with old method : 0.031015396118164062 time for calcul the mask position with numpy : 0.02928948402404785 nb_pixel_total : 9283 time to create 1 rle with old method : 0.009942054748535156 time for calcul the mask position with numpy : 0.029669523239135742 nb_pixel_total : 17193 time to create 1 rle with old method : 0.01884603500366211 create new chi : 4.8044421672821045 time to delete rle : 0.015766143798828125 batch 1 Loaded 97 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 20465 TO DO : save crop sub photo not yet done ! save time : 4.393900632858276 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 11.084147930145264 time for calcul the mask position with numpy : 0.81064772605896 nb_pixel_total : 6303653 time to create 1 rle with new method : 0.6387546062469482 time for calcul the mask position with numpy : 0.03507804870605469 nb_pixel_total : 11793 time to create 1 rle with old method : 0.013559579849243164 time for calcul the mask position with numpy : 0.03485846519470215 nb_pixel_total : 39085 time to create 1 rle with old method : 0.046054840087890625 time for calcul the mask position with numpy : 0.032515525817871094 nb_pixel_total : 7193 time to create 1 rle with old method : 0.008285045623779297 time for calcul the mask position with numpy : 0.032737016677856445 nb_pixel_total : 22710 time to create 1 rle with old method : 0.02788066864013672 time for calcul the mask position with numpy : 0.024092912673950195 nb_pixel_total : 19089 time to create 1 rle with old method : 0.021979570388793945 time for calcul the mask position with numpy : 0.023494958877563477 nb_pixel_total : 5463 time to create 1 rle with old method : 0.006056070327758789 time for calcul the mask position with numpy : 0.02152705192565918 nb_pixel_total : 66816 time to create 1 rle with old method : 0.08352851867675781 time for calcul the mask position with numpy : 0.022310972213745117 nb_pixel_total : 33856 time to create 1 rle with old method : 0.03637242317199707 time for calcul the mask position with numpy : 0.022096633911132812 nb_pixel_total : 44291 time to create 1 rle with old method : 0.04781365394592285 time for calcul the mask position with numpy : 0.02199578285217285 nb_pixel_total : 38273 time to create 1 rle with old method : 0.041129112243652344 time for calcul the mask position with numpy : 0.0208437442779541 nb_pixel_total : 4096 time to create 1 rle with old method : 0.0043642520904541016 time for calcul the mask position with numpy : 0.021367549896240234 nb_pixel_total : 8205 time to create 1 rle with old method : 0.009218931198120117 time for calcul the mask position with numpy : 0.02006816864013672 nb_pixel_total : 23019 time to create 1 rle with old method : 0.024974584579467773 time for calcul the mask position with numpy : 0.02447199821472168 nb_pixel_total : 18146 time to create 1 rle with old method : 0.020085573196411133 time for calcul the mask position with numpy : 0.021424531936645508 nb_pixel_total : 3137 time to create 1 rle with old method : 0.0034286975860595703 time for calcul the mask position with numpy : 0.021368980407714844 nb_pixel_total : 104499 time to create 1 rle with old method : 0.11034250259399414 time for calcul the mask position with numpy : 0.0203092098236084 nb_pixel_total : 10450 time to create 1 rle with old method : 0.011280298233032227 time for calcul the mask position with numpy : 0.020437955856323242 nb_pixel_total : 27701 time to create 1 rle with old method : 0.02964925765991211 time for calcul the mask position with numpy : 0.02049732208251953 nb_pixel_total : 9450 time to create 1 rle with old method : 0.010818719863891602 time for calcul the mask position with numpy : 0.021571636199951172 nb_pixel_total : 36771 time to create 1 rle with old method : 0.04988384246826172 time for calcul the mask position with numpy : 0.02266716957092285 nb_pixel_total : 121741 time to create 1 rle with old method : 0.13601446151733398 time for calcul the mask position with numpy : 0.022651195526123047 nb_pixel_total : 90803 time to create 1 rle with old method : 0.10279202461242676 create new chi : 2.856832504272461 time to delete rle : 0.0016276836395263672 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 12225 TO DO : save crop sub photo not yet done ! save time : 1.7353203296661377 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 8.743966341018677 time for calcul the mask position with numpy : 1.2826898097991943 nb_pixel_total : 6142960 time to create 1 rle with new method : 1.3204662799835205 time for calcul the mask position with numpy : 0.021548032760620117 nb_pixel_total : 71999 time to create 1 rle with old method : 0.08124423027038574 time for calcul the mask position with numpy : 0.022371768951416016 nb_pixel_total : 13232 time to create 1 rle with old method : 0.015744686126708984 time for calcul the mask position with numpy : 0.023987531661987305 nb_pixel_total : 78545 time to create 1 rle with old method : 0.08649921417236328 time for calcul the mask position with numpy : 0.03580355644226074 nb_pixel_total : 10326 time to create 1 rle with old method : 0.011115550994873047 time for calcul the mask position with numpy : 0.03638720512390137 nb_pixel_total : 42764 time to create 1 rle with old method : 0.0463564395904541 time for calcul the mask position with numpy : 0.03738093376159668 nb_pixel_total : 206130 time to create 1 rle with new method : 0.9946348667144775 time for calcul the mask position with numpy : 0.024897098541259766 nb_pixel_total : 17385 time to create 1 rle with old method : 0.01951766014099121 time for calcul the mask position with numpy : 0.02254343032836914 nb_pixel_total : 66308 time to create 1 rle with old method : 0.07141494750976562 time for calcul the mask position with numpy : 0.02180337905883789 nb_pixel_total : 16169 time to create 1 rle with old method : 0.017878293991088867 time for calcul the mask position with numpy : 0.02222466468811035 nb_pixel_total : 40270 time to create 1 rle with old method : 0.04391813278198242 time for calcul the mask position with numpy : 0.023004531860351562 nb_pixel_total : 80876 time to create 1 rle with old method : 0.0871891975402832 time for calcul the mask position with numpy : 0.02252674102783203 nb_pixel_total : 19335 time to create 1 rle with old method : 0.02143263816833496 time for calcul the mask position with numpy : 0.02340221405029297 nb_pixel_total : 26438 time to create 1 rle with old method : 0.02845311164855957 time for calcul the mask position with numpy : 0.021825551986694336 nb_pixel_total : 1698 time to create 1 rle with old method : 0.0018558502197265625 time for calcul the mask position with numpy : 0.022373199462890625 nb_pixel_total : 16604 time to create 1 rle with old method : 0.018512248992919922 time for calcul the mask position with numpy : 0.022321462631225586 nb_pixel_total : 13528 time to create 1 rle with old method : 0.015052080154418945 time for calcul the mask position with numpy : 0.021780014038085938 nb_pixel_total : 16729 time to create 1 rle with old method : 0.018082618713378906 time for calcul the mask position with numpy : 0.022159099578857422 nb_pixel_total : 4433 time to create 1 rle with old method : 0.0050449371337890625 time for calcul the mask position with numpy : 0.022105932235717773 nb_pixel_total : 143928 time to create 1 rle with old method : 0.1798536777496338 time for calcul the mask position with numpy : 0.022354841232299805 nb_pixel_total : 11198 time to create 1 rle with old method : 0.012700080871582031 time for calcul the mask position with numpy : 0.02192378044128418 nb_pixel_total : 9385 time to create 1 rle with old method : 0.011625289916992188 create new chi : 4.971758127212524 time to delete rle : 0.002107381820678711 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 11566 TO DO : save crop sub photo not yet done ! save time : 0.778613805770874 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 9.748754978179932 time for calcul the mask position with numpy : 1.0685629844665527 nb_pixel_total : 6320570 time to create 1 rle with new method : 0.9925174713134766 time for calcul the mask position with numpy : 0.03523063659667969 nb_pixel_total : 9034 time to create 1 rle with old method : 0.010073423385620117 time for calcul the mask position with numpy : 0.035073041915893555 nb_pixel_total : 30573 time to create 1 rle with old method : 0.033066511154174805 time for calcul the mask position with numpy : 0.03714871406555176 nb_pixel_total : 259323 time to create 1 rle with new method : 0.8329024314880371 time for calcul the mask position with numpy : 0.03604531288146973 nb_pixel_total : 28982 time to create 1 rle with old method : 0.03200578689575195 time for calcul the mask position with numpy : 0.03642749786376953 nb_pixel_total : 4165 time to create 1 rle with old method : 0.004887580871582031 time for calcul the mask position with numpy : 0.03534388542175293 nb_pixel_total : 73007 time to create 1 rle with old method : 0.07904767990112305 time for calcul the mask position with numpy : 0.03611135482788086 nb_pixel_total : 74088 time to create 1 rle with old method : 0.07970070838928223 time for calcul the mask position with numpy : 0.03533816337585449 nb_pixel_total : 62480 time to create 1 rle with old method : 0.0677177906036377 time for calcul the mask position with numpy : 0.03481411933898926 nb_pixel_total : 30059 time to create 1 rle with old method : 0.03282666206359863 time for calcul the mask position with numpy : 0.035948991775512695 nb_pixel_total : 25461 time to create 1 rle with old method : 0.027581453323364258 time for calcul the mask position with numpy : 0.03618288040161133 nb_pixel_total : 51954 time to create 1 rle with old method : 0.05691671371459961 time for calcul the mask position with numpy : 0.03458762168884277 nb_pixel_total : 60208 time to create 1 rle with old method : 0.06734800338745117 time for calcul the mask position with numpy : 0.02406620979309082 nb_pixel_total : 8830 time to create 1 rle with old method : 0.010218143463134766 time for calcul the mask position with numpy : 0.020637035369873047 nb_pixel_total : 11506 time to create 1 rle with old method : 0.013115167617797852 create new chi : 3.9464192390441895 time to delete rle : 0.001421213150024414 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9654 TO DO : save crop sub photo not yet done ! save time : 1.3957500457763672 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 7.43878960609436 time for calcul the mask position with numpy : 0.3979978561401367 nb_pixel_total : 6052675 time to create 1 rle with new method : 0.6729152202606201 time for calcul the mask position with numpy : 0.03307509422302246 nb_pixel_total : 145800 time to create 1 rle with old method : 0.15631413459777832 time for calcul the mask position with numpy : 0.02232980728149414 nb_pixel_total : 36509 time to create 1 rle with old method : 0.03926205635070801 time for calcul the mask position with numpy : 0.02196335792541504 nb_pixel_total : 56599 time to create 1 rle with old method : 0.06064963340759277 time for calcul the mask position with numpy : 0.024004459381103516 nb_pixel_total : 12962 time to create 1 rle with old method : 0.014030933380126953 time for calcul the mask position with numpy : 0.022609949111938477 nb_pixel_total : 72557 time to create 1 rle with old method : 0.07851719856262207 time for calcul the mask position with numpy : 0.021251678466796875 nb_pixel_total : 18756 time to create 1 rle with old method : 0.020924806594848633 time for calcul the mask position with numpy : 0.02363896369934082 nb_pixel_total : 185648 time to create 1 rle with new method : 0.5218665599822998 time for calcul the mask position with numpy : 0.0229339599609375 nb_pixel_total : 99704 time to create 1 rle with old method : 0.10721659660339355 time for calcul the mask position with numpy : 0.021846294403076172 nb_pixel_total : 47367 time to create 1 rle with old method : 0.052184104919433594 time for calcul the mask position with numpy : 0.024076461791992188 nb_pixel_total : 73579 time to create 1 rle with old method : 0.07997727394104004 time for calcul the mask position with numpy : 0.02426886558532715 nb_pixel_total : 6942 time to create 1 rle with old method : 0.008150577545166016 time for calcul the mask position with numpy : 0.02274322509765625 nb_pixel_total : 5028 time to create 1 rle with old method : 0.006055355072021484 time for calcul the mask position with numpy : 0.025978803634643555 nb_pixel_total : 109052 time to create 1 rle with old method : 0.1267242431640625 time for calcul the mask position with numpy : 0.023006916046142578 nb_pixel_total : 24555 time to create 1 rle with old method : 0.027005910873413086 time for calcul the mask position with numpy : 0.02324676513671875 nb_pixel_total : 48605 time to create 1 rle with old method : 0.05909895896911621 time for calcul the mask position with numpy : 0.041912078857421875 nb_pixel_total : 53902 time to create 1 rle with old method : 0.06057333946228027 create new chi : 2.9535868167877197 time to delete rle : 0.0020759105682373047 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 13656 TO DO : save crop sub photo not yet done ! save time : 1.2945165634155273 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 9.695418119430542 time for calcul the mask position with numpy : 1.553086519241333 nb_pixel_total : 6130901 time to create 1 rle with new method : 2.976092576980591 time for calcul the mask position with numpy : 0.03767657279968262 nb_pixel_total : 25175 time to create 1 rle with old method : 0.027921438217163086 time for calcul the mask position with numpy : 0.03517913818359375 nb_pixel_total : 63702 time to create 1 rle with old method : 0.07084345817565918 time for calcul the mask position with numpy : 0.028730154037475586 nb_pixel_total : 75450 time to create 1 rle with old method : 0.08405399322509766 time for calcul the mask position with numpy : 0.02290034294128418 nb_pixel_total : 47127 time to create 1 rle with old method : 0.050398826599121094 time for calcul the mask position with numpy : 0.023049354553222656 nb_pixel_total : 49493 time to create 1 rle with old method : 0.0532994270324707 time for calcul the mask position with numpy : 0.02281641960144043 nb_pixel_total : 18482 time to create 1 rle with old method : 0.020168781280517578 time for calcul the mask position with numpy : 0.023447751998901367 nb_pixel_total : 20538 time to create 1 rle with old method : 0.02243804931640625 time for calcul the mask position with numpy : 0.023037195205688477 nb_pixel_total : 36886 time to create 1 rle with old method : 0.03997063636779785 time for calcul the mask position with numpy : 0.021526575088500977 nb_pixel_total : 12292 time to create 1 rle with old method : 0.014051198959350586 time for calcul the mask position with numpy : 0.022168636322021484 nb_pixel_total : 222392 time to create 1 rle with new method : 2.5951080322265625 time for calcul the mask position with numpy : 0.023766279220581055 nb_pixel_total : 38499 time to create 1 rle with old method : 0.04182577133178711 time for calcul the mask position with numpy : 0.02259087562561035 nb_pixel_total : 26844 time to create 1 rle with old method : 0.029326677322387695 time for calcul the mask position with numpy : 0.022616147994995117 nb_pixel_total : 9947 time to create 1 rle with old method : 0.011126518249511719 time for calcul the mask position with numpy : 0.022768735885620117 nb_pixel_total : 40178 time to create 1 rle with old method : 0.04458189010620117 time for calcul the mask position with numpy : 0.023241758346557617 nb_pixel_total : 56680 time to create 1 rle with old method : 0.06139945983886719 time for calcul the mask position with numpy : 0.02158212661743164 nb_pixel_total : 36898 time to create 1 rle with old method : 0.040184974670410156 time for calcul the mask position with numpy : 0.022433996200561523 nb_pixel_total : 4325 time to create 1 rle with old method : 0.004996061325073242 time for calcul the mask position with numpy : 0.024262428283691406 nb_pixel_total : 13506 time to create 1 rle with old method : 0.019439220428466797 time for calcul the mask position with numpy : 0.024667024612426758 nb_pixel_total : 21552 time to create 1 rle with old method : 0.03387141227722168 time for calcul the mask position with numpy : 0.02590799331665039 nb_pixel_total : 78839 time to create 1 rle with old method : 0.08524250984191895 time for calcul the mask position with numpy : 0.023203611373901367 nb_pixel_total : 20534 time to create 1 rle with old method : 0.02342367172241211 create new chi : 8.483695268630981 time to delete rle : 0.002135038375854492 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 12510 TO DO : save crop sub photo not yet done ! save time : 2.1388309001922607 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 16.27272605895996 time for calcul the mask position with numpy : 1.1353518962860107 nb_pixel_total : 6285828 time to create 1 rle with new method : 2.5341503620147705 time for calcul the mask position with numpy : 0.03548836708068848 nb_pixel_total : 13876 time to create 1 rle with old method : 0.015112161636352539 time for calcul the mask position with numpy : 0.026169776916503906 nb_pixel_total : 9175 time to create 1 rle with old method : 0.009998798370361328 time for calcul the mask position with numpy : 0.02221369743347168 nb_pixel_total : 74583 time to create 1 rle with old method : 0.08440637588500977 time for calcul the mask position with numpy : 0.022053003311157227 nb_pixel_total : 11696 time to create 1 rle with old method : 0.014087915420532227 time for calcul the mask position with numpy : 0.02272319793701172 nb_pixel_total : 10291 time to create 1 rle with old method : 0.011909246444702148 time for calcul the mask position with numpy : 0.0233151912689209 nb_pixel_total : 268174 time to create 1 rle with new method : 2.6542916297912598 time for calcul the mask position with numpy : 0.028308868408203125 nb_pixel_total : 376617 time to create 1 rle with new method : 9.745861530303955 create new chi : 16.474797248840332 time to delete rle : 0.0012488365173339844 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 6632 TO DO : save crop sub photo not yet done ! save time : 0.7823922634124756 nb_obj : 27 nb_hashtags : 4 time to prepare the origin masks : 3.4651265144348145 time for calcul the mask position with numpy : 0.5919697284698486 nb_pixel_total : 6225861 time to create 1 rle with new method : 2.9312405586242676 time for calcul the mask position with numpy : 0.0331721305847168 nb_pixel_total : 236587 time to create 1 rle with new method : 2.1934618949890137 time for calcul the mask position with numpy : 0.029175281524658203 nb_pixel_total : 9453 time to create 1 rle with old method : 0.010132074356079102 time for calcul the mask position with numpy : 0.030138254165649414 nb_pixel_total : 15781 time to create 1 rle with old method : 0.017621994018554688 time for calcul the mask position with numpy : 0.03070831298828125 nb_pixel_total : 154175 time to create 1 rle with new method : 0.3965914249420166 time for calcul the mask position with numpy : 0.028083324432373047 nb_pixel_total : 33942 time to create 1 rle with old method : 0.036933183670043945 time for calcul the mask position with numpy : 0.029485225677490234 nb_pixel_total : 9409 time to create 1 rle with old method : 0.010369539260864258 time for calcul the mask position with numpy : 0.029460668563842773 nb_pixel_total : 16218 time to create 1 rle with old method : 0.017567157745361328 time for calcul the mask position with numpy : 0.02941608428955078 nb_pixel_total : 27614 time to create 1 rle with old method : 0.029846906661987305 time for calcul the mask position with numpy : 0.028304338455200195 nb_pixel_total : 37709 time to create 1 rle with old method : 0.04064130783081055 time for calcul the mask position with numpy : 0.029102802276611328 nb_pixel_total : 14263 time to create 1 rle with old method : 0.01614999771118164 time for calcul the mask position with numpy : 0.028903484344482422 nb_pixel_total : 24377 time to create 1 rle with old method : 0.02650761604309082 time for calcul the mask position with numpy : 0.02892160415649414 nb_pixel_total : 17742 time to create 1 rle with old method : 0.025867223739624023 time for calcul the mask position with numpy : 0.03061366081237793 nb_pixel_total : 2618 time to create 1 rle with old method : 0.0031270980834960938 time for calcul the mask position with numpy : 0.029151201248168945 nb_pixel_total : 6780 time to create 1 rle with old method : 0.007677555084228516 time for calcul the mask position with numpy : 0.02894115447998047 nb_pixel_total : 8655 time to create 1 rle with old method : 0.009807109832763672 time for calcul the mask position with numpy : 0.029065847396850586 nb_pixel_total : 11485 time to create 1 rle with old method : 0.012752771377563477 time for calcul the mask position with numpy : 0.02812933921813965 nb_pixel_total : 35603 time to create 1 rle with old method : 0.03844046592712402 time for calcul the mask position with numpy : 0.029323101043701172 nb_pixel_total : 12087 time to create 1 rle with old method : 0.01382756233215332 time for calcul the mask position with numpy : 0.03162407875061035 nb_pixel_total : 26004 time to create 1 rle with old method : 0.04747343063354492 time for calcul the mask position with numpy : 0.03650331497192383 nb_pixel_total : 11376 time to create 1 rle with old method : 0.0209047794342041 time for calcul the mask position with numpy : 0.03554272651672363 nb_pixel_total : 7830 time to create 1 rle with old method : 0.008408069610595703 time for calcul the mask position with numpy : 0.02873706817626953 nb_pixel_total : 11505 time to create 1 rle with old method : 0.012940645217895508 time for calcul the mask position with numpy : 0.031159639358520508 nb_pixel_total : 6669 time to create 1 rle with old method : 0.0076634883880615234 time for calcul the mask position with numpy : 0.029755353927612305 nb_pixel_total : 42874 time to create 1 rle with old method : 0.046486854553222656 time for calcul the mask position with numpy : 0.02901458740234375 nb_pixel_total : 22347 time to create 1 rle with old method : 0.024706363677978516 time for calcul the mask position with numpy : 0.028557300567626953 nb_pixel_total : 16250 time to create 1 rle with old method : 0.019809246063232422 time for calcul the mask position with numpy : 0.029075145721435547 nb_pixel_total : 5026 time to create 1 rle with old method : 0.005609035491943359 create new chi : 7.51954984664917 time to delete rle : 0.0031626224517822266 batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 12844 TO DO : save crop sub photo not yet done ! save time : 2.0908849239349365 nb_obj : 37 nb_hashtags : 4 time to prepare the origin masks : 3.5626442432403564 time for calcul the mask position with numpy : 0.6916103363037109 nb_pixel_total : 6119358 time to create 1 rle with new method : 2.5814058780670166 time for calcul the mask position with numpy : 0.029539823532104492 nb_pixel_total : 7928 time to create 1 rle with old method : 0.00916910171508789 time for calcul the mask position with numpy : 0.02991461753845215 nb_pixel_total : 27203 time to create 1 rle with old method : 0.02968287467956543 time for calcul the mask position with numpy : 0.030420780181884766 nb_pixel_total : 10934 time to create 1 rle with old method : 0.012300252914428711 time for calcul the mask position with numpy : 0.03651022911071777 nb_pixel_total : 32596 time to create 1 rle with old method : 0.03589439392089844 time for calcul the mask position with numpy : 0.02986621856689453 nb_pixel_total : 9417 time to create 1 rle with old method : 0.01067042350769043 time for calcul the mask position with numpy : 0.029247760772705078 nb_pixel_total : 52781 time to create 1 rle with old method : 0.061156272888183594 time for calcul the mask position with numpy : 0.029625654220581055 nb_pixel_total : 18798 time to create 1 rle with old method : 0.021565914154052734 time for calcul the mask position with numpy : 0.029181957244873047 nb_pixel_total : 13459 time to create 1 rle with old method : 0.014957427978515625 time for calcul the mask position with numpy : 0.030132770538330078 nb_pixel_total : 35800 time to create 1 rle with old method : 0.042626142501831055 time for calcul the mask position with numpy : 0.029694795608520508 nb_pixel_total : 3766 time to create 1 rle with old method : 0.0042531490325927734 time for calcul the mask position with numpy : 0.030319690704345703 nb_pixel_total : 17319 time to create 1 rle with old method : 0.02047252655029297 time for calcul the mask position with numpy : 0.02909684181213379 nb_pixel_total : 7625 time to create 1 rle with old method : 0.008749246597290039 time for calcul the mask position with numpy : 0.029625654220581055 nb_pixel_total : 38866 time to create 1 rle with old method : 0.04315471649169922 time for calcul the mask position with numpy : 0.02934885025024414 nb_pixel_total : 11034 time to create 1 rle with old method : 0.01254582405090332 time for calcul the mask position with numpy : 0.028391361236572266 nb_pixel_total : 8204 time to create 1 rle with old method : 0.009101629257202148 time for calcul the mask position with numpy : 0.02907395362854004 nb_pixel_total : 5414 time to create 1 rle with old method : 0.006091117858886719 time for calcul the mask position with numpy : 0.029011964797973633 nb_pixel_total : 7524 time to create 1 rle with old method : 0.008642435073852539 time for calcul the mask position with numpy : 0.02915787696838379 nb_pixel_total : 12340 time to create 1 rle with old method : 0.013913393020629883 time for calcul the mask position with numpy : 0.028861522674560547 nb_pixel_total : 94656 time to create 1 rle with old method : 0.1002495288848877 time for calcul the mask position with numpy : 0.02953481674194336 nb_pixel_total : 115896 time to create 1 rle with old method : 0.12187457084655762 time for calcul the mask position with numpy : 0.02719426155090332 nb_pixel_total : 650 time to create 1 rle with old method : 0.001028299331665039 time for calcul the mask position with numpy : 0.028362035751342773 nb_pixel_total : 78013 time to create 1 rle with old method : 0.08720731735229492 time for calcul the mask position with numpy : 0.03170895576477051 nb_pixel_total : 62210 time to create 1 rle with old method : 0.0719292163848877 time for calcul the mask position with numpy : 0.029543399810791016 nb_pixel_total : 25938 time to create 1 rle with old method : 0.029846906661987305 time for calcul the mask position with numpy : 0.03217816352844238 nb_pixel_total : 8939 time to create 1 rle with old method : 0.01059722900390625 time for calcul the mask position with numpy : 0.029308319091796875 nb_pixel_total : 29009 time to create 1 rle with old method : 0.033554792404174805 time for calcul the mask position with numpy : 0.02944183349609375 nb_pixel_total : 20057 time to create 1 rle with old method : 0.02377772331237793 time for calcul the mask position with numpy : 0.03038763999938965 nb_pixel_total : 11708 time to create 1 rle with old method : 0.013524293899536133 time for calcul the mask position with numpy : 0.028662681579589844 nb_pixel_total : 6542 time to create 1 rle with old method : 0.007995843887329102 time for calcul the mask position with numpy : 0.029134511947631836 nb_pixel_total : 21169 time to create 1 rle with old method : 0.02473759651184082 time for calcul the mask position with numpy : 0.029517412185668945 nb_pixel_total : 19586 time to create 1 rle with old method : 0.022472858428955078 time for calcul the mask position with numpy : 0.029364824295043945 nb_pixel_total : 26411 time to create 1 rle with old method : 0.03272247314453125 time for calcul the mask position with numpy : 0.029550552368164062 nb_pixel_total : 29686 time to create 1 rle with old method : 0.03137993812561035 time for calcul the mask position with numpy : 0.029746055603027344 nb_pixel_total : 12473 time to create 1 rle with old method : 0.01703476905822754 time for calcul the mask position with numpy : 0.030751705169677734 nb_pixel_total : 16181 time to create 1 rle with old method : 0.01925063133239746 time for calcul the mask position with numpy : 0.028759479522705078 nb_pixel_total : 7882 time to create 1 rle with old method : 0.008827924728393555 time for calcul the mask position with numpy : 0.028494596481323242 nb_pixel_total : 22868 time to create 1 rle with old method : 0.024671554565429688 create new chi : 5.469405174255371 time to delete rle : 0.002562999725341797 batch 1 Loaded 75 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17044 TO DO : save crop sub photo not yet done ! save time : 2.720320701599121 nb_obj : 38 nb_hashtags : 2 time to prepare the origin masks : 3.4680416584014893 time for calcul the mask position with numpy : 0.3608126640319824 nb_pixel_total : 6173297 time to create 1 rle with new method : 0.7514488697052002 time for calcul the mask position with numpy : 0.029976606369018555 nb_pixel_total : 18626 time to create 1 rle with old method : 0.021619081497192383 time for calcul the mask position with numpy : 0.030063867568969727 nb_pixel_total : 18607 time to create 1 rle with old method : 0.02115035057067871 time for calcul the mask position with numpy : 0.03014540672302246 nb_pixel_total : 15604 time to create 1 rle with old method : 0.017284393310546875 time for calcul the mask position with numpy : 0.02983880043029785 nb_pixel_total : 12583 time to create 1 rle with old method : 0.014171838760375977 time for calcul the mask position with numpy : 0.029177188873291016 nb_pixel_total : 57845 time to create 1 rle with old method : 0.06437921524047852 time for calcul the mask position with numpy : 0.030675649642944336 nb_pixel_total : 18314 time to create 1 rle with old method : 0.020657777786254883 time for calcul the mask position with numpy : 0.029168128967285156 nb_pixel_total : 25808 time to create 1 rle with old method : 0.028345346450805664 time for calcul the mask position with numpy : 0.028690099716186523 nb_pixel_total : 23787 time to create 1 rle with old method : 0.03096151351928711 time for calcul the mask position with numpy : 0.029210329055786133 nb_pixel_total : 4175 time to create 1 rle with old method : 0.004804372787475586 time for calcul the mask position with numpy : 0.028814315795898438 nb_pixel_total : 6202 time to create 1 rle with old method : 0.006878376007080078 time for calcul the mask position with numpy : 0.028153181076049805 nb_pixel_total : 42818 time to create 1 rle with old method : 0.04581570625305176 time for calcul the mask position with numpy : 0.02875208854675293 nb_pixel_total : 5919 time to create 1 rle with old method : 0.006704092025756836 time for calcul the mask position with numpy : 0.02910637855529785 nb_pixel_total : 31607 time to create 1 rle with old method : 0.03426408767700195 time for calcul the mask position with numpy : 0.03113102912902832 nb_pixel_total : 70976 time to create 1 rle with old method : 0.07786297798156738 time for calcul the mask position with numpy : 0.02898406982421875 nb_pixel_total : 9902 time to create 1 rle with old method : 0.01127934455871582 time for calcul the mask position with numpy : 0.02917647361755371 nb_pixel_total : 18986 time to create 1 rle with old method : 0.020663022994995117 time for calcul the mask position with numpy : 0.02925586700439453 nb_pixel_total : 11843 time to create 1 rle with old method : 0.013398885726928711 time for calcul the mask position with numpy : 0.029157161712646484 nb_pixel_total : 11636 time to create 1 rle with old method : 0.013041257858276367 time for calcul the mask position with numpy : 0.02913069725036621 nb_pixel_total : 26594 time to create 1 rle with old method : 0.028689861297607422 time for calcul the mask position with numpy : 0.028937101364135742 nb_pixel_total : 12049 time to create 1 rle with old method : 0.018227577209472656 time for calcul the mask position with numpy : 0.02932596206665039 nb_pixel_total : 17285 time to create 1 rle with old method : 0.018451690673828125 time for calcul the mask position with numpy : 0.02891373634338379 nb_pixel_total : 21660 time to create 1 rle with old method : 0.024639129638671875 time for calcul the mask position with numpy : 0.032102346420288086 nb_pixel_total : 19895 time to create 1 rle with old method : 0.023477554321289062 time for calcul the mask position with numpy : 0.0293734073638916 nb_pixel_total : 30406 time to create 1 rle with old method : 0.03433084487915039 time for calcul the mask position with numpy : 0.029827117919921875 nb_pixel_total : 29143 time to create 1 rle with old method : 0.031542062759399414 time for calcul the mask position with numpy : 0.029767751693725586 nb_pixel_total : 18742 time to create 1 rle with old method : 0.020958662033081055 time for calcul the mask position with numpy : 0.030492067337036133 nb_pixel_total : 28997 time to create 1 rle with old method : 0.032532453536987305 time for calcul the mask position with numpy : 0.030291318893432617 nb_pixel_total : 26028 time to create 1 rle with old method : 0.029540061950683594 time for calcul the mask position with numpy : 0.029136180877685547 nb_pixel_total : 32611 time to create 1 rle with old method : 0.03774285316467285 time for calcul the mask position with numpy : 0.03231549263000488 nb_pixel_total : 3753 time to create 1 rle with old method : 0.0047266483306884766 time for calcul the mask position with numpy : 0.029183387756347656 nb_pixel_total : 24520 time to create 1 rle with old method : 0.026807308197021484 time for calcul the mask position with numpy : 0.03003978729248047 nb_pixel_total : 27041 time to create 1 rle with old method : 0.030935049057006836 time for calcul the mask position with numpy : 0.029477357864379883 nb_pixel_total : 17855 time to create 1 rle with old method : 0.021120548248291016 time for calcul the mask position with numpy : 0.0301969051361084 nb_pixel_total : 49397 time to create 1 rle with old method : 0.0537106990814209 time for calcul the mask position with numpy : 0.029348134994506836 nb_pixel_total : 15468 time to create 1 rle with old method : 0.017345190048217773 time for calcul the mask position with numpy : 0.028923511505126953 nb_pixel_total : 18260 time to create 1 rle with old method : 0.019590377807617188 time for calcul the mask position with numpy : 0.028528690338134766 nb_pixel_total : 39766 time to create 1 rle with old method : 0.044031381607055664 time for calcul the mask position with numpy : 0.029089689254760742 nb_pixel_total : 12235 time to create 1 rle with old method : 0.013316869735717773 create new chi : 3.2569692134857178 time to delete rle : 0.002866983413696289 batch 1 Loaded 77 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17106 TO DO : save crop sub photo not yet done ! save time : 2.262791395187378 map_output_result : {1337460307: (0.0, 'Should be the crop_list due to order', 0.0), 1337460295: (0.0, 'Should be the crop_list due to order', 0.0), 1337460291: (0.0, 'Should be the crop_list due to order', 0.0), 1337460274: (0.0, 'Should be the crop_list due to order', 0.0), 1337340465: (0.0, 'Should be the crop_list due to order', 0.0), 1337340462: (0.0, 'Should be the crop_list due to order', 0.0), 1337340458: (0.0, 'Should be the crop_list due to order', 0.0), 1337340285: (0.0, 'Should be the crop_list due to order', 0.0), 1337340283: (0.0, 'Should be the crop_list due to order', 0.0), 1337340282: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337460307, 1337460295, 1337460291, 1337460274, 1337340465, 1337340462, 1337340458, 1337340285, 1337340283, 1337340282] Looping around the photos to save general results len do output : 10 /1337460307.Didn't retrieve data . /1337460295.Didn't retrieve data . /1337460291.Didn't retrieve data . /1337460274.Didn't retrieve data . /1337340465.Didn't retrieve data . /1337340462.Didn't retrieve data . /1337340458.Didn't retrieve data . /1337340285.Didn't retrieve data . /1337340283.Didn't retrieve data . /1337340282.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460307', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460295', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460291', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460274', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340465', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340462', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340458', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340285', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340283', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340282', None, None, None, None, None, '2584393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.08655953407287598 save_final save missing photos in datou_result : time spend for datou_step_exec : 158.64444828033447 time spend to save output : 0.08727025985717773 total time spend for step 3 : 158.73171854019165 step4:ventilate_hashtags_in_portfolio Fri Feb 14 01:07:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20528871 get user id for portfolio 20528871 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528871 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','autre','pet_fonce','metal','mal_croppe','environnement','flou','background','pehd','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528871 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','autre','pet_fonce','metal','mal_croppe','environnement','flou','background','pehd','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528871 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','autre','pet_fonce','metal','mal_croppe','environnement','flou','background','pehd','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20531159,20531160,20531161,20531162,20531163,20531164,20531165,20531166,20531167,20531168,20531169?tags=pet_clair,carton,autre,pet_fonce,metal,mal_croppe,environnement,flou,background,pehd,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337460307, 1337460295, 1337460291, 1337460274, 1337340465, 1337340462, 1337340458, 1337340285, 1337340283, 1337340282] Looping around the photos to save general results len do output : 1 /20528871. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460307', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460295', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460291', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460274', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340465', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340462', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340458', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340285', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340283', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340282', None, None, None, None, None, '2584393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01863884925842285 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9835724830627441 time spend to save output : 0.0188753604888916 total time spend for step 4 : 2.0024478435516357 step5:final Fri Feb 14 01:07:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337460307: ('0.12365535073983296',), 1337460295: ('0.12365535073983296',), 1337460291: ('0.12365535073983296',), 1337460274: ('0.12365535073983296',), 1337340465: ('0.12365535073983296',), 1337340462: ('0.12365535073983296',), 1337340458: ('0.12365535073983296',), 1337340285: ('0.12365535073983296',), 1337340283: ('0.12365535073983296',), 1337340282: ('0.12365535073983296',)} new output for save of step final : {1337460307: ('0.12365535073983296',), 1337460295: ('0.12365535073983296',), 1337460291: ('0.12365535073983296',), 1337460274: ('0.12365535073983296',), 1337340465: ('0.12365535073983296',), 1337340462: ('0.12365535073983296',), 1337340458: ('0.12365535073983296',), 1337340285: ('0.12365535073983296',), 1337340283: ('0.12365535073983296',), 1337340282: ('0.12365535073983296',)} [1337460307, 1337460295, 1337460291, 1337460274, 1337340465, 1337340462, 1337340458, 1337340285, 1337340283, 1337340282] Looping around the photos to save general results len do output : 10 /1337460307.Didn't retrieve data . /1337460295.Didn't retrieve data . /1337460291.Didn't retrieve data . /1337460274.Didn't retrieve data . /1337340465.Didn't retrieve data . /1337340462.Didn't retrieve data . /1337340458.Didn't retrieve data . /1337340285.Didn't retrieve data . /1337340283.Didn't retrieve data . /1337340282.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460307', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460295', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460291', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460274', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340465', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340462', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340458', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340285', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340283', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340282', None, None, None, None, None, '2584393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.033124446868896484 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15377140045166016 time spend to save output : 0.03389143943786621 total time spend for step 5 : 0.18766283988952637 step6:blur_detection Fri Feb 14 01:07:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866.jpg resize: (2160, 3264) 1337460307 -5.395495003029587 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f.jpg resize: (2160, 3264) 1337460295 -5.2879533687880045 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52.jpg resize: (2160, 3264) 1337460291 -4.969720782941583 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4.jpg resize: (2160, 3264) 1337460274 -3.666814585439737 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8.jpg resize: (2160, 3264) 1337340465 -3.296695207442416 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa.jpg resize: (2160, 3264) 1337340462 -4.249108308997526 treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb.jpg resize: (2160, 3264) 1337340458 -3.3742672506215525 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83.jpg resize: (2160, 3264) 1337340285 -2.7874777328432523 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61.jpg resize: (2160, 3264) 1337340283 -4.380787355639817 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0.jpg resize: (2160, 3264) 1337340282 -4.740631851337783 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080063_0.png resize: (136, 141) 1337476153 -3.8608996649481058 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080044_0.png resize: (187, 254) 1337476154 -2.3962744495843054 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080089_0.png resize: (116, 162) 1337476157 -3.001279063481311 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080071_0.png resize: (85, 83) 1337476160 -3.49664016923554 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080074_0.png resize: (164, 89) 1337476162 -3.1517248434782807 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080088_0.png resize: (162, 94) 1337476166 -3.3046809469106364 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080072_0.png resize: (129, 127) 1337476168 -4.235331726893578 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080070_0.png resize: (80, 111) 1337476171 -3.472193172339834 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080069_0.png resize: (156, 187) 1337476173 -2.2553247595379196 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080061_0.png resize: (174, 146) 1337476175 -3.2979324905541256 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080058_0.png resize: (124, 125) 1337476176 -3.2654780256009546 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080055_0.png resize: (148, 160) 1337476177 -3.6357725236458647 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080068_0.png resize: (180, 122) 1337476178 -3.0748249076062177 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080067_0.png resize: (135, 116) 1337476179 -4.112205390437215 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080073_0.png resize: (96, 106) 1337476180 -1.7037019121320802 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080087_0.png resize: (164, 95) 1337476181 -2.3871393802633296 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080078_0.png resize: (113, 110) 1337476182 -3.519934476754973 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080052_0.png resize: (131, 142) 1337476183 -4.309635986833872 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080056_0.png resize: (207, 172) 1337476184 -3.324266305503887 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080065_0.png resize: (216, 244) 1337476185 -4.175480755378495 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080083_0.png resize: (164, 116) 1337476186 -2.6115020968783353 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080085_0.png resize: (90, 126) 1337476187 -3.4145183039955334 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080064_0.png resize: (215, 224) 1337476188 -2.7309469840119873 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080075_0.png resize: (71, 87) 1337476189 -0.8849410753812752 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080054_0.png resize: (185, 351) 1337476190 -4.404975709791904 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080060_0.png resize: (324, 113) 1337476191 -3.6774194247717693 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080059_0.png resize: (161, 194) 1337476192 -3.649185416890718 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080077_0.png resize: (174, 261) 1337476193 -3.746929576026807 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080081_0.png resize: (299, 489) 1337476194 -3.889601120229429 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080066_0.png resize: (307, 172) 1337476195 -3.8693316515413865 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080046_0.png resize: (242, 97) 1337476196 -1.4122789840637109 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080079_0.png resize: (178, 200) 1337476197 -2.8697124374054526 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080090_0.png resize: (354, 330) 1337476198 -4.516597564752687 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080076_0.png resize: (137, 91) 1337476199 -3.549409164858824 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080082_0.png resize: (384, 321) 1337476200 -2.406607101960301 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080053_0.png resize: (139, 212) 1337476201 -2.8606251925544184 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080051_0.png resize: (282, 180) 1337476202 -3.877790799195336 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080108_0.png resize: (184, 192) 1337476203 -2.6372829380793728 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080100_0.png resize: (138, 246) 1337476204 -3.017728924056356 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080110_0.png resize: (124, 158) 1337476205 -0.18835082627087069 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080096_0.png resize: (80, 186) 1337476206 -3.557052311506531 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080092_0.png resize: (381, 487) 1337476207 -2.1504353889730505 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080097_0.png resize: (253, 650) 1337476208 -4.001538072141273 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080102_0.png resize: (118, 61) 1337476209 -1.6358566293799224 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080109_0.png resize: (297, 365) 1337476210 -2.4154877209876093 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080093_0.png resize: (234, 271) 1337476211 -3.985259043736573 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080112_0.png resize: (114, 137) 1337476212 -2.5992909582288815 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080095_0.png resize: (195, 266) 1337476213 -3.529562788057164 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080104_0.png resize: (218, 335) 1337476214 -4.715366559972012 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080101_0.png resize: (138, 130) 1337476215 -3.630005627317402 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080098_0.png resize: (57, 82) 1337476216 -1.3160585967708793 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080107_0.png resize: (118, 65) 1337476217 -2.5605306740802534 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080094_0.png resize: (225, 63) 1337476218 -2.6771390596940505 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080103_0.png resize: (250, 214) 1337476219 -2.6187711610460007 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080126_0.png resize: (262, 377) 1337476220 -2.8369301378312852 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080130_0.png resize: (120, 119) 1337476221 -3.4971327138409802 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080114_0.png resize: (126, 119) 1337476222 -3.1306765415066367 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080113_0.png resize: (131, 93) 1337476223 -2.4533055954931404 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080118_0.png resize: (194, 98) 1337476224 -2.39908226082461 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080123_0.png resize: (287, 406) 1337476225 -4.751983875822948 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080128_0.png resize: (409, 668) 1337476226 -2.8713202035072567 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080129_0.png resize: (333, 225) 1337476227 -3.6079560250096905 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080121_0.png resize: (180, 275) 1337476228 -2.9807424152129096 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080119_0.png resize: (135, 201) 1337476229 -3.4944654726181144 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080115_0.png resize: (501, 414) 1337476230 -3.4197000670620885 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080122_0.png resize: (141, 187) 1337476231 -1.9646582568623823 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080117_0.png resize: (137, 154) 1337476232 -2.0167582320394093 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080132_0.png resize: (112, 157) 1337476233 -2.529355423509397 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080124_0.png resize: (215, 271) 1337476234 -3.4420593108454285 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080125_0.png resize: (119, 199) 1337476235 -3.617068920021432 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080127_0.png resize: (223, 122) 1337476236 -3.221472531614407 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080116_0.png resize: (142, 38) 1337476237 -3.265552815042922 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080135_0.png resize: (138, 344) 1337476238 -2.463451933705888 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080134_0.png resize: (117, 163) 1337476239 -2.765484672381302 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080144_0.png resize: (272, 169) 1337476240 -5.2270439080449735 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080138_0.png resize: (262, 267) 1337476241 -2.4146963522410703 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080139_0.png resize: (240, 278) 1337476242 -2.284269155167959 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080142_0.png resize: (332, 355) 1337476243 2.6466931423951676 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080147_0.png resize: (171, 195) 1337476244 -2.6038456709303364 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080149_0.png resize: (312, 244) 1337476245 -2.5580728632414034 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080161_0.png resize: (236, 331) 1337476246 -3.0928070854782543 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080155_0.png resize: (295, 242) 1337476248 -2.6548881141237604 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080153_0.png resize: (113, 89) 1337476249 -2.3471498434461124 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080151_0.png resize: (552, 343) 1337476250 -2.5888475129891764 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080150_0.png resize: (146, 219) 1337476251 -3.248035701674261 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080160_0.png resize: (215, 136) 1337476252 -2.6727898526990974 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080156_0.png resize: (276, 654) 1337476253 -0.8808658163888153 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080158_0.png resize: (144, 197) 1337476254 -2.8659907595181977 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080157_0.png resize: (1045, 1254) 1337476255 -0.91718141407746 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080154_0.png resize: (353, 376) 1337476256 -0.6245292557517691 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080148_0.png resize: (318, 276) 1337476257 -3.1422486518436252 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080173_0.png resize: (233, 152) 1337476258 -1.6954201956668533 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080174_0.png resize: (208, 293) 1337476259 -2.8752152403016975 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080176_0.png resize: (123, 156) 1337476260 -2.78668974477271 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080164_0.png resize: (154, 219) 1337476261 -2.978647716357898 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080172_0.png resize: (81, 186) 1337476262 -4.114720751866941 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080181_0.png resize: (209, 299) 1337476263 -4.290081334727 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080166_0.png resize: (179, 206) 1337476264 -4.0954050818710295 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080168_0.png resize: (55, 92) 1337476265 -0.17061825289954782 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080178_0.png resize: (200, 130) 1337476266 -3.0007944493515644 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080171_0.png resize: (317, 573) 1337476267 -1.6322959237004182 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080170_0.png resize: (237, 370) 1337476268 -3.923014238591678 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080179_0.png resize: (202, 140) 1337476269 -3.1182335481471846 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080177_0.png resize: (226, 243) 1337476270 -1.7750560272230949 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080167_0.png resize: (163, 108) 1337476271 -2.1624693852091106 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080180_0.png resize: (326, 220) 1337476272 -4.336575102672374 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080182_0.png resize: (214, 507) 1337476273 -4.761319297105012 treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080186_0.png resize: (489, 764) 1337476274 -3.630189071769782 treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080187_0.png resize: (121, 172) 1337476275 -3.5190732501774775 treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080189_0.png resize: (137, 686) 1337476276 -0.723661669869598 treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080185_0.png resize: (866, 619) 1337476277 -1.7147306880633637 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080192_0.png resize: (167, 132) 1337476278 -2.2217396594530987 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080204_0.png resize: (131, 93) 1337476279 -1.5280204057373525 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080197_0.png resize: (134, 152) 1337476280 -0.6009896709740549 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080193_0.png resize: (170, 240) 1337476281 -1.8553190336021814 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080211_0.png resize: (200, 207) 1337476282 -1.7727497163233181 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080194_0.png resize: (265, 98) 1337476283 -0.9739173326123779 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080208_0.png resize: (190, 292) 1337476284 -2.0942939746651565 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080205_0.png resize: (126, 127) 1337476285 -0.11986147579261022 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080213_0.png resize: (197, 276) 1337476286 -3.254183562697806 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080200_0.png resize: (170, 227) 1337476287 -0.4632005167876934 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080196_0.png resize: (255, 197) 1337476288 -1.2916530483277084 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080217_0.png resize: (104, 92) 1337476289 -1.282855775418039 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080202_0.png resize: (225, 372) 1337476290 0.4102473551185039 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080199_0.png resize: (88, 77) 1337476291 -3.059919034754522 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080198_0.png resize: (142, 169) 1337476292 -0.5699239420403298 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080218_0.png resize: (248, 311) 1337476293 -2.4307191362949276 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080201_0.png resize: (111, 129) 1337476294 0.5530549020266222 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080214_0.png resize: (94, 122) 1337476295 -3.868325244514864 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080209_0.png resize: (185, 127) 1337476296 -2.7807946547147595 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080224_0.png resize: (429, 394) 1337476297 -1.261591203781829 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080220_0.png resize: (122, 111) 1337476298 -2.083556040289304 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080230_0.png resize: (78, 126) 1337476299 -2.493618155637754 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080221_0.png resize: (88, 124) 1337476300 -0.3001728875963045 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080241_0.png resize: (130, 175) 1337476301 -2.8355978185374484 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080219_0.png resize: (207, 181) 1337476302 -0.07037297721717506 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080222_0.png resize: (264, 251) 1337476303 -1.6201654068049796 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080227_0.png resize: (194, 115) 1337476304 -2.226663425634288 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080253_0.png resize: (171, 126) 1337476305 -3.323620264317658 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080255_0.png resize: (90, 92) 1337476306 -2.734801797640763 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080254_0.png resize: (166, 88) 1337476307 -1.8749061661601722 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080242_0.png resize: (102, 105) 1337476308 -2.4279668674291655 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080250_0.png resize: (248, 217) 1337476309 -1.4056811335602346 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080252_0.png resize: (123, 168) 1337476310 -2.808223387354071 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080233_0.png resize: (75, 133) 1337476311 -0.8590225494711083 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080245_0.png resize: (253, 159) 1337476312 -3.0663927222819916 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080236_0.png resize: (192, 147) 1337476313 -2.3541413867350753 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080246_0.png resize: (195, 188) 1337476314 -2.9819104230200386 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080228_0.png resize: (200, 171) 1337476315 -2.2490246280178976 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080249_0.png resize: (365, 371) 1337476316 -2.5236261764690138 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080231_0.png resize: (150, 190) 1337476317 -2.931983724050708 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080232_0.png resize: (169, 110) 1337476318 -1.2990925693404674 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080223_0.png resize: (105, 176) 1337476319 -3.837230655825149 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080240_0.png resize: (235, 199) 1337476320 -4.208932035943999 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080229_0.png resize: (294, 237) 1337476321 -1.1159379856220064 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080238_0.png resize: (154, 180) 1337476322 -2.1390378230973903 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080235_0.png resize: (311, 224) 1337476323 -3.035329597614598 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080225_0.png resize: (291, 326) 1337476324 -2.803463385606384 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080244_0.png resize: (149, 207) 1337476325 -2.2479658202251365 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080269_0.png resize: (271, 179) 1337476326 -3.8496078043845317 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080262_0.png resize: (158, 104) 1337476327 -1.8210692659942787 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080273_0.png resize: (154, 277) 1337476328 -3.833550406095911 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080258_0.png resize: (95, 84) 1337476329 -1.3135836144807644 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080286_0.png resize: (182, 180) 1337476330 -2.600414256941477 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080268_0.png resize: (84, 120) 1337476331 -3.100065676489618 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080256_0.png resize: (98, 146) 1337476332 -3.1521939158285863 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080277_0.png resize: (221, 213) 1337476333 -2.6349491837795305 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080265_0.png resize: (363, 122) 1337476334 -2.6337416136761855 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080257_0.png resize: (141, 180) 1337476335 -0.8101687314123742 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080267_0.png resize: (150, 180) 1337476336 -1.9201296902983116 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080266_0.png resize: (126, 121) 1337476337 -0.5347696666828897 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080276_0.png resize: (113, 160) 1337476338 -1.8578400683454857 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080285_0.png resize: (156, 148) 1337476339 -0.8430981721303743 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080278_0.png resize: (187, 171) 1337476340 -3.458555374915693 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080292_0.png resize: (186, 210) 1337476341 -3.434421968614905 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080283_0.png resize: (108, 222) 1337476342 -2.4125060107864993 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080288_0.png resize: (162, 340) 1337476343 -2.845796713337161 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080289_0.png resize: (184, 324) 1337476344 -3.8475957174211186 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080274_0.png resize: (122, 304) 1337476345 -3.328306735445295 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080264_0.png resize: (347, 362) 1337476346 -2.8943724139456286 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080291_0.png resize: (129, 201) 1337476347 -1.667929241023071 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080275_0.png resize: (142, 251) 1337476348 -3.631132896782646 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080259_0.png resize: (204, 195) 1337476349 -3.19547288939431 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080272_0.png resize: (146, 119) 1337476350 -3.437433274875506 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080279_0.png resize: (220, 200) 1337476351 -3.8815498464698335 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080282_0.png resize: (146, 198) 1337476352 -4.025163183858859 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080271_0.png resize: (137, 201) 1337476353 -4.382066090401196 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080270_0.png resize: (282, 305) 1337476354 -3.3554933390852875 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080261_0.png resize: (190, 193) 1337476355 -3.786263092479012 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080281_0.png resize: (149, 272) 1337476356 -2.351237248343126 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080287_0.png resize: (377, 300) 1337476357 -1.5095651190842354 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080260_0.png resize: (243, 160) 1337476358 -3.062280839826604 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080047_0.png resize: (121, 145) 1337476384 -2.994359279056633 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080062_0.png resize: (210, 177) 1337476385 -1.2793374891400595 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080050_0.png resize: (350, 294) 1337476386 -3.8248191532413016 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080048_0.png resize: (138, 157) 1337476387 -1.7710630175181175 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080086_0.png resize: (294, 179) 1337476388 -3.866354203381801 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080049_0.png resize: (108, 209) 1337476389 -2.601101555507328 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080045_0.png resize: (251, 280) 1337476390 -1.0631724694727394 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080084_0.png resize: (178, 128) 1337476391 -1.8065476159987808 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080080_0.png resize: (348, 322) 1337476392 -4.413710103713566 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080057_0.png resize: (137, 163) 1337476393 -3.530277938369564 treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080043_0.png resize: (215, 203) 1337476394 -2.653234434654788 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080091_0.png resize: (453, 730) 1337476395 -2.1994150947237867 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080099_0.png resize: (143, 173) 1337476396 -3.6293517922250165 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080120_0.png resize: (51, 45) 1337476397 -0.905122640013222 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080133_0.png resize: (269, 352) 1337476398 -3.168141833483118 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080143_0.png resize: (92, 84) 1337476399 -2.6754990069998996 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080137_0.png resize: (335, 291) 1337476400 -2.8589429660833656 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080140_0.png resize: (299, 347) 1337476401 -4.580510479190001 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080152_0.png resize: (111, 76) 1337476402 -2.7071850663723516 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080163_0.png resize: (611, 374) 1337476403 -1.516339848370374 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080175_0.png resize: (644, 472) 1337476404 -3.944802740950486 treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080191_0.png resize: (205, 114) 1337476405 -2.137466047613243 treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080188_0.png resize: (127, 142) 1337476406 -2.8200067477754382 treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080190_0.png resize: (119, 172) 1337476407 -2.436090930265886 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080203_0.png resize: (110, 126) 1337476408 -3.809347387138726 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080207_0.png resize: (482, 428) 1337476409 -1.3532074712838564 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080206_0.png resize: (123, 159) 1337476410 -3.080006810118926 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080195_0.png resize: (110, 213) 1337476411 -0.3801908834404444 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080212_0.png resize: (707, 629) 1337476412 -2.238954237224021 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080237_0.png resize: (111, 86) 1337476413 -2.7115206850044262 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080239_0.png resize: (179, 137) 1337476414 -1.939738956591681 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080243_0.png resize: (388, 456) 1337476415 -2.3732145586979874 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080251_0.png resize: (159, 236) 1337476416 -2.1343537888740234 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080226_0.png resize: (65, 200) 1337476417 -3.1303650102984384 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080293_0.png resize: (166, 260) 1337476418 -2.915232943510916 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080280_0.png resize: (155, 297) 1337476419 -3.115850568153535 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080284_0.png resize: (202, 291) 1337476420 -4.117487657613379 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080263_0.png resize: (187, 176) 1337476421 -2.565066506890871 treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080290_0.png resize: (222, 372) 1337476422 -3.198633532579175 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080210_0.png resize: (95, 122) 1337476424 -1.168349020648563 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080111_0.png resize: (256, 216) 1337476430 -1.4117310577776683 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080106_0.png resize: (237, 334) 1337476431 -3.523698307369046 treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080105_0.png resize: (256, 182) 1337476432 -3.027952991172265 treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080131_0.png resize: (467, 229) 1337476433 -3.8865432691938064 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080146_0.png resize: (198, 227) 1337476434 -2.9963869733716595 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080136_0.png resize: (230, 322) 1337476435 -2.107028957842457 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080141_0.png resize: (320, 368) 1337476436 -2.4258827957228086 treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080145_0.png resize: (607, 666) 1337476437 -2.265131871173999 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080162_0.png resize: (215, 230) 1337476438 -2.996639514542373 treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080159_0.png resize: (233, 515) 1337476439 -3.48035745785915 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080169_0.png resize: (231, 223) 1337476440 -3.7259516583760464 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080165_0.png resize: (237, 413) 1337476441 -2.192930524445154 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080234_0.png resize: (226, 497) 1337476442 -4.206659285791757 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080248_0.png resize: (251, 296) 1337476443 -2.4135814097977355 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080215_0.png resize: (87, 129) 1337476445 -2.6187893607448305 treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080216_0.png resize: (118, 113) 1337476446 -0.06675005391752284 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080184_0.png resize: (183, 204) 1337476447 -4.969602756559352 treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080183_0.png resize: (210, 547) 1337476448 -3.0859607654716013 treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080247_0.png resize: (131, 193) 1337476449 -3.277964032219828 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 261 time used for this insertion : 0.027817249298095703 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 261 time used for this insertion : 0.0631103515625 save missing photos in datou_result : time spend for datou_step_exec : 35.07215356826782 time spend to save output : 0.09678053855895996 total time spend for step 6 : 35.16893410682678 step7:brightness Fri Feb 14 01:07:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866.jpg treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f.jpg treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52.jpg treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4.jpg treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8.jpg treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa.jpg treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb.jpg treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83.jpg treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61.jpg treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0.jpg treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080063_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080044_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080089_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080071_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080074_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080088_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080072_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080070_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080069_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080061_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080058_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080055_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080068_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080067_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080073_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080087_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080078_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080052_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080056_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080065_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080083_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080085_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080064_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080075_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080054_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080060_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080059_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080077_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080081_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080066_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080046_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080079_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080090_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080076_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080082_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080053_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080051_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080108_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080100_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080110_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080096_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080092_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080097_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080102_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080109_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080093_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080112_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080095_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080104_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080101_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080098_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080107_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080094_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080103_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080126_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080130_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080114_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080113_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080118_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080123_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080128_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080129_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080121_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080119_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080115_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080122_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080117_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080132_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080124_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080125_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080127_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080116_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080135_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080134_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080144_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080138_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080139_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080142_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080147_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080149_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080161_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080155_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080153_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080151_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080150_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080160_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080156_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080158_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080157_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080154_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080148_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080173_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080174_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080176_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080164_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080172_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080181_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080166_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080168_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080178_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080171_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080170_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080179_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080177_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080167_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080180_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080182_0.png treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080186_0.png treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080187_0.png treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080189_0.png treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080185_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080192_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080204_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080197_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080193_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080211_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080194_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080208_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080205_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080213_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080200_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080196_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080217_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080202_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080199_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080198_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080218_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080201_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080214_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080209_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080224_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080220_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080230_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080221_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080241_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080219_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080222_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080227_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080253_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080255_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080254_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080242_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080250_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080252_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080233_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080245_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080236_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080246_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080228_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080249_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080231_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080232_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080223_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080240_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080229_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080238_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080235_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080225_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080244_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080269_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080262_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080273_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080258_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080286_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080268_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080256_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080277_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080265_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080257_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080267_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080266_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080276_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080285_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080278_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080292_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080283_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080288_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080289_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080274_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080264_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080291_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080275_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080259_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080272_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080279_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080282_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080271_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080270_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080261_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080281_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080287_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080260_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080047_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080062_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080050_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080048_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080086_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080049_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080045_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080084_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080080_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080057_0.png treat image : temp/1739491229_2432784_1337460307_5f96166bace41e23ad0bd40747fe9866_rle_crop_3674080043_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080091_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080099_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080120_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080133_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080143_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080137_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080140_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080152_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080163_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080175_0.png treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080191_0.png treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080188_0.png treat image : temp/1739491229_2432784_1337340458_4bad2e870113aa05e2e0052275d094cb_rle_crop_3674080190_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080203_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080207_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080206_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080195_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080212_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080237_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080239_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080243_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080251_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080226_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080293_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080280_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080284_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080263_0.png treat image : temp/1739491229_2432784_1337340282_3b34d8c19490b93683d2151c8f9a1df0_rle_crop_3674080290_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080210_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080111_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080106_0.png treat image : temp/1739491229_2432784_1337460295_a03b4c1c3cf2c15998233608be0bc67f_rle_crop_3674080105_0.png treat image : temp/1739491229_2432784_1337460291_1d9c8d36da1ae1470d4837667675be52_rle_crop_3674080131_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080146_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080136_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080141_0.png treat image : temp/1739491229_2432784_1337460274_6d7ad81ff79862778565894cac7707b4_rle_crop_3674080145_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080162_0.png treat image : temp/1739491229_2432784_1337340465_5e1c52b2d0eea91b4315cf8a4b1c0fd8_rle_crop_3674080159_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080169_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080165_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080234_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080248_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080215_0.png treat image : temp/1739491229_2432784_1337340285_9ed7a27be8bfbb38fc09566c7257bb83_rle_crop_3674080216_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080184_0.png treat image : temp/1739491229_2432784_1337340462_43ad9891dc4263f7882509face11daaa_rle_crop_3674080183_0.png treat image : temp/1739491229_2432784_1337340283_05b7c134498a12f4dd3b1e1195a62c61_rle_crop_3674080247_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 261 time used for this insertion : 0.026498079299926758 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 261 time used for this insertion : 0.04693007469177246 save missing photos in datou_result : time spend for datou_step_exec : 9.77614951133728 time spend to save output : 0.08006167411804199 total time spend for step 7 : 9.856211185455322 step8:velours_tree Fri Feb 14 01:08:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.1246659755706787 time spend to save output : 5.53131103515625e-05 total time spend for step 8 : 1.1247212886810303 step9:send_mail_cod Fri Feb 14 01:08:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20528871_14-02-2025_01_08_08.pdf 20531159 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205311591739491688 20531160 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205311601739491689 20531161 change filename to text .change filename to text .imagette205311611739491690 20531162 change filename to text .change filename to text .change filename to text .imagette205311621739491690 20531163 change filename to text .imagette205311631739491690 20531164 imagette205311641739491690 20531166 imagette205311661739491690 20531167 imagette205311671739491690 20531168 imagette205311681739491690 20531169 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205311691739491690 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20528871 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20531159,20531160,20531161,20531162,20531163,20531164,20531165,20531166,20531167,20531168,20531169?tags=pet_clair,carton,autre,pet_fonce,metal,mal_croppe,environnement,flou,background,pehd,papier args[1337460307] : ((1337460307, -5.395495003029587, 492609224), (1337460307, -0.3802853346540556, 496442774), '0.12365535073983296') apple ((1337460307, -5.395495003029587, 492609224), (1337460307, -0.3802853346540556, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337460295] : ((1337460295, -5.2879533687880045, 492609224), (1337460295, -0.24508660882376807, 496442774), '0.12365535073983296') apple ((1337460295, -5.2879533687880045, 492609224), (1337460295, -0.24508660882376807, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337460291] : ((1337460291, -4.969720782941583, 492609224), (1337460291, -0.360701165736452, 496442774), '0.12365535073983296') apple ((1337460291, -4.969720782941583, 492609224), (1337460291, -0.360701165736452, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337460274] : ((1337460274, -3.666814585439737, 492609224), (1337460274, -0.40481128218032525, 496442774), '0.12365535073983296') apple ((1337460274, -3.666814585439737, 492609224), (1337460274, -0.40481128218032525, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337340465] : ((1337340465, -3.296695207442416, 492609224), (1337340465, -0.22101604752474077, 496442774), '0.12365535073983296') apple ((1337340465, -3.296695207442416, 492609224), (1337340465, -0.22101604752474077, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337340462] : ((1337340462, -4.249108308997526, 492609224), (1337340462, -0.4345734532022551, 496442774), '0.12365535073983296') apple ((1337340462, -4.249108308997526, 492609224), (1337340462, -0.4345734532022551, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337340458] : ((1337340458, -3.3742672506215525, 492609224), (1337340458, -0.34807853111161124, 496442774), '0.12365535073983296') apple ((1337340458, -3.3742672506215525, 492609224), (1337340458, -0.34807853111161124, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337340285] : ((1337340285, -2.7874777328432523, 492609224), (1337340285, -0.2863501573007613, 496442774), '0.12365535073983296') apple ((1337340285, -2.7874777328432523, 492609224), (1337340285, -0.2863501573007613, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337340283] : ((1337340283, -4.380787355639817, 492609224), (1337340283, -0.204085216153211, 496442774), '0.12365535073983296') apple ((1337340283, -4.380787355639817, 492609224), (1337340283, -0.204085216153211, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com args[1337340282] : ((1337340282, -4.740631851337783, 492609224), (1337340282, -0.31828870200260134, 496442774), '0.12365535073983296') apple ((1337340282, -4.740631851337783, 492609224), (1337340282, -0.31828870200260134, 496442774), '0.12365535073983296') We are sending mail with results at report@fotonower.com refus_total : 0.12365535073983296 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20528871 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1337340462,1337340465,1337460274,1337340282,1337340283,1337340285,1337340458,1337460291,1337460295,1337460307) Found this number of photos: 10 begin to download photo : 1337340462 begin to download photo : 1337340282 begin to download photo : 1337340458 begin to download photo : 1337460307 download finish for photo 1337340458 begin to download photo : 1337460291 download finish for photo 1337340462 begin to download photo : 1337340465 download finish for photo 1337460307 download finish for photo 1337340282 begin to download photo : 1337340283 download finish for photo 1337460291 begin to download photo : 1337460295 download finish for photo 1337340465 begin to download photo : 1337460274 download finish for photo 1337340283 begin to download photo : 1337340285 download finish for photo 1337460295 download finish for photo 1337460274 download finish for photo 1337340285 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528871_14-02-2025_01_08_08.pdf results_Auto_P20528871_14-02-2025_01_08_08.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528871_14-02-2025_01_08_08.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20528871','results_Auto_P20528871_14-02-2025_01_08_08.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528871_14-02-2025_01_08_08.pdf','pdf','','0.65','0.12365535073983296') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20528871

https://www.fotonower.com/image?json=false&list_photos_id=1337460307
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337460295
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337460291
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337460274
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340465
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340462
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340458
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340285
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340283
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340282
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.37%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/20531159?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20531160?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20531161?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20531162?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20531163?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/20531169?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528871_14-02-2025_01_08_08.pdf.

Lien vers velours :https://www.fotonower.com/velours/20531159,20531160,20531161,20531162,20531163,20531164,20531165,20531166,20531167,20531168,20531169?tags=pet_clair,carton,autre,pet_fonce,metal,mal_croppe,environnement,flou,background,pehd,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 14 Feb 2025 00:08:15 GMT Content-Length: 0 Connection: close X-Message-Id: IhJI-KJPRTyFrQmTRtejUQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337460307, 1337460295, 1337460291, 1337460274, 1337340465, 1337340462, 1337340458, 1337340285, 1337340283, 1337340282] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460307', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460295', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460291', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460274', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340465', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340462', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340458', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340285', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340283', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340282', None, None, None, None, None, '2584393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.02376699447631836 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.174088954925537 time spend to save output : 0.02395343780517578 total time spend for step 9 : 7.198042392730713 step10:split_time_score Fri Feb 14 01:08:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13022025 20528871 Nombre de photos uploadées : 10 / 23040 (0%) 13022025 20528871 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 13022025 20528871 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005643367767333984 elapsed_time : insert_dashboard_record_day_entry 0.026572465896606445 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528847 order by id desc limit 1 Qualite : 0.14136086604967552 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20503797_13-02-2025_09_15_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20503797 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20503797 AND mptpi.`type`=3594 To do Qualite : 0.14449458458151784 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20503799_13-02-2025_09_01_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20503799 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20503799 AND mptpi.`type`=3594 To do Qualite : 0.07891361257373916 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528860_14-02-2025_00_50_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528860 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528862 order by id desc limit 1 Qualite : 0.13281513190409905 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528869_14-02-2025_00_57_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528869 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528869 AND mptpi.`type`=3594 To do Qualite : 0.12365535073983296 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528871_14-02-2025_01_08_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528871 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528871 AND mptpi.`type`=3594 To do Qualite : 0.17378304379236262 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528872_14-02-2025_00_48_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528872 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528872 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528940 order by id desc limit 1 Qualite : 0.06743200877946215 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528945_14-02-2025_00_17_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528945 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528945 AND mptpi.`type`=3726 To do Qualite : 0.14551669770917627 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528952_14-02-2025_00_32_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528952 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528952 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528954 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13022025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337460307, 1337460295, 1337460291, 1337460274, 1337340465, 1337340462, 1337340458, 1337340285, 1337340283, 1337340282] Looping around the photos to save general results len do output : 1 /20528871Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460307', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460295', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460291', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337460274', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340465', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340462', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340458', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340285', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340283', None, None, None, None, None, '2584393') ('3318', None, None, None, None, None, None, None, '2584393') ('3318', '20528871', '1337340282', None, None, None, None, None, '2584393') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016287565231323242 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.008777618408203 time spend to save output : 0.016480445861816406 total time spend for step 10 : 4.0252580642700195 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 190.01user 179.26system 7:53.63elapsed 77%CPU (0avgtext+0avgdata 7223140maxresident)k 2167104inputs+143072outputs (28287major+19714952minor)pagefaults 0swaps