python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1136183 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2987541'] with mtr_portfolio_ids : ['23452977'] and first list_photo_ids : [] new path : /proc/1136183/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 14 ; length of list_pids : 14 ; length of list_args : 14 time to download the photos : 2.4574222564697266 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri May 30 16:00:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-30 16:00:35.738949: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-30 16:00:35.767504: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492915000 Hz 2025-05-30 16:00:35.769354: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2920000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-30 16:00:35.769393: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-30 16:00:35.772770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-30 16:00:35.938907: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3340ff70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-30 16:00:35.938964: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-30 16:00:35.940478: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-30 16:00:35.940871: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-30 16:00:35.944004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-30 16:00:35.946786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-30 16:00:35.947427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-30 16:00:35.950132: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-30 16:00:35.951599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-30 16:00:35.956905: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-30 16:00:35.958789: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-30 16:00:35.958867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-30 16:00:35.959858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-30 16:00:35.959880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-30 16:00:35.959890: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-30 16:00:35.961480: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-30 16:00:36.217919: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-30 16:00:36.218019: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-30 16:00:36.218048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-30 16:00:36.218073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-30 16:00:36.218098: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-30 16:00:36.218122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-30 16:00:36.218145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-30 16:00:36.218169: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-30 16:00:36.220424: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-30 16:00:36.221626: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-30 16:00:36.221681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-30 16:00:36.221704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-30 16:00:36.221726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-30 16:00:36.221747: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-30 16:00:36.221769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-30 16:00:36.221792: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-30 16:00:36.221814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-30 16:00:36.223135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-30 16:00:36.223164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-30 16:00:36.223173: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-30 16:00:36.223181: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-30 16:00:36.224566: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-30 16:00:44.273350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-30 16:00:44.490222: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 Detection mask done ! Trying to reset tf kernel 1137078 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2282 tf kernel not reseted sub process len(results) : 14 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 14 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7177 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.005738735198974609 nb_pixel_total : 212060 time to create 1 rle with new method : 0.011641979217529297 length of segment : 472 time for calcul the mask position with numpy : 0.018454313278198242 nb_pixel_total : 893359 time to create 1 rle with new method : 0.04928326606750488 length of segment : 1148 time for calcul the mask position with numpy : 0.0008680820465087891 nb_pixel_total : 48388 time to create 1 rle with old method : 0.05981111526489258 length of segment : 188 time for calcul the mask position with numpy : 0.0008740425109863281 nb_pixel_total : 45600 time to create 1 rle with old method : 0.05338931083679199 length of segment : 315 time for calcul the mask position with numpy : 0.00032806396484375 nb_pixel_total : 19593 time to create 1 rle with old method : 0.022141695022583008 length of segment : 185 time for calcul the mask position with numpy : 0.0004394054412841797 nb_pixel_total : 27782 time to create 1 rle with old method : 0.033818721771240234 length of segment : 179 time for calcul the mask position with numpy : 0.0007772445678710938 nb_pixel_total : 52004 time to create 1 rle with old method : 0.06540989875793457 length of segment : 142 time for calcul the mask position with numpy : 0.0011687278747558594 nb_pixel_total : 69900 time to create 1 rle with old method : 0.08235001564025879 length of segment : 268 time for calcul the mask position with numpy : 0.00039005279541015625 nb_pixel_total : 19751 time to create 1 rle with old method : 0.022416353225708008 length of segment : 202 time for calcul the mask position with numpy : 0.0003399848937988281 nb_pixel_total : 18266 time to create 1 rle with old method : 0.02546095848083496 length of segment : 152 time for calcul the mask position with numpy : 0.0002512931823730469 nb_pixel_total : 13626 time to create 1 rle with old method : 0.015723466873168945 length of segment : 153 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 27610 time to create 1 rle with old method : 0.03200078010559082 length of segment : 144 time for calcul the mask position with numpy : 0.0004763603210449219 nb_pixel_total : 26886 time to create 1 rle with old method : 0.03020501136779785 length of segment : 205 time for calcul the mask position with numpy : 0.0012679100036621094 nb_pixel_total : 76937 time to create 1 rle with old method : 0.0895395278930664 length of segment : 164 time for calcul the mask position with numpy : 0.0004928112030029297 nb_pixel_total : 18058 time to create 1 rle with old method : 0.02094268798828125 length of segment : 132 time for calcul the mask position with numpy : 0.00011754035949707031 nb_pixel_total : 4133 time to create 1 rle with old method : 0.008216142654418945 length of segment : 111 time for calcul the mask position with numpy : 0.004746198654174805 nb_pixel_total : 298474 time to create 1 rle with new method : 0.009343147277832031 length of segment : 464 time for calcul the mask position with numpy : 0.004689931869506836 nb_pixel_total : 310278 time to create 1 rle with new method : 0.014312744140625 length of segment : 941 time for calcul the mask position with numpy : 0.00026154518127441406 nb_pixel_total : 13304 time to create 1 rle with old method : 0.015357732772827148 length of segment : 147 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 36099 time to create 1 rle with old method : 0.04105830192565918 length of segment : 333 time for calcul the mask position with numpy : 0.0032477378845214844 nb_pixel_total : 240035 time to create 1 rle with new method : 0.011994600296020508 length of segment : 563 time for calcul the mask position with numpy : 0.0003597736358642578 nb_pixel_total : 13682 time to create 1 rle with old method : 0.01574087142944336 length of segment : 186 time for calcul the mask position with numpy : 0.002420186996459961 nb_pixel_total : 106993 time to create 1 rle with old method : 0.1251668930053711 length of segment : 247 time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 10676 time to create 1 rle with old method : 0.012290477752685547 length of segment : 97 time for calcul the mask position with numpy : 0.005033254623413086 nb_pixel_total : 357664 time to create 1 rle with new method : 0.013715982437133789 length of segment : 802 time for calcul the mask position with numpy : 0.0005438327789306641 nb_pixel_total : 32809 time to create 1 rle with old method : 0.03898024559020996 length of segment : 254 time for calcul the mask position with numpy : 0.0006301403045654297 nb_pixel_total : 34803 time to create 1 rle with old method : 0.03887486457824707 length of segment : 346 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 19397 time to create 1 rle with old method : 0.03402376174926758 length of segment : 154 time for calcul the mask position with numpy : 0.0015120506286621094 nb_pixel_total : 47644 time to create 1 rle with old method : 0.06353497505187988 length of segment : 222 time for calcul the mask position with numpy : 0.0013158321380615234 nb_pixel_total : 23042 time to create 1 rle with old method : 0.02713942527770996 length of segment : 328 time for calcul the mask position with numpy : 0.0038323402404785156 nb_pixel_total : 58428 time to create 1 rle with old method : 0.07049274444580078 length of segment : 211 time for calcul the mask position with numpy : 0.0017664432525634766 nb_pixel_total : 46892 time to create 1 rle with old method : 0.05265498161315918 length of segment : 253 time for calcul the mask position with numpy : 0.0014042854309082031 nb_pixel_total : 54632 time to create 1 rle with old method : 0.06303668022155762 length of segment : 251 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 6418 time to create 1 rle with old method : 0.007714748382568359 length of segment : 68 time for calcul the mask position with numpy : 0.0007710456848144531 nb_pixel_total : 20920 time to create 1 rle with old method : 0.02605152130126953 length of segment : 151 time for calcul the mask position with numpy : 0.0009613037109375 nb_pixel_total : 25627 time to create 1 rle with old method : 0.02967548370361328 length of segment : 137 time for calcul the mask position with numpy : 0.0014622211456298828 nb_pixel_total : 33704 time to create 1 rle with old method : 0.03873920440673828 length of segment : 223 time for calcul the mask position with numpy : 0.001041412353515625 nb_pixel_total : 25025 time to create 1 rle with old method : 0.02867579460144043 length of segment : 178 time for calcul the mask position with numpy : 0.001005411148071289 nb_pixel_total : 32451 time to create 1 rle with old method : 0.0371556282043457 length of segment : 207 time for calcul the mask position with numpy : 0.0006961822509765625 nb_pixel_total : 14558 time to create 1 rle with old method : 0.01688385009765625 length of segment : 257 time for calcul the mask position with numpy : 0.0010781288146972656 nb_pixel_total : 32963 time to create 1 rle with old method : 0.03751802444458008 length of segment : 187 time for calcul the mask position with numpy : 0.013030290603637695 nb_pixel_total : 400322 time to create 1 rle with new method : 0.017067432403564453 length of segment : 723 time for calcul the mask position with numpy : 0.0027685165405273438 nb_pixel_total : 83264 time to create 1 rle with old method : 0.09336566925048828 length of segment : 343 time for calcul the mask position with numpy : 0.002943277359008789 nb_pixel_total : 71283 time to create 1 rle with old method : 0.08212161064147949 length of segment : 357 time for calcul the mask position with numpy : 0.0007538795471191406 nb_pixel_total : 15367 time to create 1 rle with old method : 0.017729997634887695 length of segment : 176 time for calcul the mask position with numpy : 0.0007331371307373047 nb_pixel_total : 19396 time to create 1 rle with old method : 0.022375106811523438 length of segment : 253 time for calcul the mask position with numpy : 0.002429962158203125 nb_pixel_total : 60663 time to create 1 rle with old method : 0.08870840072631836 length of segment : 718 time for calcul the mask position with numpy : 0.0017020702362060547 nb_pixel_total : 55991 time to create 1 rle with old method : 0.06384730339050293 length of segment : 184 time for calcul the mask position with numpy : 0.0008664131164550781 nb_pixel_total : 26133 time to create 1 rle with old method : 0.03023052215576172 length of segment : 152 time for calcul the mask position with numpy : 0.0007941722869873047 nb_pixel_total : 23342 time to create 1 rle with old method : 0.026456117630004883 length of segment : 232 time for calcul the mask position with numpy : 0.0007505416870117188 nb_pixel_total : 19410 time to create 1 rle with old method : 0.022286653518676758 length of segment : 154 time for calcul the mask position with numpy : 0.0014781951904296875 nb_pixel_total : 35302 time to create 1 rle with old method : 0.04029202461242676 length of segment : 240 time for calcul the mask position with numpy : 0.00113677978515625 nb_pixel_total : 38200 time to create 1 rle with old method : 0.04814553260803223 length of segment : 188 time for calcul the mask position with numpy : 0.0010287761688232422 nb_pixel_total : 30996 time to create 1 rle with old method : 0.034853458404541016 length of segment : 195 time for calcul the mask position with numpy : 0.0008168220520019531 nb_pixel_total : 26299 time to create 1 rle with old method : 0.029180049896240234 length of segment : 151 time for calcul the mask position with numpy : 0.0007963180541992188 nb_pixel_total : 20061 time to create 1 rle with old method : 0.022157669067382812 length of segment : 167 time for calcul the mask position with numpy : 0.0007493495941162109 nb_pixel_total : 19333 time to create 1 rle with old method : 0.02121567726135254 length of segment : 249 time for calcul the mask position with numpy : 0.0031032562255859375 nb_pixel_total : 83181 time to create 1 rle with old method : 0.09329891204833984 length of segment : 365 time for calcul the mask position with numpy : 0.0013401508331298828 nb_pixel_total : 30954 time to create 1 rle with old method : 0.03695821762084961 length of segment : 278 time for calcul the mask position with numpy : 0.0017249584197998047 nb_pixel_total : 49324 time to create 1 rle with old method : 0.057517051696777344 length of segment : 218 time for calcul the mask position with numpy : 0.0013935565948486328 nb_pixel_total : 31987 time to create 1 rle with old method : 0.03509831428527832 length of segment : 260 time for calcul the mask position with numpy : 0.0007770061492919922 nb_pixel_total : 16003 time to create 1 rle with old method : 0.01799631118774414 length of segment : 192 time for calcul the mask position with numpy : 0.0013883113861083984 nb_pixel_total : 43322 time to create 1 rle with old method : 0.051224708557128906 length of segment : 202 time for calcul the mask position with numpy : 0.00043892860412597656 nb_pixel_total : 17117 time to create 1 rle with old method : 0.019417285919189453 length of segment : 178 time for calcul the mask position with numpy : 0.0034377574920654297 nb_pixel_total : 117940 time to create 1 rle with old method : 0.12886381149291992 length of segment : 431 time for calcul the mask position with numpy : 0.0008988380432128906 nb_pixel_total : 23615 time to create 1 rle with old method : 0.026731014251708984 length of segment : 268 time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 13619 time to create 1 rle with old method : 0.016096115112304688 length of segment : 100 time for calcul the mask position with numpy : 0.0031490325927734375 nb_pixel_total : 104501 time to create 1 rle with old method : 0.11874890327453613 length of segment : 386 time for calcul the mask position with numpy : 0.0013375282287597656 nb_pixel_total : 33104 time to create 1 rle with old method : 0.03682661056518555 length of segment : 277 time for calcul the mask position with numpy : 0.0008704662322998047 nb_pixel_total : 21382 time to create 1 rle with old method : 0.03464531898498535 length of segment : 187 time for calcul the mask position with numpy : 0.0010039806365966797 nb_pixel_total : 24033 time to create 1 rle with old method : 0.035265445709228516 length of segment : 171 time for calcul the mask position with numpy : 0.0014903545379638672 nb_pixel_total : 44350 time to create 1 rle with old method : 0.05120491981506348 length of segment : 290 time for calcul the mask position with numpy : 0.01389312744140625 nb_pixel_total : 422491 time to create 1 rle with new method : 0.020859241485595703 length of segment : 1312 time for calcul the mask position with numpy : 0.0005557537078857422 nb_pixel_total : 15654 time to create 1 rle with old method : 0.017596006393432617 length of segment : 119 time for calcul the mask position with numpy : 0.003343343734741211 nb_pixel_total : 109161 time to create 1 rle with old method : 0.12773633003234863 length of segment : 459 time for calcul the mask position with numpy : 0.0006799697875976562 nb_pixel_total : 15398 time to create 1 rle with old method : 0.02476787567138672 length of segment : 166 time for calcul the mask position with numpy : 0.001520395278930664 nb_pixel_total : 30322 time to create 1 rle with old method : 0.04614114761352539 length of segment : 280 time for calcul the mask position with numpy : 0.0030832290649414062 nb_pixel_total : 78685 time to create 1 rle with old method : 0.08845376968383789 length of segment : 327 time for calcul the mask position with numpy : 0.0006685256958007812 nb_pixel_total : 16637 time to create 1 rle with old method : 0.019022464752197266 length of segment : 164 time for calcul the mask position with numpy : 0.005201578140258789 nb_pixel_total : 381198 time to create 1 rle with new method : 0.017490148544311523 length of segment : 1319 time for calcul the mask position with numpy : 0.0018486976623535156 nb_pixel_total : 107831 time to create 1 rle with old method : 0.12021565437316895 length of segment : 314 time for calcul the mask position with numpy : 0.0023708343505859375 nb_pixel_total : 78789 time to create 1 rle with old method : 0.08784651756286621 length of segment : 298 time for calcul the mask position with numpy : 0.0009174346923828125 nb_pixel_total : 23704 time to create 1 rle with old method : 0.02675175666809082 length of segment : 137 time for calcul the mask position with numpy : 0.0009653568267822266 nb_pixel_total : 25145 time to create 1 rle with old method : 0.031204938888549805 length of segment : 185 time for calcul the mask position with numpy : 0.001775979995727539 nb_pixel_total : 62658 time to create 1 rle with old method : 0.07955098152160645 length of segment : 182 time for calcul the mask position with numpy : 0.002642393112182617 nb_pixel_total : 58424 time to create 1 rle with old method : 0.06850671768188477 length of segment : 321 time for calcul the mask position with numpy : 0.001966714859008789 nb_pixel_total : 47600 time to create 1 rle with old method : 0.0555422306060791 length of segment : 283 time for calcul the mask position with numpy : 0.0026302337646484375 nb_pixel_total : 83973 time to create 1 rle with old method : 0.09421086311340332 length of segment : 342 time for calcul the mask position with numpy : 0.0010917186737060547 nb_pixel_total : 9191 time to create 1 rle with old method : 0.010886669158935547 length of segment : 149 time for calcul the mask position with numpy : 0.0026726722717285156 nb_pixel_total : 85334 time to create 1 rle with old method : 0.09778690338134766 length of segment : 257 time for calcul the mask position with numpy : 0.0011203289031982422 nb_pixel_total : 17217 time to create 1 rle with old method : 0.019617080688476562 length of segment : 130 time for calcul the mask position with numpy : 0.0013015270233154297 nb_pixel_total : 20730 time to create 1 rle with old method : 0.026162147521972656 length of segment : 133 time for calcul the mask position with numpy : 0.0028617382049560547 nb_pixel_total : 91813 time to create 1 rle with old method : 0.10990095138549805 length of segment : 324 time for calcul the mask position with numpy : 0.002580404281616211 nb_pixel_total : 56348 time to create 1 rle with old method : 0.06697320938110352 length of segment : 312 time for calcul the mask position with numpy : 0.001990795135498047 nb_pixel_total : 56163 time to create 1 rle with old method : 0.06307339668273926 length of segment : 246 time for calcul the mask position with numpy : 0.0012989044189453125 nb_pixel_total : 24142 time to create 1 rle with old method : 0.027654409408569336 length of segment : 234 time for calcul the mask position with numpy : 0.002533435821533203 nb_pixel_total : 77224 time to create 1 rle with old method : 0.08640003204345703 length of segment : 304 time for calcul the mask position with numpy : 0.0010068416595458984 nb_pixel_total : 27214 time to create 1 rle with old method : 0.030547380447387695 length of segment : 260 time for calcul the mask position with numpy : 0.002117633819580078 nb_pixel_total : 50768 time to create 1 rle with old method : 0.05837440490722656 length of segment : 317 time for calcul the mask position with numpy : 0.0007226467132568359 nb_pixel_total : 17784 time to create 1 rle with old method : 0.020348310470581055 length of segment : 158 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 13296 time to create 1 rle with old method : 0.01567363739013672 length of segment : 133 time for calcul the mask position with numpy : 0.0011069774627685547 nb_pixel_total : 29795 time to create 1 rle with old method : 0.033940792083740234 length of segment : 168 time for calcul the mask position with numpy : 0.0011987686157226562 nb_pixel_total : 27443 time to create 1 rle with old method : 0.03161811828613281 length of segment : 163 time for calcul the mask position with numpy : 0.0030760765075683594 nb_pixel_total : 85724 time to create 1 rle with old method : 0.09430265426635742 length of segment : 442 time for calcul the mask position with numpy : 0.0006318092346191406 nb_pixel_total : 16970 time to create 1 rle with old method : 0.019289493560791016 length of segment : 154 time for calcul the mask position with numpy : 0.0013206005096435547 nb_pixel_total : 45155 time to create 1 rle with old method : 0.050081729888916016 length of segment : 249 time for calcul the mask position with numpy : 0.00048422813415527344 nb_pixel_total : 12105 time to create 1 rle with old method : 0.013925313949584961 length of segment : 145 time for calcul the mask position with numpy : 0.0009844303131103516 nb_pixel_total : 33776 time to create 1 rle with old method : 0.039167165756225586 length of segment : 158 time for calcul the mask position with numpy : 0.0004897117614746094 nb_pixel_total : 8250 time to create 1 rle with old method : 0.00933694839477539 length of segment : 150 time for calcul the mask position with numpy : 0.001550436019897461 nb_pixel_total : 40960 time to create 1 rle with old method : 0.046488285064697266 length of segment : 290 time for calcul the mask position with numpy : 0.0006990432739257812 nb_pixel_total : 19753 time to create 1 rle with old method : 0.022390127182006836 length of segment : 143 time for calcul the mask position with numpy : 0.0005905628204345703 nb_pixel_total : 28917 time to create 1 rle with old method : 0.03267240524291992 length of segment : 141 time for calcul the mask position with numpy : 0.0008985996246337891 nb_pixel_total : 23041 time to create 1 rle with old method : 0.026278018951416016 length of segment : 162 time for calcul the mask position with numpy : 0.00047087669372558594 nb_pixel_total : 13927 time to create 1 rle with old method : 0.016367673873901367 length of segment : 133 time for calcul the mask position with numpy : 0.002180337905883789 nb_pixel_total : 69419 time to create 1 rle with old method : 0.07705283164978027 length of segment : 432 time for calcul the mask position with numpy : 0.0025196075439453125 nb_pixel_total : 42944 time to create 1 rle with old method : 0.04953408241271973 length of segment : 376 time for calcul the mask position with numpy : 0.0026733875274658203 nb_pixel_total : 65308 time to create 1 rle with old method : 0.07742619514465332 length of segment : 365 time for calcul the mask position with numpy : 0.0006997585296630859 nb_pixel_total : 16515 time to create 1 rle with old method : 0.01876068115234375 length of segment : 191 time for calcul the mask position with numpy : 0.0005538463592529297 nb_pixel_total : 15043 time to create 1 rle with old method : 0.017180681228637695 length of segment : 141 time for calcul the mask position with numpy : 0.006579399108886719 nb_pixel_total : 194924 time to create 1 rle with new method : 0.00887441635131836 length of segment : 474 time for calcul the mask position with numpy : 0.0010769367218017578 nb_pixel_total : 23947 time to create 1 rle with old method : 0.027169466018676758 length of segment : 147 time for calcul the mask position with numpy : 0.001210927963256836 nb_pixel_total : 22872 time to create 1 rle with old method : 0.027304649353027344 length of segment : 186 time for calcul the mask position with numpy : 0.0027518272399902344 nb_pixel_total : 71435 time to create 1 rle with old method : 0.08670973777770996 length of segment : 388 time for calcul the mask position with numpy : 0.0009469985961914062 nb_pixel_total : 18330 time to create 1 rle with old method : 0.03026294708251953 length of segment : 194 time for calcul the mask position with numpy : 0.0013692378997802734 nb_pixel_total : 26792 time to create 1 rle with old method : 0.0312960147857666 length of segment : 225 time for calcul the mask position with numpy : 0.0015871524810791016 nb_pixel_total : 36230 time to create 1 rle with old method : 0.04176640510559082 length of segment : 215 time for calcul the mask position with numpy : 0.0017206668853759766 nb_pixel_total : 62838 time to create 1 rle with old method : 0.07108592987060547 length of segment : 271 time for calcul the mask position with numpy : 0.0014607906341552734 nb_pixel_total : 38032 time to create 1 rle with old method : 0.05194687843322754 length of segment : 247 time for calcul the mask position with numpy : 0.0033082962036132812 nb_pixel_total : 55413 time to create 1 rle with old method : 0.06687641143798828 length of segment : 509 time for calcul the mask position with numpy : 0.0009305477142333984 nb_pixel_total : 26700 time to create 1 rle with old method : 0.03867340087890625 length of segment : 246 time for calcul the mask position with numpy : 0.0014605522155761719 nb_pixel_total : 37171 time to create 1 rle with old method : 0.04828190803527832 length of segment : 143 time for calcul the mask position with numpy : 0.0004417896270751953 nb_pixel_total : 11066 time to create 1 rle with old method : 0.012739896774291992 length of segment : 149 time for calcul the mask position with numpy : 0.0006165504455566406 nb_pixel_total : 24358 time to create 1 rle with old method : 0.028489112854003906 length of segment : 177 time for calcul the mask position with numpy : 0.0007233619689941406 nb_pixel_total : 17058 time to create 1 rle with old method : 0.026578187942504883 length of segment : 184 time for calcul the mask position with numpy : 0.003206014633178711 nb_pixel_total : 78619 time to create 1 rle with old method : 0.09449219703674316 length of segment : 730 time for calcul the mask position with numpy : 0.0006215572357177734 nb_pixel_total : 23079 time to create 1 rle with old method : 0.026395559310913086 length of segment : 141 time for calcul the mask position with numpy : 0.0006954669952392578 nb_pixel_total : 17180 time to create 1 rle with old method : 0.020084619522094727 length of segment : 164 time for calcul the mask position with numpy : 0.0033152103424072266 nb_pixel_total : 105496 time to create 1 rle with old method : 0.11783099174499512 length of segment : 327 time for calcul the mask position with numpy : 0.0021178722381591797 nb_pixel_total : 53445 time to create 1 rle with old method : 0.05907797813415527 length of segment : 525 time for calcul the mask position with numpy : 0.0013630390167236328 nb_pixel_total : 43561 time to create 1 rle with old method : 0.04878115653991699 length of segment : 272 time for calcul the mask position with numpy : 0.0008399486541748047 nb_pixel_total : 23833 time to create 1 rle with old method : 0.027441740036010742 length of segment : 217 time for calcul the mask position with numpy : 0.000469207763671875 nb_pixel_total : 7577 time to create 1 rle with old method : 0.008660316467285156 length of segment : 104 time for calcul the mask position with numpy : 0.0007119178771972656 nb_pixel_total : 19818 time to create 1 rle with old method : 0.023044586181640625 length of segment : 129 time for calcul the mask position with numpy : 0.00045371055603027344 nb_pixel_total : 8096 time to create 1 rle with old method : 0.009368896484375 length of segment : 161 time for calcul the mask position with numpy : 0.0008482933044433594 nb_pixel_total : 21746 time to create 1 rle with old method : 0.025005102157592773 length of segment : 187 time for calcul the mask position with numpy : 0.0008821487426757812 nb_pixel_total : 31535 time to create 1 rle with old method : 0.03537273406982422 length of segment : 226 time for calcul the mask position with numpy : 0.0007331371307373047 nb_pixel_total : 17506 time to create 1 rle with old method : 0.019819259643554688 length of segment : 157 time for calcul the mask position with numpy : 0.004629850387573242 nb_pixel_total : 135193 time to create 1 rle with old method : 0.14980244636535645 length of segment : 590 time for calcul the mask position with numpy : 0.001712799072265625 nb_pixel_total : 50076 time to create 1 rle with old method : 0.06964755058288574 length of segment : 240 time for calcul the mask position with numpy : 0.0008752346038818359 nb_pixel_total : 24267 time to create 1 rle with old method : 0.027793407440185547 length of segment : 231 time for calcul the mask position with numpy : 0.0011136531829833984 nb_pixel_total : 40142 time to create 1 rle with old method : 0.04592323303222656 length of segment : 192 time for calcul the mask position with numpy : 0.0013239383697509766 nb_pixel_total : 43682 time to create 1 rle with old method : 0.04947781562805176 length of segment : 199 time for calcul the mask position with numpy : 0.0008502006530761719 nb_pixel_total : 17512 time to create 1 rle with old method : 0.020222187042236328 length of segment : 152 time for calcul the mask position with numpy : 0.0006940364837646484 nb_pixel_total : 17998 time to create 1 rle with old method : 0.020947694778442383 length of segment : 169 time for calcul the mask position with numpy : 0.002712249755859375 nb_pixel_total : 72642 time to create 1 rle with old method : 0.08225178718566895 length of segment : 317 time for calcul the mask position with numpy : 0.0025472640991210938 nb_pixel_total : 62305 time to create 1 rle with old method : 0.06931686401367188 length of segment : 433 time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 12685 time to create 1 rle with old method : 0.014616966247558594 length of segment : 250 time for calcul the mask position with numpy : 0.002613067626953125 nb_pixel_total : 82574 time to create 1 rle with old method : 0.09107446670532227 length of segment : 321 time for calcul the mask position with numpy : 0.0012013912200927734 nb_pixel_total : 44091 time to create 1 rle with old method : 0.04761958122253418 length of segment : 309 time for calcul the mask position with numpy : 0.0004467964172363281 nb_pixel_total : 8643 time to create 1 rle with old method : 0.009806632995605469 length of segment : 176 time for calcul the mask position with numpy : 0.0011086463928222656 nb_pixel_total : 22653 time to create 1 rle with old method : 0.0254971981048584 length of segment : 118 time for calcul the mask position with numpy : 0.0011754035949707031 nb_pixel_total : 45537 time to create 1 rle with old method : 0.04954338073730469 length of segment : 270 time for calcul the mask position with numpy : 0.0009789466857910156 nb_pixel_total : 37270 time to create 1 rle with old method : 0.04212021827697754 length of segment : 236 time for calcul the mask position with numpy : 0.0005381107330322266 nb_pixel_total : 10213 time to create 1 rle with old method : 0.014997243881225586 length of segment : 165 time for calcul the mask position with numpy : 0.0036537647247314453 nb_pixel_total : 121339 time to create 1 rle with old method : 0.1508181095123291 length of segment : 580 time for calcul the mask position with numpy : 0.0008814334869384766 nb_pixel_total : 30312 time to create 1 rle with old method : 0.03419327735900879 length of segment : 145 time for calcul the mask position with numpy : 0.0009508132934570312 nb_pixel_total : 25387 time to create 1 rle with old method : 0.028387784957885742 length of segment : 388 time for calcul the mask position with numpy : 0.0019097328186035156 nb_pixel_total : 56892 time to create 1 rle with old method : 0.06447529792785645 length of segment : 528 time for calcul the mask position with numpy : 0.0007383823394775391 nb_pixel_total : 25756 time to create 1 rle with old method : 0.029376745223999023 length of segment : 185 time for calcul the mask position with numpy : 0.0026810169219970703 nb_pixel_total : 130138 time to create 1 rle with old method : 0.1439361572265625 length of segment : 335 time for calcul the mask position with numpy : 0.0019137859344482422 nb_pixel_total : 56995 time to create 1 rle with old method : 0.06129741668701172 length of segment : 334 time for calcul the mask position with numpy : 0.0006234645843505859 nb_pixel_total : 12000 time to create 1 rle with old method : 0.01974177360534668 length of segment : 134 time for calcul the mask position with numpy : 0.0011217594146728516 nb_pixel_total : 28574 time to create 1 rle with old method : 0.037459611892700195 length of segment : 224 time for calcul the mask position with numpy : 0.0011148452758789062 nb_pixel_total : 32953 time to create 1 rle with old method : 0.03728342056274414 length of segment : 315 time for calcul the mask position with numpy : 0.0007560253143310547 nb_pixel_total : 29620 time to create 1 rle with old method : 0.03451204299926758 length of segment : 197 time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 31548 time to create 1 rle with old method : 0.035872459411621094 length of segment : 196 time for calcul the mask position with numpy : 0.002215862274169922 nb_pixel_total : 113459 time to create 1 rle with old method : 0.12743043899536133 length of segment : 456 time for calcul the mask position with numpy : 0.0005936622619628906 nb_pixel_total : 10098 time to create 1 rle with old method : 0.01148533821105957 length of segment : 168 time for calcul the mask position with numpy : 0.003031492233276367 nb_pixel_total : 126503 time to create 1 rle with old method : 0.14547252655029297 length of segment : 382 time for calcul the mask position with numpy : 0.0012392997741699219 nb_pixel_total : 22180 time to create 1 rle with old method : 0.025845050811767578 length of segment : 255 time for calcul the mask position with numpy : 0.003905057907104492 nb_pixel_total : 116797 time to create 1 rle with old method : 0.15647029876708984 length of segment : 476 time for calcul the mask position with numpy : 0.0017597675323486328 nb_pixel_total : 60981 time to create 1 rle with old method : 0.08265852928161621 length of segment : 222 time for calcul the mask position with numpy : 0.0012793540954589844 nb_pixel_total : 49313 time to create 1 rle with old method : 0.05508828163146973 length of segment : 279 time for calcul the mask position with numpy : 0.0006260871887207031 nb_pixel_total : 10443 time to create 1 rle with old method : 0.012480497360229492 length of segment : 131 time for calcul the mask position with numpy : 0.0008158683776855469 nb_pixel_total : 16899 time to create 1 rle with old method : 0.019219160079956055 length of segment : 149 time for calcul the mask position with numpy : 0.0020503997802734375 nb_pixel_total : 31159 time to create 1 rle with old method : 0.03591203689575195 length of segment : 265 time for calcul the mask position with numpy : 0.0028488636016845703 nb_pixel_total : 75948 time to create 1 rle with old method : 0.0838615894317627 length of segment : 259 time for calcul the mask position with numpy : 0.00046324729919433594 nb_pixel_total : 10309 time to create 1 rle with old method : 0.012197494506835938 length of segment : 99 time for calcul the mask position with numpy : 0.0041658878326416016 nb_pixel_total : 117814 time to create 1 rle with old method : 0.12942147254943848 length of segment : 793 time for calcul the mask position with numpy : 0.0022935867309570312 nb_pixel_total : 89929 time to create 1 rle with old method : 0.09760212898254395 length of segment : 244 time for calcul the mask position with numpy : 0.0011157989501953125 nb_pixel_total : 40715 time to create 1 rle with old method : 0.04593467712402344 length of segment : 218 time for calcul the mask position with numpy : 0.0006208419799804688 nb_pixel_total : 13751 time to create 1 rle with old method : 0.016529560089111328 length of segment : 146 time for calcul the mask position with numpy : 0.0004761219024658203 nb_pixel_total : 7720 time to create 1 rle with old method : 0.008941888809204102 length of segment : 135 time for calcul the mask position with numpy : 0.002004861831665039 nb_pixel_total : 70601 time to create 1 rle with old method : 0.07882547378540039 length of segment : 335 time for calcul the mask position with numpy : 0.0008194446563720703 nb_pixel_total : 14473 time to create 1 rle with old method : 0.01640009880065918 length of segment : 196 time for calcul the mask position with numpy : 0.002960681915283203 nb_pixel_total : 67242 time to create 1 rle with old method : 0.0757300853729248 length of segment : 329 time for calcul the mask position with numpy : 0.004043102264404297 nb_pixel_total : 124463 time to create 1 rle with old method : 0.19794869422912598 length of segment : 414 time for calcul the mask position with numpy : 0.0014705657958984375 nb_pixel_total : 33779 time to create 1 rle with old method : 0.03898167610168457 length of segment : 249 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 11299 time to create 1 rle with old method : 0.012992382049560547 length of segment : 188 time for calcul the mask position with numpy : 0.0007846355438232422 nb_pixel_total : 18334 time to create 1 rle with old method : 0.02172994613647461 length of segment : 131 time for calcul the mask position with numpy : 0.0011076927185058594 nb_pixel_total : 30099 time to create 1 rle with old method : 0.0346827507019043 length of segment : 148 time spent for convertir_results : 17.88089656829834 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 201 chid ids of type : 3594 Number RLEs to save : 54511 save missing photos in datou_result : time spend for datou_step_exec : 77.56704235076904 time spend to save output : 3.106247901916504 total time spend for step 1 : 80.67329025268555 step2:crop_condition Fri May 30 16:01:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 14 ! batch 1 Loaded 201 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 108 About to insert : list_path_to_insert length 108 new photo from crops ! About to upload 108 photos upload in portfolio : 3736932 init cache_photo without model_param we have 108 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748613744_1136183 we have uploaded 108 photos in the portfolio 3736932 time of upload the photos Elapsed time : 26.76760697364807 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3736932 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748613779_1136183 we have uploaded 27 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.023189544677734 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748613786_1136183 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6109933853149414 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 60 About to insert : list_path_to_insert length 60 new photo from crops ! About to upload 60 photos upload in portfolio : 3736932 init cache_photo without model_param we have 60 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748613804_1136183 we have uploaded 60 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.515072345733643 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748613824_1136183 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9556455612182617 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748613826_1136183 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8968281745910645 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361758093, 1361758090, 1361758087, 1361758085, 1361758081, 1361758064, 1361758053, 1361758045, 1361758014, 1361758011, 1361758007, 1361757999, 1361757994, 1361757989] Looping around the photos to save general results len do output : 201 /1361777332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361777669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758093', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758090', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758087', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758085', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758081', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758064', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758053', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758045', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758014', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758011', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758007', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757999', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757994', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757989', None, None, None, None, None, '2987541') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 617 time used for this insertion : 0.07374787330627441 save_final save missing photos in datou_result : time spend for datou_step_exec : 113.57503151893616 time spend to save output : 0.07866692543029785 total time spend for step 2 : 113.65369844436646 step3:rle_unique_nms_with_priority Fri May 30 16:03:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 201 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 0.9758591651916504 time for calcul the mask position with numpy : 0.2991507053375244 nb_pixel_total : 4624158 time to create 1 rle with new method : 0.24144768714904785 time for calcul the mask position with numpy : 0.02322530746459961 nb_pixel_total : 240035 time to create 1 rle with new method : 0.1421349048614502 time for calcul the mask position with numpy : 0.02234959602355957 nb_pixel_total : 36099 time to create 1 rle with old method : 0.04005289077758789 time for calcul the mask position with numpy : 0.022006750106811523 nb_pixel_total : 13304 time to create 1 rle with old method : 0.01594257354736328 time for calcul the mask position with numpy : 0.023706674575805664 nb_pixel_total : 310278 time to create 1 rle with new method : 0.1423170566558838 time for calcul the mask position with numpy : 0.022965431213378906 nb_pixel_total : 298338 time to create 1 rle with new method : 0.13921141624450684 time for calcul the mask position with numpy : 0.022627830505371094 nb_pixel_total : 4133 time to create 1 rle with old method : 0.006710529327392578 time for calcul the mask position with numpy : 0.02257990837097168 nb_pixel_total : 18058 time to create 1 rle with old method : 0.02559375762939453 time for calcul the mask position with numpy : 0.023255109786987305 nb_pixel_total : 76937 time to create 1 rle with old method : 0.08603096008300781 time for calcul the mask position with numpy : 0.020450592041015625 nb_pixel_total : 26886 time to create 1 rle with old method : 0.029899120330810547 time for calcul the mask position with numpy : 0.02027440071105957 nb_pixel_total : 27610 time to create 1 rle with old method : 0.030037879943847656 time for calcul the mask position with numpy : 0.020304441452026367 nb_pixel_total : 13626 time to create 1 rle with old method : 0.014801979064941406 time for calcul the mask position with numpy : 0.02155470848083496 nb_pixel_total : 18266 time to create 1 rle with old method : 0.020155668258666992 time for calcul the mask position with numpy : 0.02010655403137207 nb_pixel_total : 19751 time to create 1 rle with old method : 0.021739482879638672 time for calcul the mask position with numpy : 0.020438194274902344 nb_pixel_total : 69900 time to create 1 rle with old method : 0.07695508003234863 time for calcul the mask position with numpy : 0.021306753158569336 nb_pixel_total : 52004 time to create 1 rle with old method : 0.05693531036376953 time for calcul the mask position with numpy : 0.020467519760131836 nb_pixel_total : 27782 time to create 1 rle with old method : 0.03058171272277832 time for calcul the mask position with numpy : 0.020427465438842773 nb_pixel_total : 19593 time to create 1 rle with old method : 0.021762371063232422 time for calcul the mask position with numpy : 0.024244070053100586 nb_pixel_total : 45600 time to create 1 rle with old method : 0.050462961196899414 time for calcul the mask position with numpy : 0.0216677188873291 nb_pixel_total : 2463 time to create 1 rle with old method : 0.003022909164428711 time for calcul the mask position with numpy : 0.03042745590209961 nb_pixel_total : 893359 time to create 1 rle with new method : 0.13871407508850098 time for calcul the mask position with numpy : 0.024440526962280273 nb_pixel_total : 212060 time to create 1 rle with new method : 0.14005374908447266 create new chi : 2.3363966941833496 time to delete rle : 0.020402908325195312 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 15021 TO DO : save crop sub photo not yet done ! save time : 0.8826963901519775 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 0.5223758220672607 time for calcul the mask position with numpy : 0.0720975399017334 nb_pixel_total : 6237160 time to create 1 rle with new method : 0.1320514678955078 time for calcul the mask position with numpy : 0.020041465759277344 nb_pixel_total : 6418 time to create 1 rle with old method : 0.00692296028137207 time for calcul the mask position with numpy : 0.02070140838623047 nb_pixel_total : 54632 time to create 1 rle with old method : 0.060357093811035156 time for calcul the mask position with numpy : 0.021768569946289062 nb_pixel_total : 46892 time to create 1 rle with old method : 0.050577640533447266 time for calcul the mask position with numpy : 0.021917343139648438 nb_pixel_total : 58428 time to create 1 rle with old method : 0.06382083892822266 time for calcul the mask position with numpy : 0.02166604995727539 nb_pixel_total : 23042 time to create 1 rle with old method : 0.02568507194519043 time for calcul the mask position with numpy : 0.021242618560791016 nb_pixel_total : 47644 time to create 1 rle with old method : 0.05340385437011719 time for calcul the mask position with numpy : 0.026539325714111328 nb_pixel_total : 19397 time to create 1 rle with old method : 0.02187490463256836 time for calcul the mask position with numpy : 0.022082090377807617 nb_pixel_total : 34803 time to create 1 rle with old method : 0.040151119232177734 time for calcul the mask position with numpy : 0.020840883255004883 nb_pixel_total : 32809 time to create 1 rle with old method : 0.03649306297302246 time for calcul the mask position with numpy : 0.024371623992919922 nb_pixel_total : 357664 time to create 1 rle with new method : 0.1326298713684082 time for calcul the mask position with numpy : 0.02008795738220215 nb_pixel_total : 10676 time to create 1 rle with old method : 0.011692285537719727 time for calcul the mask position with numpy : 0.020882129669189453 nb_pixel_total : 106993 time to create 1 rle with old method : 0.12210416793823242 time for calcul the mask position with numpy : 0.02103137969970703 nb_pixel_total : 13682 time to create 1 rle with old method : 0.015041589736938477 create new chi : 1.1551218032836914 time to delete rle : 0.0011916160583496094 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8998 TO DO : save crop sub photo not yet done ! save time : 0.5464298725128174 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 0.6535003185272217 time for calcul the mask position with numpy : 0.08590865135192871 nb_pixel_total : 6109231 time to create 1 rle with new method : 0.15871429443359375 time for calcul the mask position with numpy : 0.020790815353393555 nb_pixel_total : 23342 time to create 1 rle with old method : 0.02621173858642578 time for calcul the mask position with numpy : 0.02493000030517578 nb_pixel_total : 26133 time to create 1 rle with old method : 0.03311967849731445 time for calcul the mask position with numpy : 0.020507335662841797 nb_pixel_total : 55991 time to create 1 rle with old method : 0.06349039077758789 time for calcul the mask position with numpy : 0.021506786346435547 nb_pixel_total : 60663 time to create 1 rle with old method : 0.06738686561584473 time for calcul the mask position with numpy : 0.021552562713623047 nb_pixel_total : 19396 time to create 1 rle with old method : 0.02170252799987793 time for calcul the mask position with numpy : 0.02145838737487793 nb_pixel_total : 15367 time to create 1 rle with old method : 0.01713728904724121 time for calcul the mask position with numpy : 0.02092742919921875 nb_pixel_total : 71283 time to create 1 rle with old method : 0.07813596725463867 time for calcul the mask position with numpy : 0.020595073699951172 nb_pixel_total : 83264 time to create 1 rle with old method : 0.09203767776489258 time for calcul the mask position with numpy : 0.02259349822998047 nb_pixel_total : 400322 time to create 1 rle with new method : 0.12843918800354004 time for calcul the mask position with numpy : 0.022503376007080078 nb_pixel_total : 32963 time to create 1 rle with old method : 0.0525970458984375 time for calcul the mask position with numpy : 0.020660877227783203 nb_pixel_total : 14558 time to create 1 rle with old method : 0.016226768493652344 time for calcul the mask position with numpy : 0.02054142951965332 nb_pixel_total : 32451 time to create 1 rle with old method : 0.03574824333190918 time for calcul the mask position with numpy : 0.021003246307373047 nb_pixel_total : 25025 time to create 1 rle with old method : 0.027844905853271484 time for calcul the mask position with numpy : 0.02221512794494629 nb_pixel_total : 33704 time to create 1 rle with old method : 0.037233591079711914 time for calcul the mask position with numpy : 0.021135330200195312 nb_pixel_total : 25627 time to create 1 rle with old method : 0.028398513793945312 time for calcul the mask position with numpy : 0.021886587142944336 nb_pixel_total : 20920 time to create 1 rle with old method : 0.02351975440979004 create new chi : 1.368863582611084 time to delete rle : 0.0016431808471679688 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 11116 TO DO : save crop sub photo not yet done ! save time : 0.659182071685791 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 0.6639978885650635 time for calcul the mask position with numpy : 0.07316207885742188 nb_pixel_total : 6447196 time to create 1 rle with new method : 0.13311243057250977 time for calcul the mask position with numpy : 0.019657373428344727 nb_pixel_total : 23615 time to create 1 rle with old method : 0.02530503273010254 time for calcul the mask position with numpy : 0.02071523666381836 nb_pixel_total : 117940 time to create 1 rle with old method : 0.12540006637573242 time for calcul the mask position with numpy : 0.022259235382080078 nb_pixel_total : 17117 time to create 1 rle with old method : 0.02734994888305664 time for calcul the mask position with numpy : 0.022431373596191406 nb_pixel_total : 43322 time to create 1 rle with old method : 0.052051544189453125 time for calcul the mask position with numpy : 0.021397113800048828 nb_pixel_total : 16003 time to create 1 rle with old method : 0.02494025230407715 time for calcul the mask position with numpy : 0.02220892906188965 nb_pixel_total : 31987 time to create 1 rle with old method : 0.04653787612915039 time for calcul the mask position with numpy : 0.022261381149291992 nb_pixel_total : 49324 time to create 1 rle with old method : 0.06216597557067871 time for calcul the mask position with numpy : 0.021225929260253906 nb_pixel_total : 30954 time to create 1 rle with old method : 0.03441572189331055 time for calcul the mask position with numpy : 0.02071380615234375 nb_pixel_total : 83181 time to create 1 rle with old method : 0.09305834770202637 time for calcul the mask position with numpy : 0.020181655883789062 nb_pixel_total : 19333 time to create 1 rle with old method : 0.020967483520507812 time for calcul the mask position with numpy : 0.01996016502380371 nb_pixel_total : 20061 time to create 1 rle with old method : 0.021918773651123047 time for calcul the mask position with numpy : 0.020076990127563477 nb_pixel_total : 26299 time to create 1 rle with old method : 0.02873539924621582 time for calcul the mask position with numpy : 0.020015954971313477 nb_pixel_total : 30996 time to create 1 rle with old method : 0.03347301483154297 time for calcul the mask position with numpy : 0.02019333839416504 nb_pixel_total : 38200 time to create 1 rle with old method : 0.04116320610046387 time for calcul the mask position with numpy : 0.01933455467224121 nb_pixel_total : 35302 time to create 1 rle with old method : 0.03734898567199707 time for calcul the mask position with numpy : 0.020052671432495117 nb_pixel_total : 19410 time to create 1 rle with old method : 0.021094560623168945 create new chi : 1.2502171993255615 time to delete rle : 0.0013756752014160156 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9632 TO DO : save crop sub photo not yet done ! save time : 0.6082828044891357 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 0.693455696105957 time for calcul the mask position with numpy : 0.0714116096496582 nb_pixel_total : 6017163 time to create 1 rle with new method : 0.13664746284484863 time for calcul the mask position with numpy : 0.02062702178955078 nb_pixel_total : 78789 time to create 1 rle with old method : 0.08508014678955078 time for calcul the mask position with numpy : 0.020653963088989258 nb_pixel_total : 18361 time to create 1 rle with old method : 0.020622730255126953 time for calcul the mask position with numpy : 0.020062923431396484 nb_pixel_total : 6590 time to create 1 rle with old method : 0.007336854934692383 time for calcul the mask position with numpy : 0.019667625427246094 nb_pixel_total : 16637 time to create 1 rle with old method : 0.01827216148376465 time for calcul the mask position with numpy : 0.020690441131591797 nb_pixel_total : 78685 time to create 1 rle with old method : 0.08421111106872559 time for calcul the mask position with numpy : 0.019263744354248047 nb_pixel_total : 30322 time to create 1 rle with old method : 0.031237125396728516 time for calcul the mask position with numpy : 0.01956009864807129 nb_pixel_total : 15398 time to create 1 rle with old method : 0.016454219818115234 time for calcul the mask position with numpy : 0.021041154861450195 nb_pixel_total : 109161 time to create 1 rle with old method : 0.12270116806030273 time for calcul the mask position with numpy : 0.020871400833129883 nb_pixel_total : 15654 time to create 1 rle with old method : 0.01722431182861328 time for calcul the mask position with numpy : 0.025509119033813477 nb_pixel_total : 422491 time to create 1 rle with new method : 0.13562965393066406 time for calcul the mask position with numpy : 0.02224111557006836 nb_pixel_total : 44350 time to create 1 rle with old method : 0.04919123649597168 time for calcul the mask position with numpy : 0.02171182632446289 nb_pixel_total : 24033 time to create 1 rle with old method : 0.026276350021362305 time for calcul the mask position with numpy : 0.020861148834228516 nb_pixel_total : 21382 time to create 1 rle with old method : 0.023304224014282227 time for calcul the mask position with numpy : 0.0208280086517334 nb_pixel_total : 33104 time to create 1 rle with old method : 0.03647899627685547 time for calcul the mask position with numpy : 0.021013736724853516 nb_pixel_total : 104501 time to create 1 rle with old method : 0.11253666877746582 time for calcul the mask position with numpy : 0.021458148956298828 nb_pixel_total : 13619 time to create 1 rle with old method : 0.01727151870727539 create new chi : 1.377004623413086 time to delete rle : 0.002526998519897461 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12390 TO DO : save crop sub photo not yet done ! save time : 0.7384042739868164 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 0.8854160308837891 time for calcul the mask position with numpy : 0.07831263542175293 nb_pixel_total : 6058550 time to create 1 rle with new method : 0.14220857620239258 time for calcul the mask position with numpy : 0.02151966094970703 nb_pixel_total : 85724 time to create 1 rle with old method : 0.1045382022857666 time for calcul the mask position with numpy : 0.020629405975341797 nb_pixel_total : 27443 time to create 1 rle with old method : 0.030307769775390625 time for calcul the mask position with numpy : 0.021038055419921875 nb_pixel_total : 29795 time to create 1 rle with old method : 0.03299593925476074 time for calcul the mask position with numpy : 0.020989418029785156 nb_pixel_total : 13296 time to create 1 rle with old method : 0.014987707138061523 time for calcul the mask position with numpy : 0.02072930335998535 nb_pixel_total : 17784 time to create 1 rle with old method : 0.019843101501464844 time for calcul the mask position with numpy : 0.020535707473754883 nb_pixel_total : 50768 time to create 1 rle with old method : 0.05542802810668945 time for calcul the mask position with numpy : 0.02057337760925293 nb_pixel_total : 27214 time to create 1 rle with old method : 0.03344321250915527 time for calcul the mask position with numpy : 0.022301673889160156 nb_pixel_total : 77224 time to create 1 rle with old method : 0.11355161666870117 time for calcul the mask position with numpy : 0.02190089225769043 nb_pixel_total : 24142 time to create 1 rle with old method : 0.04037952423095703 time for calcul the mask position with numpy : 0.023197412490844727 nb_pixel_total : 56163 time to create 1 rle with old method : 0.06706595420837402 time for calcul the mask position with numpy : 0.021323442459106445 nb_pixel_total : 56348 time to create 1 rle with old method : 0.06276679039001465 time for calcul the mask position with numpy : 0.02219390869140625 nb_pixel_total : 91813 time to create 1 rle with old method : 0.10573506355285645 time for calcul the mask position with numpy : 0.021101951599121094 nb_pixel_total : 20730 time to create 1 rle with old method : 0.022682666778564453 time for calcul the mask position with numpy : 0.02017831802368164 nb_pixel_total : 17217 time to create 1 rle with old method : 0.018594980239868164 time for calcul the mask position with numpy : 0.020384550094604492 nb_pixel_total : 85334 time to create 1 rle with old method : 0.09305286407470703 time for calcul the mask position with numpy : 0.019968271255493164 nb_pixel_total : 9191 time to create 1 rle with old method : 0.009937524795532227 time for calcul the mask position with numpy : 0.020136117935180664 nb_pixel_total : 83973 time to create 1 rle with old method : 0.0911719799041748 time for calcul the mask position with numpy : 0.02048969268798828 nb_pixel_total : 47600 time to create 1 rle with old method : 0.05165266990661621 time for calcul the mask position with numpy : 0.020318031311035156 nb_pixel_total : 58424 time to create 1 rle with old method : 0.06262826919555664 time for calcul the mask position with numpy : 0.020643234252929688 nb_pixel_total : 62658 time to create 1 rle with old method : 0.06914258003234863 time for calcul the mask position with numpy : 0.020297765731811523 nb_pixel_total : 25145 time to create 1 rle with old method : 0.027186155319213867 time for calcul the mask position with numpy : 0.020414352416992188 nb_pixel_total : 23704 time to create 1 rle with old method : 0.026324033737182617 create new chi : 1.851982593536377 time to delete rle : 0.00189971923828125 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 12520 TO DO : save crop sub photo not yet done ! save time : 0.7677490711212158 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 0.4198942184448242 time for calcul the mask position with numpy : 0.07809114456176758 nb_pixel_total : 6807386 time to create 1 rle with new method : 0.13300681114196777 time for calcul the mask position with numpy : 0.020434856414794922 nb_pixel_total : 13927 time to create 1 rle with old method : 0.015388965606689453 time for calcul the mask position with numpy : 0.020326614379882812 nb_pixel_total : 23041 time to create 1 rle with old method : 0.025449037551879883 time for calcul the mask position with numpy : 0.020615577697753906 nb_pixel_total : 28917 time to create 1 rle with old method : 0.03180432319641113 time for calcul the mask position with numpy : 0.020211219787597656 nb_pixel_total : 19753 time to create 1 rle with old method : 0.02173590660095215 time for calcul the mask position with numpy : 0.0203092098236084 nb_pixel_total : 40960 time to create 1 rle with old method : 0.04535961151123047 time for calcul the mask position with numpy : 0.020348072052001953 nb_pixel_total : 8250 time to create 1 rle with old method : 0.009022235870361328 time for calcul the mask position with numpy : 0.021264076232910156 nb_pixel_total : 33776 time to create 1 rle with old method : 0.03696846961975098 time for calcul the mask position with numpy : 0.02100396156311035 nb_pixel_total : 12105 time to create 1 rle with old method : 0.013388395309448242 time for calcul the mask position with numpy : 0.020735502243041992 nb_pixel_total : 45155 time to create 1 rle with old method : 0.05755162239074707 time for calcul the mask position with numpy : 0.021881818771362305 nb_pixel_total : 16970 time to create 1 rle with old method : 0.027194738388061523 create new chi : 0.71649169921875 time to delete rle : 0.0010802745819091797 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 5610 TO DO : save crop sub photo not yet done ! save time : 0.3651106357574463 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 0.5767524242401123 time for calcul the mask position with numpy : 0.0821526050567627 nb_pixel_total : 6290198 time to create 1 rle with new method : 0.14268159866333008 time for calcul the mask position with numpy : 0.02093672752380371 nb_pixel_total : 55413 time to create 1 rle with old method : 0.06191444396972656 time for calcul the mask position with numpy : 0.021052837371826172 nb_pixel_total : 38032 time to create 1 rle with old method : 0.04237866401672363 time for calcul the mask position with numpy : 0.02157139778137207 nb_pixel_total : 62838 time to create 1 rle with old method : 0.07114791870117188 time for calcul the mask position with numpy : 0.020972490310668945 nb_pixel_total : 36230 time to create 1 rle with old method : 0.04709291458129883 time for calcul the mask position with numpy : 0.02054738998413086 nb_pixel_total : 26792 time to create 1 rle with old method : 0.02923583984375 time for calcul the mask position with numpy : 0.019945621490478516 nb_pixel_total : 18330 time to create 1 rle with old method : 0.020140647888183594 time for calcul the mask position with numpy : 0.021741628646850586 nb_pixel_total : 71435 time to create 1 rle with old method : 0.07824325561523438 time for calcul the mask position with numpy : 0.02072429656982422 nb_pixel_total : 22872 time to create 1 rle with old method : 0.02403569221496582 time for calcul the mask position with numpy : 0.019878864288330078 nb_pixel_total : 23947 time to create 1 rle with old method : 0.02572011947631836 time for calcul the mask position with numpy : 0.02073812484741211 nb_pixel_total : 194924 time to create 1 rle with new method : 0.12970352172851562 time for calcul the mask position with numpy : 0.020737171173095703 nb_pixel_total : 15043 time to create 1 rle with old method : 0.016311168670654297 time for calcul the mask position with numpy : 0.022525310516357422 nb_pixel_total : 16515 time to create 1 rle with old method : 0.018059730529785156 time for calcul the mask position with numpy : 0.020224332809448242 nb_pixel_total : 65308 time to create 1 rle with old method : 0.07659912109375 time for calcul the mask position with numpy : 0.02129960060119629 nb_pixel_total : 42944 time to create 1 rle with old method : 0.046309471130371094 time for calcul the mask position with numpy : 0.020322561264038086 nb_pixel_total : 69419 time to create 1 rle with old method : 0.07636880874633789 create new chi : 1.3285515308380127 time to delete rle : 0.001798868179321289 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10882 TO DO : save crop sub photo not yet done ! save time : 0.6683793067932129 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 0.6958475112915039 time for calcul the mask position with numpy : 0.07387876510620117 nb_pixel_total : 6499902 time to create 1 rle with new method : 0.1365957260131836 time for calcul the mask position with numpy : 0.020884275436401367 nb_pixel_total : 31535 time to create 1 rle with old method : 0.03433060646057129 time for calcul the mask position with numpy : 0.0215451717376709 nb_pixel_total : 21746 time to create 1 rle with old method : 0.023979902267456055 time for calcul the mask position with numpy : 0.021138668060302734 nb_pixel_total : 8096 time to create 1 rle with old method : 0.008958816528320312 time for calcul the mask position with numpy : 0.020822763442993164 nb_pixel_total : 19818 time to create 1 rle with old method : 0.022631406784057617 time for calcul the mask position with numpy : 0.020919322967529297 nb_pixel_total : 7577 time to create 1 rle with old method : 0.012046575546264648 time for calcul the mask position with numpy : 0.02390122413635254 nb_pixel_total : 23833 time to create 1 rle with old method : 0.026262283325195312 time for calcul the mask position with numpy : 0.02039194107055664 nb_pixel_total : 43561 time to create 1 rle with old method : 0.04824686050415039 time for calcul the mask position with numpy : 0.02118396759033203 nb_pixel_total : 53445 time to create 1 rle with old method : 0.05880308151245117 time for calcul the mask position with numpy : 0.020665884017944336 nb_pixel_total : 105496 time to create 1 rle with old method : 0.11585879325866699 time for calcul the mask position with numpy : 0.021122217178344727 nb_pixel_total : 17180 time to create 1 rle with old method : 0.018871068954467773 time for calcul the mask position with numpy : 0.020847320556640625 nb_pixel_total : 23079 time to create 1 rle with old method : 0.02564382553100586 time for calcul the mask position with numpy : 0.02098989486694336 nb_pixel_total : 78619 time to create 1 rle with old method : 0.08601069450378418 time for calcul the mask position with numpy : 0.020107507705688477 nb_pixel_total : 17058 time to create 1 rle with old method : 0.018919706344604492 time for calcul the mask position with numpy : 0.019757747650146484 nb_pixel_total : 24358 time to create 1 rle with old method : 0.02859044075012207 time for calcul the mask position with numpy : 0.020557165145874023 nb_pixel_total : 11066 time to create 1 rle with old method : 0.012106180191040039 time for calcul the mask position with numpy : 0.02007603645324707 nb_pixel_total : 37171 time to create 1 rle with old method : 0.040105342864990234 time for calcul the mask position with numpy : 0.02029585838317871 nb_pixel_total : 26700 time to create 1 rle with old method : 0.028501510620117188 create new chi : 1.1901600360870361 time to delete rle : 0.0015540122985839844 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 10324 TO DO : save crop sub photo not yet done ! save time : 0.6546192169189453 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 0.40705394744873047 time for calcul the mask position with numpy : 0.08356499671936035 nb_pixel_total : 6568917 time to create 1 rle with new method : 0.13882994651794434 time for calcul the mask position with numpy : 0.020765304565429688 nb_pixel_total : 62305 time to create 1 rle with old method : 0.06695270538330078 time for calcul the mask position with numpy : 0.01987767219543457 nb_pixel_total : 72642 time to create 1 rle with old method : 0.07878637313842773 time for calcul the mask position with numpy : 0.01963639259338379 nb_pixel_total : 17998 time to create 1 rle with old method : 0.019382476806640625 time for calcul the mask position with numpy : 0.019662141799926758 nb_pixel_total : 17512 time to create 1 rle with old method : 0.018413066864013672 time for calcul the mask position with numpy : 0.019669055938720703 nb_pixel_total : 43682 time to create 1 rle with old method : 0.0464632511138916 time for calcul the mask position with numpy : 0.019505739212036133 nb_pixel_total : 40142 time to create 1 rle with old method : 0.04262113571166992 time for calcul the mask position with numpy : 0.01989889144897461 nb_pixel_total : 24267 time to create 1 rle with old method : 0.026414871215820312 time for calcul the mask position with numpy : 0.020267486572265625 nb_pixel_total : 50076 time to create 1 rle with old method : 0.0542292594909668 time for calcul the mask position with numpy : 0.019909143447875977 nb_pixel_total : 135193 time to create 1 rle with old method : 0.14864635467529297 time for calcul the mask position with numpy : 0.021759510040283203 nb_pixel_total : 17506 time to create 1 rle with old method : 0.027980804443359375 create new chi : 0.9677844047546387 time to delete rle : 0.0014421939849853516 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7520 TO DO : save crop sub photo not yet done ! save time : 0.4747893810272217 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 0.38936758041381836 time for calcul the mask position with numpy : 0.07623839378356934 nb_pixel_total : 6634923 time to create 1 rle with new method : 0.13442540168762207 time for calcul the mask position with numpy : 0.020987510681152344 nb_pixel_total : 30312 time to create 1 rle with old method : 0.03351473808288574 time for calcul the mask position with numpy : 0.020682096481323242 nb_pixel_total : 121339 time to create 1 rle with old method : 0.13147735595703125 time for calcul the mask position with numpy : 0.02006673812866211 nb_pixel_total : 10213 time to create 1 rle with old method : 0.011192798614501953 time for calcul the mask position with numpy : 0.01965498924255371 nb_pixel_total : 37270 time to create 1 rle with old method : 0.04032611846923828 time for calcul the mask position with numpy : 0.02000117301940918 nb_pixel_total : 45537 time to create 1 rle with old method : 0.04968976974487305 time for calcul the mask position with numpy : 0.021232128143310547 nb_pixel_total : 22653 time to create 1 rle with old method : 0.024609804153442383 time for calcul the mask position with numpy : 0.020490646362304688 nb_pixel_total : 8643 time to create 1 rle with old method : 0.0096893310546875 time for calcul the mask position with numpy : 0.02296757698059082 nb_pixel_total : 44091 time to create 1 rle with old method : 0.047331809997558594 time for calcul the mask position with numpy : 0.020185470581054688 nb_pixel_total : 82574 time to create 1 rle with old method : 0.09003877639770508 time for calcul the mask position with numpy : 0.020064830780029297 nb_pixel_total : 12685 time to create 1 rle with old method : 0.013596057891845703 create new chi : 0.8837709426879883 time to delete rle : 0.0011510848999023438 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 7300 TO DO : save crop sub photo not yet done ! save time : 0.44983434677124023 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 0.4158482551574707 time for calcul the mask position with numpy : 0.07936358451843262 nb_pixel_total : 6508350 time to create 1 rle with new method : 0.13267278671264648 time for calcul the mask position with numpy : 0.020763397216796875 nb_pixel_total : 112984 time to create 1 rle with old method : 0.12457871437072754 time for calcul the mask position with numpy : 0.020035743713378906 nb_pixel_total : 30591 time to create 1 rle with old method : 0.033262014389038086 time for calcul the mask position with numpy : 0.01990032196044922 nb_pixel_total : 29620 time to create 1 rle with old method : 0.031998395919799805 time for calcul the mask position with numpy : 0.019480466842651367 nb_pixel_total : 32953 time to create 1 rle with old method : 0.03572726249694824 time for calcul the mask position with numpy : 0.019904136657714844 nb_pixel_total : 28574 time to create 1 rle with old method : 0.031275272369384766 time for calcul the mask position with numpy : 0.021741867065429688 nb_pixel_total : 12000 time to create 1 rle with old method : 0.021854162216186523 time for calcul the mask position with numpy : 0.02036428451538086 nb_pixel_total : 56995 time to create 1 rle with old method : 0.06177711486816406 time for calcul the mask position with numpy : 0.020524024963378906 nb_pixel_total : 130138 time to create 1 rle with old method : 0.13952255249023438 time for calcul the mask position with numpy : 0.019866466522216797 nb_pixel_total : 25756 time to create 1 rle with old method : 0.027394771575927734 time for calcul the mask position with numpy : 0.020158052444458008 nb_pixel_total : 56892 time to create 1 rle with old method : 0.0612492561340332 time for calcul the mask position with numpy : 0.020147085189819336 nb_pixel_total : 25387 time to create 1 rle with old method : 0.027684450149536133 create new chi : 1.0463593006134033 time to delete rle : 0.0012624263763427734 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8542 TO DO : save crop sub photo not yet done ! save time : 0.5282478332519531 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.2417600154876709 time for calcul the mask position with numpy : 0.07291984558105469 nb_pixel_total : 6664368 time to create 1 rle with new method : 0.13962221145629883 time for calcul the mask position with numpy : 0.020885229110717773 nb_pixel_total : 49313 time to create 1 rle with old method : 0.054700613021850586 time for calcul the mask position with numpy : 0.02043938636779785 nb_pixel_total : 60981 time to create 1 rle with old method : 0.06507754325866699 time for calcul the mask position with numpy : 0.02028346061706543 nb_pixel_total : 116797 time to create 1 rle with old method : 0.12622714042663574 time for calcul the mask position with numpy : 0.020462989807128906 nb_pixel_total : 22180 time to create 1 rle with old method : 0.027011632919311523 time for calcul the mask position with numpy : 0.02080392837524414 nb_pixel_total : 126503 time to create 1 rle with old method : 0.14316153526306152 time for calcul the mask position with numpy : 0.020398616790771484 nb_pixel_total : 10098 time to create 1 rle with old method : 0.011051177978515625 create new chi : 0.7778489589691162 time to delete rle : 0.0008757114410400391 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 5724 TO DO : save crop sub photo not yet done ! save time : 0.3650050163269043 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 0.6935052871704102 time for calcul the mask position with numpy : 0.06806445121765137 nb_pixel_total : 6265263 time to create 1 rle with new method : 0.1304004192352295 time for calcul the mask position with numpy : 0.020513057708740234 nb_pixel_total : 30099 time to create 1 rle with old method : 0.032441139221191406 time for calcul the mask position with numpy : 0.01895928382873535 nb_pixel_total : 18334 time to create 1 rle with old method : 0.01964116096496582 time for calcul the mask position with numpy : 0.018991947174072266 nb_pixel_total : 11299 time to create 1 rle with old method : 0.011783599853515625 time for calcul the mask position with numpy : 0.01903533935546875 nb_pixel_total : 33779 time to create 1 rle with old method : 0.036512136459350586 time for calcul the mask position with numpy : 0.01985335350036621 nb_pixel_total : 124463 time to create 1 rle with old method : 0.1288928985595703 time for calcul the mask position with numpy : 0.019992589950561523 nb_pixel_total : 67242 time to create 1 rle with old method : 0.07115745544433594 time for calcul the mask position with numpy : 0.0189971923828125 nb_pixel_total : 14473 time to create 1 rle with old method : 0.014943122863769531 time for calcul the mask position with numpy : 0.01932501792907715 nb_pixel_total : 70601 time to create 1 rle with old method : 0.07340359687805176 time for calcul the mask position with numpy : 0.01913905143737793 nb_pixel_total : 7720 time to create 1 rle with old method : 0.008027076721191406 time for calcul the mask position with numpy : 0.019431352615356445 nb_pixel_total : 13751 time to create 1 rle with old method : 0.014560461044311523 time for calcul the mask position with numpy : 0.019185543060302734 nb_pixel_total : 40715 time to create 1 rle with old method : 0.042253971099853516 time for calcul the mask position with numpy : 0.020041227340698242 nb_pixel_total : 89929 time to create 1 rle with old method : 0.0962226390838623 time for calcul the mask position with numpy : 0.020705699920654297 nb_pixel_total : 117814 time to create 1 rle with old method : 0.12462925910949707 time for calcul the mask position with numpy : 0.0200045108795166 nb_pixel_total : 10309 time to create 1 rle with old method : 0.01123356819152832 time for calcul the mask position with numpy : 0.02006673812866211 nb_pixel_total : 75948 time to create 1 rle with old method : 0.08148455619812012 time for calcul the mask position with numpy : 0.019466638565063477 nb_pixel_total : 31159 time to create 1 rle with old method : 0.03394651412963867 time for calcul the mask position with numpy : 0.020044565200805664 nb_pixel_total : 16899 time to create 1 rle with old method : 0.018515586853027344 time for calcul the mask position with numpy : 0.019927501678466797 nb_pixel_total : 10443 time to create 1 rle with old method : 0.011471986770629883 create new chi : 1.398465633392334 time to delete rle : 0.001687765121459961 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11018 TO DO : save crop sub photo not yet done ! save time : 0.6759638786315918 map_output_result : {1361758093: (0.0, 'Should be the crop_list due to order', 0), 1361758090: (0.0, 'Should be the crop_list due to order', 0), 1361758087: (0.0, 'Should be the crop_list due to order', 0), 1361758085: (0.0, 'Should be the crop_list due to order', 0), 1361758081: (0.0, 'Should be the crop_list due to order', 0), 1361758064: (0.0, 'Should be the crop_list due to order', 0), 1361758053: (0.0, 'Should be the crop_list due to order', 0), 1361758045: (0.0, 'Should be the crop_list due to order', 0), 1361758014: (0.0, 'Should be the crop_list due to order', 0), 1361758011: (0.0, 'Should be the crop_list due to order', 0), 1361758007: (0.0, 'Should be the crop_list due to order', 0), 1361757999: (0.0, 'Should be the crop_list due to order', 0), 1361757994: (0.0, 'Should be the crop_list due to order', 0), 1361757989: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361758093, 1361758090, 1361758087, 1361758085, 1361758081, 1361758064, 1361758053, 1361758045, 1361758014, 1361758011, 1361758007, 1361757999, 1361757994, 1361757989] Looping around the photos to save general results len do output : 14 /1361758093.Didn't retrieve data . /1361758090.Didn't retrieve data . /1361758087.Didn't retrieve data . /1361758085.Didn't retrieve data . /1361758081.Didn't retrieve data . /1361758064.Didn't retrieve data . /1361758053.Didn't retrieve data . /1361758045.Didn't retrieve data . /1361758014.Didn't retrieve data . /1361758011.Didn't retrieve data . /1361758007.Didn't retrieve data . /1361757999.Didn't retrieve data . /1361757994.Didn't retrieve data . /1361757989.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758093', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758090', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758087', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758085', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758081', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758064', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758053', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758045', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758014', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758011', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758007', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757999', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757994', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757989', None, None, None, None, None, '2987541') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.01349496841430664 save_final save missing photos in datou_result : time spend for datou_step_exec : 35.501559019088745 time spend to save output : 0.014012813568115234 total time spend for step 3 : 35.51557183265686 step4:ventilate_hashtags_in_portfolio Fri May 30 16:04:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23452977 get user id for portfolio 23452977 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23452977 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','flou','background','papier','metal','pehd','autre','pet_clair','mal_croppe','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23452977 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','flou','background','papier','metal','pehd','autre','pet_clair','mal_croppe','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23452977 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','flou','background','papier','metal','pehd','autre','pet_clair','mal_croppe','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23453558,23453559,23453560,23453561,23453562,23453563,23453564,23453565,23453566,23453567,23453568?tags=carton,flou,background,papier,metal,pehd,autre,pet_clair,mal_croppe,pet_fonce,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361758093, 1361758090, 1361758087, 1361758085, 1361758081, 1361758064, 1361758053, 1361758045, 1361758014, 1361758011, 1361758007, 1361757999, 1361757994, 1361757989] Looping around the photos to save general results len do output : 1 /23452977. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758093', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758090', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758087', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758085', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758081', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758064', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758053', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758045', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758014', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758011', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758007', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757999', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757994', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757989', None, None, None, None, None, '2987541') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014739751815795898 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5523674488067627 time spend to save output : 0.01571822166442871 total time spend for step 4 : 1.5680856704711914 step5:final Fri May 30 16:04:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361758093: ('0.11114712812208218',), 1361758090: ('0.11114712812208218',), 1361758087: ('0.11114712812208218',), 1361758085: ('0.11114712812208218',), 1361758081: ('0.11114712812208218',), 1361758064: ('0.11114712812208218',), 1361758053: ('0.11114712812208218',), 1361758045: ('0.11114712812208218',), 1361758014: ('0.11114712812208218',), 1361758011: ('0.11114712812208218',), 1361758007: ('0.11114712812208218',), 1361757999: ('0.11114712812208218',), 1361757994: ('0.11114712812208218',), 1361757989: ('0.11114712812208218',)} new output for save of step final : {1361758093: ('0.11114712812208218',), 1361758090: ('0.11114712812208218',), 1361758087: ('0.11114712812208218',), 1361758085: ('0.11114712812208218',), 1361758081: ('0.11114712812208218',), 1361758064: ('0.11114712812208218',), 1361758053: ('0.11114712812208218',), 1361758045: ('0.11114712812208218',), 1361758014: ('0.11114712812208218',), 1361758011: ('0.11114712812208218',), 1361758007: ('0.11114712812208218',), 1361757999: ('0.11114712812208218',), 1361757994: ('0.11114712812208218',), 1361757989: ('0.11114712812208218',)} [1361758093, 1361758090, 1361758087, 1361758085, 1361758081, 1361758064, 1361758053, 1361758045, 1361758014, 1361758011, 1361758007, 1361757999, 1361757994, 1361757989] Looping around the photos to save general results len do output : 14 /1361758093.Didn't retrieve data . /1361758090.Didn't retrieve data . /1361758087.Didn't retrieve data . /1361758085.Didn't retrieve data . /1361758081.Didn't retrieve data . /1361758064.Didn't retrieve data . /1361758053.Didn't retrieve data . /1361758045.Didn't retrieve data . /1361758014.Didn't retrieve data . /1361758011.Didn't retrieve data . /1361758007.Didn't retrieve data . /1361757999.Didn't retrieve data . /1361757994.Didn't retrieve data . /1361757989.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758093', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758090', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758087', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758085', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758081', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758064', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758053', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758045', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758014', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758011', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758007', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757999', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757994', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757989', None, None, None, None, None, '2987541') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.014333486557006836 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10805368423461914 time spend to save output : 0.014963626861572266 total time spend for step 5 : 0.1230173110961914 step6:blur_detection Fri May 30 16:04:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d.jpg resize: (2160, 3264) 1361758093 0.12245798059295873 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9.jpg resize: (2160, 3264) 1361758090 -1.896241342120384 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc.jpg resize: (2160, 3264) 1361758087 -4.8862086272343905 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350.jpg resize: (2160, 3264) 1361758085 -4.944082046824683 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd.jpg resize: (2160, 3264) 1361758081 -2.126722590727305 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59.jpg resize: (2160, 3264) 1361758064 -2.2295106631972312 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518.jpg resize: (2160, 3264) 1361758053 -2.1427959755011834 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5.jpg resize: (2160, 3264) 1361758045 0.5337454938036594 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a.jpg resize: (2160, 3264) 1361758014 -1.8646138834840655 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35.jpg resize: (2160, 3264) 1361758011 -1.7655345673574998 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce.jpg resize: (2160, 3264) 1361758007 -1.5842952460435982 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7.jpg resize: (2160, 3264) 1361757999 -3.0898299349811533 treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c.jpg resize: (2160, 3264) 1361757994 -2.348217649266632 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698.jpg resize: (2160, 3264) 1361757989 -5.298449182688539 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901249_0.png resize: (435, 689) 1361777332 -1.4384302884376186 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901250_0.png resize: (1148, 1233) 1361777333 0.37985963355111346 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901251_0.png resize: (175, 414) 1361777334 -1.7125851370884988 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901253_0.png resize: (185, 147) 1361777335 -0.2813637227378052 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901256_0.png resize: (268, 382) 1361777336 -0.20669568920010567 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901257_0.png resize: (195, 131) 1361777337 0.017798828918014063 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901259_0.png resize: (153, 137) 1361777338 -2.151708336858004 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901261_0.png resize: (161, 238) 1361777340 -1.4293865262104455 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901263_0.png resize: (132, 195) 1361777341 -1.1546429737737838 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901264_0.png resize: (110, 44) 1361777342 2.4090040040356175 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901265_0.png resize: (461, 850) 1361777343 -0.17408828820401645 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901266_0.png resize: (814, 527) 1361777344 0.9126090751134355 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901268_0.png resize: (333, 166) 1361777345 -0.9101004099847634 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901273_0.png resize: (750, 642) 1361777346 -2.152776930879387 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901275_0.png resize: (330, 192) 1361777347 -1.7780865471585785 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901277_0.png resize: (196, 295) 1361777348 -0.8179992565830487 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901281_0.png resize: (251, 318) 1361777349 -0.5481115206603282 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901283_0.png resize: (145, 231) 1361777350 -2.238076729350399 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901284_0.png resize: (137, 275) 1361777351 -1.653776831369362 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901287_0.png resize: (207, 232) 1361777352 -0.913916953709556 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901288_0.png resize: (158, 174) 1361777353 -2.983634203442863 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901289_0.png resize: (183, 231) 1361777354 -0.9260972758048843 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901291_0.png resize: (304, 459) 1361777355 -3.0464059728264927 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901293_0.png resize: (168, 130) 1361777356 -1.5013562219819914 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901294_0.png resize: (196, 151) 1361777357 -1.995409375219982 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901297_0.png resize: (150, 233) 1361777358 -3.174644462446392 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901298_0.png resize: (219, 137) 1361777359 -1.621424800372943 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901299_0.png resize: (154, 212) 1361777360 -2.167942436685663 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901302_0.png resize: (195, 225) 1361777361 -0.7103269626138621 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901303_0.png resize: (144, 249) 1361777362 -3.461203212944364 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901305_0.png resize: (194, 147) 1361777363 -1.8286368968130131 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901307_0.png resize: (258, 200) 1361777364 -2.9008530559523624 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901309_0.png resize: (237, 183) 1361777365 -2.7541576529814575 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901310_0.png resize: (181, 150) 1361777366 -1.590307737750461 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901313_0.png resize: (407, 413) 1361777367 -2.885525662748997 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901314_0.png resize: (165, 191) 1361777368 -2.6012262645012076 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901315_0.png resize: (100, 176) 1361777369 -2.410819364395688 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901317_0.png resize: (276, 145) 1361777371 0.15118253333707032 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901319_0.png resize: (170, 184) 1361777372 -0.05127522882320671 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901320_0.png resize: (290, 221) 1361777373 -0.5363214057473167 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901321_0.png resize: (1304, 502) 1361777374 -0.8052897307469379 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901322_0.png resize: (119, 175) 1361777375 -0.679931690302663 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901323_0.png resize: (324, 498) 1361777376 -1.3083445987783417 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901324_0.png resize: (154, 136) 1361777377 -1.3158563565430632 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901326_0.png resize: (327, 406) 1361777378 -1.2089998768480013 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901327_0.png resize: (164, 134) 1361777379 -0.28215597967159906 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901329_0.png resize: (296, 533) 1361777380 -0.6928043521834465 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901330_0.png resize: (265, 455) 1361777381 -1.4423925718190944 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901334_0.png resize: (301, 329) 1361777382 -0.27960459544287847 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901336_0.png resize: (319, 328) 1361777383 -1.3054749730250723 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901337_0.png resize: (149, 102) 1361777384 -1.0786818831163218 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901344_0.png resize: (185, 226) 1361777385 -1.512409441793267 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901348_0.png resize: (158, 155) 1361777386 0.6069828503684033 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901349_0.png resize: (133, 132) 1361777387 -0.42088410890120725 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901350_0.png resize: (162, 248) 1361777388 -0.3448630495626879 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901352_0.png resize: (435, 302) 1361777389 -1.0817583919330358 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901353_0.png resize: (143, 164) 1361777390 -0.664715923663658 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901354_0.png resize: (237, 281) 1361777391 -1.6699288337369596 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901355_0.png resize: (145, 108) 1361777392 1.271577350486548 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901356_0.png resize: (141, 318) 1361777393 -1.695916118965693 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901357_0.png resize: (136, 87) 1361777395 -0.831311416465495 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901359_0.png resize: (141, 174) 1361777396 0.3595606652199378 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901363_0.png resize: (426, 225) 1361777397 -0.12422713054891019 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901364_0.png resize: (340, 351) 1361777399 -1.7084123722415496 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901367_0.png resize: (141, 164) 1361777400 -0.25172083609709944 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901368_0.png resize: (383, 741) 1361777401 -1.1303571365923122 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901370_0.png resize: (156, 251) 1361777402 -1.362665566787732 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901372_0.png resize: (152, 205) 1361777404 -1.621361963120625 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901374_0.png resize: (215, 303) 1361777405 -1.2422433380290763 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901376_0.png resize: (204, 313) 1361777406 -0.7964149864068621 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901377_0.png resize: (366, 338) 1361777408 -1.6947177216593798 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901378_0.png resize: (246, 148) 1361777409 -0.20705642753920045 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901380_0.png resize: (149, 88) 1361777410 2.721708505114274 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901381_0.png resize: (174, 200) 1361777411 -1.2472302050352262 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901384_0.png resize: (141, 222) 1361777413 -0.1886977268371736 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901385_0.png resize: (164, 181) 1361777414 -0.9028092578759301 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901387_0.png resize: (448, 212) 1361777415 -1.2731350387206712 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901389_0.png resize: (195, 162) 1361777417 -0.9511123742412981 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901392_0.png resize: (161, 118) 1361777418 -1.0789981539480575 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901394_0.png resize: (226, 185) 1361777419 -1.0809392818846932 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901396_0.png resize: (482, 493) 1361777421 -0.9946303855962806 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901398_0.png resize: (200, 152) 1361777422 -1.05051130897965 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901401_0.png resize: (151, 149) 1361777423 0.38294417802105857 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901402_0.png resize: (164, 135) 1361777424 0.6496224035323122 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901404_0.png resize: (330, 356) 1361777426 -1.4810677354591975 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901405_0.png resize: (250, 165) 1361777427 -1.2838720436260174 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901407_0.png resize: (309, 220) 1361777428 -0.8353742905020974 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901410_0.png resize: (266, 202) 1361777429 -0.5726184644022388 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901411_0.png resize: (236, 211) 1361777430 -0.36232664660451924 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901412_0.png resize: (165, 112) 1361777432 -1.801843970739036 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901413_0.png resize: (510, 393) 1361777433 -1.419528990961374 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901414_0.png resize: (145, 320) 1361777434 -1.569342911744677 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901415_0.png resize: (378, 81) 1361777435 0.3986912556194372 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901417_0.png resize: (185, 181) 1361777436 -0.4876046472712341 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901421_0.png resize: (188, 243) 1361777437 -1.770725076727985 treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901426_0.png resize: (173, 105) 1361777438 -1.1561502379086666 treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901428_0.png resize: (255, 275) 1361777439 -0.9801213605214045 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901432_0.png resize: (131, 164) 1361777440 -2.307619127950992 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901433_0.png resize: (145, 216) 1361777441 -2.105933857749896 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901434_0.png resize: (265, 338) 1361777442 -1.4660292145233835 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901436_0.png resize: (99, 155) 1361777443 -4.171256948111422 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901437_0.png resize: (757, 238) 1361777444 -1.7048953235433064 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901439_0.png resize: (209, 289) 1361777447 -1.7865123565569534 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901440_0.png resize: (144, 141) 1361777448 -2.0933127173232884 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901441_0.png resize: (135, 79) 1361777449 -3.5026184778133764 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901446_0.png resize: (184, 327) 1361777450 -2.222343153961091 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901447_0.png resize: (188, 91) 1361777451 -1.3442655218588606 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901449_0.png resize: (136, 312) 1361777452 -2.946268770659923 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901252_0.png resize: (282, 270) 1361777465 -1.2349698483665754 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901258_0.png resize: (152, 187) 1361777466 -0.12714441723822115 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901269_0.png resize: (548, 590) 1361777467 -0.6731495269289424 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901272_0.png resize: (96, 128) 1361777468 1.652999945090576 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901276_0.png resize: (153, 163) 1361777469 -1.0082757505478055 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901285_0.png resize: (217, 296) 1361777470 -2.0526201584370765 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901290_0.png resize: (706, 890) 1361777471 -0.8154730332093609 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901300_0.png resize: (233, 293) 1361777472 -2.0005358450281547 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901311_0.png resize: (201, 278) 1361777473 -3.966033611939208 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901318_0.png resize: (187, 160) 1361777474 -0.8714160453141125 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901328_0.png resize: (1171, 418) 1361777475 -1.3314849843533247 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901331_0.png resize: (128, 229) 1361777476 0.05925322524851324 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901332_0.png resize: (184, 217) 1361777477 -1.243120566989699 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901339_0.png resize: (130, 245) 1361777478 -1.3406798544364091 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901346_0.png resize: (242, 161) 1361777479 -0.5498109737953313 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901358_0.png resize: (272, 270) 1361777480 -0.5480275378721796 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901366_0.png resize: (191, 103) 1361777481 1.157578026337441 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901379_0.png resize: (132, 404) 1361777482 -0.3626453774325947 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901382_0.png resize: (167, 184) 1361777483 -1.256945355127608 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901390_0.png resize: (104, 95) 1361777484 -0.07898838843590769 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901391_0.png resize: (119, 207) 1361777485 0.8673595340288179 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901393_0.png resize: (187, 185) 1361777486 -0.34256065112573786 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901395_0.png resize: (157, 175) 1361777487 -1.410359310459509 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901408_0.png resize: (175, 76) 1361777489 -1.4112906410978487 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901420_0.png resize: (134, 157) 1361777490 -1.642012264882576 treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901427_0.png resize: (378, 465) 1361777491 -0.32887661022442694 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901443_0.png resize: (210, 145) 1361777492 -2.1788265469143684 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901423_0.png resize: (192, 207) 1361777495 -1.5276101279272667 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901254_0.png resize: (179, 189) 1361777597 -1.8728393036890327 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901255_0.png resize: (142, 468) 1361777598 -0.429310241682122 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901260_0.png resize: (143, 239) 1361777599 -0.8176247985872174 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901262_0.png resize: (162, 586) 1361777600 -1.1917691585882524 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901270_0.png resize: (183, 112) 1361777601 -1.9836789021945551 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901271_0.png resize: (232, 708) 1361777602 -1.5662913697756546 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901274_0.png resize: (253, 179) 1361777603 -1.5746058738641655 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901278_0.png resize: (220, 230) 1361777604 -1.8969548261665967 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901279_0.png resize: (182, 709) 1361777605 -0.6618692354678306 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901280_0.png resize: (253, 353) 1361777606 -1.3997454907867506 treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901282_0.png resize: (67, 114) 1361777607 0.15254999185880813 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901286_0.png resize: (175, 198) 1361777608 -2.8708198253584105 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901292_0.png resize: (351, 309) 1361777610 -2.8089458423094174 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901295_0.png resize: (446, 252) 1361777611 -3.2652193405408827 treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901296_0.png resize: (169, 441) 1361777612 -4.806074961806358 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901301_0.png resize: (180, 284) 1361777613 0.15188655848890528 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901304_0.png resize: (158, 181) 1361777614 -2.7508495818397676 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901306_0.png resize: (362, 322) 1361777615 -3.3233363120947534 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901308_0.png resize: (207, 348) 1361777616 -2.9729396328729045 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901316_0.png resize: (315, 483) 1361777617 -1.3149255049429416 treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901325_0.png resize: (263, 186) 1361777618 -0.992815003288033 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901333_0.png resize: (178, 421) 1361777619 -1.8649610231452731 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901335_0.png resize: (248, 259) 1361777620 -0.8701515003798742 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901338_0.png resize: (257, 458) 1361777621 -1.999273587986432 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901340_0.png resize: (133, 206) 1361777622 -0.9437419909006076 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901341_0.png resize: (321, 361) 1361777623 -0.8649473026557869 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901342_0.png resize: (294, 276) 1361777624 -2.2240580740392155 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901343_0.png resize: (216, 416) 1361777625 -1.9615763531672379 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901345_0.png resize: (285, 333) 1361777626 -0.5019383210521227 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901347_0.png resize: (297, 311) 1361777627 -2.64699054206166 treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901351_0.png resize: (160, 329) 1361777628 -1.7710220961981022 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901360_0.png resize: (141, 254) 1361777629 -1.1785943110612713 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901362_0.png resize: (130, 131) 1361777630 -2.3037499554717265 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901365_0.png resize: (355, 241) 1361777632 -0.9477339953274128 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901369_0.png resize: (146, 204) 1361777633 -1.6701488934000004 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901371_0.png resize: (334, 307) 1361777635 -0.5949118345128954 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901375_0.png resize: (233, 404) 1361777636 -1.45072144037487 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901383_0.png resize: (708, 147) 1361777637 -2.572531245691041 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901386_0.png resize: (289, 575) 1361777638 -2.2968928820752605 treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901388_0.png resize: (212, 309) 1361777639 -2.062106368542764 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901397_0.png resize: (237, 281) 1361777640 -1.0399677523205428 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901399_0.png resize: (191, 256) 1361777641 -1.104740439172157 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901400_0.png resize: (197, 244) 1361777642 -0.45361176606983444 treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901403_0.png resize: (314, 373) 1361777643 -0.6672333069537846 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901406_0.png resize: (286, 554) 1361777644 -0.9941760961860282 treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901409_0.png resize: (110, 237) 1361777645 -1.456797847729608 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901416_0.png resize: (276, 402) 1361777646 -2.5928790558997488 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901418_0.png resize: (302, 533) 1361777647 -1.8329068492867513 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901419_0.png resize: (334, 316) 1361777648 -2.0030388878101313 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901422_0.png resize: (292, 161) 1361777649 -1.7865919147439013 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901425_0.png resize: (456, 324) 1361777650 -2.8499768125332574 treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901429_0.png resize: (355, 616) 1361777651 -2.0799248895699796 treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901430_0.png resize: (222, 377) 1361777652 -1.3049376200954115 treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901431_0.png resize: (276, 292) 1361777653 -3.0634652409330467 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901435_0.png resize: (250, 438) 1361777654 -2.6008626119822953 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901438_0.png resize: (242, 487) 1361777656 -4.200480591383636 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901442_0.png resize: (264, 336) 1361777657 -4.448586191907493 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901444_0.png resize: (303, 291) 1361777658 -3.790907119469536 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901445_0.png resize: (413, 460) 1361777659 -3.1253570588142066 treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901448_0.png resize: (119, 334) 1361777660 -3.530341333950114 treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901267_0.png resize: (146, 115) 1361777662 0.9991034048497789 treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901312_0.png resize: (178, 118) 1361777663 -3.0308990516884617 treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901373_0.png resize: (225, 181) 1361777664 -1.2461546101383274 treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901361_0.png resize: (162, 210) 1361777667 -1.1038429516826966 treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901424_0.png resize: (162, 300) 1361777669 -1.4820294160475183 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 215 time used for this insertion : 0.023755788803100586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 215 time used for this insertion : 0.04476189613342285 save missing photos in datou_result : time spend for datou_step_exec : 46.63295340538025 time spend to save output : 0.07535600662231445 total time spend for step 6 : 46.70830941200256 step7:brightness Fri May 30 16:05:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d.jpg treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9.jpg treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc.jpg treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350.jpg treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd.jpg treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59.jpg treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518.jpg treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5.jpg treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a.jpg treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35.jpg treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce.jpg treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7.jpg treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c.jpg treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698.jpg treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901249_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901250_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901251_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901253_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901256_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901257_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901259_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901261_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901263_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901264_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901265_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901266_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901268_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901273_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901275_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901277_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901281_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901283_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901284_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901287_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901288_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901289_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901291_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901293_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901294_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901297_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901298_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901299_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901302_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901303_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901305_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901307_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901309_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901310_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901313_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901314_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901315_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901317_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901319_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901320_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901321_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901322_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901323_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901324_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901326_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901327_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901329_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901330_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901334_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901336_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901337_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901344_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901348_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901349_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901350_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901352_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901353_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901354_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901355_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901356_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901357_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901359_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901363_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901364_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901367_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901368_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901370_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901372_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901374_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901376_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901377_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901378_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901380_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901381_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901384_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901385_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901387_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901389_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901392_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901394_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901396_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901398_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901401_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901402_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901404_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901405_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901407_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901410_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901411_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901412_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901413_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901414_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901415_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901417_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901421_0.png treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901426_0.png treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901428_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901432_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901433_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901434_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901436_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901437_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901439_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901440_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901441_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901446_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901447_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901449_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901252_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901258_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901269_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901272_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901276_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901285_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901290_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901300_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901311_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901318_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901328_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901331_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901332_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901339_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901346_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901358_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901366_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901379_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901382_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901390_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901391_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901393_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901395_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901408_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901420_0.png treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901427_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901443_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901423_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901254_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901255_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901260_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901262_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901270_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901271_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901274_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901278_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901279_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901280_0.png treat image : temp/1748613630_1136183_1361758090_5eafa0bb75febab2eae84bb4b62020c9_rle_crop_3815901282_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901286_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901292_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901295_0.png treat image : temp/1748613630_1136183_1361758087_296ed096cfaafa598f0a9e764ed32acc_rle_crop_3815901296_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901301_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901304_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901306_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901308_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901316_0.png treat image : temp/1748613630_1136183_1361758081_e32e7d000196af128d3a416b63ba94bd_rle_crop_3815901325_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901333_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901335_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901338_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901340_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901341_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901342_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901343_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901345_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901347_0.png treat image : temp/1748613630_1136183_1361758064_30993bf686d9325034b140427c4d7d59_rle_crop_3815901351_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901360_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901362_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901365_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901369_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901371_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901375_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901383_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901386_0.png treat image : temp/1748613630_1136183_1361758014_e46f2402415eacb7bda797334e71fb8a_rle_crop_3815901388_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901397_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901399_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901400_0.png treat image : temp/1748613630_1136183_1361758011_3c9061c9180bc9eb7aa85aa159986a35_rle_crop_3815901403_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901406_0.png treat image : temp/1748613630_1136183_1361758007_77847f15db2ac5d1b0b7cb08fa5111ce_rle_crop_3815901409_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901416_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901418_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901419_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901422_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901425_0.png treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901429_0.png treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901430_0.png treat image : temp/1748613630_1136183_1361757994_9aafd61aebed9ce2ace5bcc16a1b8b7c_rle_crop_3815901431_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901435_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901438_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901442_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901444_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901445_0.png treat image : temp/1748613630_1136183_1361757989_862f6072385cd2635ab9410e5d7bc698_rle_crop_3815901448_0.png treat image : temp/1748613630_1136183_1361758093_cfce2613590f5c9836e1f084ebbf534d_rle_crop_3815901267_0.png treat image : temp/1748613630_1136183_1361758085_54e84a0e772c98913f5f8cc79a8f5350_rle_crop_3815901312_0.png treat image : temp/1748613630_1136183_1361758045_dae03275732c079bad292bc413adf7d5_rle_crop_3815901373_0.png treat image : temp/1748613630_1136183_1361758053_b63f12b578f6f16f65cae7d6dda0f518_rle_crop_3815901361_0.png treat image : temp/1748613630_1136183_1361757999_49a79ff3ec83bbf1e0e2095bf0a6f6c7_rle_crop_3815901424_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 215 time used for this insertion : 0.02322554588317871 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 215 time used for this insertion : 0.0476226806640625 save missing photos in datou_result : time spend for datou_step_exec : 13.297220468521118 time spend to save output : 0.07642841339111328 total time spend for step 7 : 13.373648881912231 step8:velours_tree Fri May 30 16:05:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.16747069358825684 time spend to save output : 5.1975250244140625e-05 total time spend for step 8 : 0.16752266883850098 step9:send_mail_cod Fri May 30 16:05:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23452977_30-05-2025_16_05_24.pdf 23453558 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234535581748613924 23453559 imagette234535591748613926 23453560 imagette234535601748613926 23453561 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234535611748613926 23453562 change filename to text .imagette234535621748613927 23453563 change filename to text .change filename to text .change filename to text .imagette234535631748613927 23453564 imagette234535641748613927 23453565 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234535651748613927 23453566 imagette234535661748613929 23453567 change filename to text .change filename to text .imagette234535671748613929 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23452977 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23453558,23453559,23453560,23453561,23453562,23453563,23453564,23453565,23453566,23453567,23453568?tags=carton,flou,background,papier,metal,pehd,autre,pet_clair,mal_croppe,pet_fonce,environnement args[1361758093] : ((1361758093, 0.12245798059295873, 492688767), (1361758093, 0.30078611050237297, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758090] : ((1361758090, -1.896241342120384, 492688767), (1361758090, 0.1251079643696161, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758087] : ((1361758087, -4.8862086272343905, 492609224), (1361758087, 0.21519749890392043, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758085] : ((1361758085, -4.944082046824683, 492609224), (1361758085, 0.24799043722381905, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758081] : ((1361758081, -2.126722590727305, 492609224), (1361758081, 0.5694359884439425, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758064] : ((1361758064, -2.2295106631972312, 492609224), (1361758064, 0.15527462029940264, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758053] : ((1361758053, -2.1427959755011834, 492609224), (1361758053, 0.3050612469056086, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758045] : ((1361758045, 0.5337454938036594, 492688767), (1361758045, 0.1325746199585365, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758014] : ((1361758014, -1.8646138834840655, 492688767), (1361758014, 0.35543506085292637, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758011] : ((1361758011, -1.7655345673574998, 492688767), (1361758011, 0.4204720578301459, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361758007] : ((1361758007, -1.5842952460435982, 492688767), (1361758007, -0.07309015396332658, 496442774), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361757999] : ((1361757999, -3.0898299349811533, 492609224), (1361757999, 0.2804552632880697, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361757994] : ((1361757994, -2.348217649266632, 492609224), (1361757994, 0.14361853044670986, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com args[1361757989] : ((1361757989, -5.298449182688539, 492609224), (1361757989, 0.23522057059976073, 2107752395), '0.11114712812208218') We are sending mail with results at report@fotonower.com refus_total : 0.11114712812208218 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23452977 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23452977_30-05-2025_16_05_24.pdf results_Auto_P23452977_30-05-2025_16_05_24.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23452977_30-05-2025_16_05_24.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23452977','results_Auto_P23452977_30-05-2025_16_05_24.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23452977_30-05-2025_16_05_24.pdf','pdf','','0.83','0.11114712812208218') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23452977

https://www.fotonower.com/image?json=false&list_photos_id=1361758093
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758090
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758087
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758085
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758064
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758053
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758045
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758014
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758011
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361758007
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361757999
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361757994
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361757989
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.11%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/23453558?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23453561?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23453562?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/23453563?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23453565?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23453567?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23452977_30-05-2025_16_05_24.pdf.

Lien vers velours :https://www.fotonower.com/velours/23453558,23453559,23453560,23453561,23453562,23453563,23453564,23453565,23453566,23453567,23453568?tags=carton,flou,background,papier,metal,pehd,autre,pet_clair,mal_croppe,pet_fonce,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 30 May 2025 14:05:32 GMT Content-Length: 0 Connection: close X-Message-Id: R-vZDQk2SzWC72M1NrJA_w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361758093, 1361758090, 1361758087, 1361758085, 1361758081, 1361758064, 1361758053, 1361758045, 1361758014, 1361758011, 1361758007, 1361757999, 1361757994, 1361757989] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758093', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758090', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758087', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758085', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758081', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758064', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758053', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758045', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758014', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758011', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758007', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757999', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757994', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757989', None, None, None, None, None, '2987541') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.019191980361938477 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.826625108718872 time spend to save output : 0.01942276954650879 total time spend for step 9 : 7.846047878265381 step10:split_time_score Fri May 30 16:05:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 14),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 30052025 23452977 Nombre de photos uploadées : 14 / 23040 (0%) 30052025 23452977 Nombre de photos taguées (types de déchets): 0 / 14 (0%) 30052025 23452977 Nombre de photos taguées (volume) : 0 / 14 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 7.62939453125e-06 ?????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007350444793701172 elapsed_time : insert_dashboard_record_day_entry 0.0241849422454834 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07740637119761355 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23447101_30-05-2025_08_50_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23447101 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23447101 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23452971 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23452976 order by id desc limit 1 Qualite : 0.11114712812208218 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23452977_30-05-2025_16_05_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23452977 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23452977 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23452981 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'30052025': {'nb_upload': 14, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361758093, 1361758090, 1361758087, 1361758085, 1361758081, 1361758064, 1361758053, 1361758045, 1361758014, 1361758011, 1361758007, 1361757999, 1361757994, 1361757989] Looping around the photos to save general results len do output : 1 /23452977Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758093', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758090', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758087', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758085', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758081', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758064', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758053', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758045', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758014', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758011', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361758007', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757999', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757994', None, None, None, None, None, '2987541') ('3318', None, None, None, None, None, None, None, '2987541') ('3318', '23452977', '1361757989', None, None, None, None, None, '2987541') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01448512077331543 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.975757598876953 time spend to save output : 0.014793157577514648 total time spend for step 10 : 2.9905507564544678 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 14 set_done_treatment 190.56user 54.60system 5:10.24elapsed 79%CPU (0avgtext+0avgdata 6183644maxresident)k 42808inputs+115312outputs (504major+10374002minor)pagefaults 0swaps