python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 477835 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3670239'] with mtr_portfolio_ids : ['26579614'] and first list_photo_ids : [] new path : /proc/477835/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.8907968997955322 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Sep 5 14:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6819 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-05 14:50:33.930355: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-05 14:50:33.956621: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-05 14:50:33.958265: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5074000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-05 14:50:33.958321: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-05 14:50:33.961234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-05 14:50:34.104675: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1c5d42f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-05 14:50:34.104720: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-05 14:50:34.105574: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 14:50:34.106789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 14:50:34.112410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 14:50:34.116654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 14:50:34.118240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 14:50:34.122446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 14:50:34.123993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 14:50:34.131809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 14:50:34.133431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 14:50:34.133535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 14:50:34.134354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 14:50:34.134374: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 14:50:34.134386: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 14:50:34.135979: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6267 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-05 14:50:34.514069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 14:50:34.514189: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 14:50:34.514223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 14:50:34.514253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 14:50:34.514280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 14:50:34.514307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 14:50:34.514335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 14:50:34.514364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 14:50:34.515842: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 14:50:34.517591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 14:50:34.517670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 14:50:34.517704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 14:50:34.517736: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 14:50:34.517767: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 14:50:34.517797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 14:50:34.517827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 14:50:34.517860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 14:50:34.519324: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 14:50:34.519372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 14:50:34.519389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 14:50:34.519402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 14:50:34.520972: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6267 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-05 14:50:45.910246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 14:50:46.752117: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 14:50:49.603260: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.604154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.604761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.605328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.605894: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.606453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.607022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.607500: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.608508: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.608532: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.616106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.616164: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.616757: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.616775: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.623663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.623762: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.624414: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.624435: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.661399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.661470: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.662055: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.662073: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.669042: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.669095: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.669731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.669750: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-05 14:50:49.705223: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.705851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.707731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.708318: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.751072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.751670: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.753821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.754515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.784733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.785696: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.787891: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.788838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.798189: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.799192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.801505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.802446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.811883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.813033: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.815311: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.816512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.850783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.851374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.851941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.852515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.863027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.863940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.886665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.887481: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.888190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.888926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.902345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.902930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.903497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.904067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.908865: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.909446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.914027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.914597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.926536: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.927159: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.931258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.931831: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.932402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.932970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.933695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.934266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.944707: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.945277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.945860: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.946428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.947029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.947595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.948164: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.948750: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.958247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.958818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.965014: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:49.965585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.035529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.036165: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.045216: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.045955: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.096097: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.097188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.097945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.098513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.102604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.103197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.103767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.104336: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.107729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.107756: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-05 14:50:50.115695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.116294: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.125755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.126495: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.127270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.127995: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.128841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-05 14:50:50.129557: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 Detection mask done ! Trying to reset tf kernel 478373 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 656 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1855 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.013548851013183594 nb_pixel_total : 315084 time to create 1 rle with new method : 0.026354312896728516 length of segment : 681 time for calcul the mask position with numpy : 0.000629425048828125 nb_pixel_total : 20438 time to create 1 rle with old method : 0.024941682815551758 length of segment : 205 time for calcul the mask position with numpy : 0.002599000930786133 nb_pixel_total : 143366 time to create 1 rle with old method : 0.17208647727966309 length of segment : 366 time for calcul the mask position with numpy : 0.0013887882232666016 nb_pixel_total : 44291 time to create 1 rle with old method : 0.0660104751586914 length of segment : 262 time for calcul the mask position with numpy : 0.0009636878967285156 nb_pixel_total : 36691 time to create 1 rle with old method : 0.045252084732055664 length of segment : 203 time for calcul the mask position with numpy : 0.0004296302795410156 nb_pixel_total : 14667 time to create 1 rle with old method : 0.017511844635009766 length of segment : 93 time for calcul the mask position with numpy : 0.0008025169372558594 nb_pixel_total : 24517 time to create 1 rle with old method : 0.030822038650512695 length of segment : 246 time for calcul the mask position with numpy : 0.0006191730499267578 nb_pixel_total : 17691 time to create 1 rle with old method : 0.02044200897216797 length of segment : 174 time for calcul the mask position with numpy : 0.0014543533325195312 nb_pixel_total : 48681 time to create 1 rle with old method : 0.055971622467041016 length of segment : 350 time for calcul the mask position with numpy : 0.0017502307891845703 nb_pixel_total : 80728 time to create 1 rle with old method : 0.09228038787841797 length of segment : 364 time for calcul the mask position with numpy : 0.0012540817260742188 nb_pixel_total : 35197 time to create 1 rle with old method : 0.04048275947570801 length of segment : 233 time for calcul the mask position with numpy : 0.0004405975341796875 nb_pixel_total : 17702 time to create 1 rle with old method : 0.02079153060913086 length of segment : 139 time for calcul the mask position with numpy : 0.0003898143768310547 nb_pixel_total : 11262 time to create 1 rle with old method : 0.01336812973022461 length of segment : 135 time for calcul the mask position with numpy : 0.0003349781036376953 nb_pixel_total : 10448 time to create 1 rle with old method : 0.013184547424316406 length of segment : 108 time for calcul the mask position with numpy : 0.0016443729400634766 nb_pixel_total : 59320 time to create 1 rle with old method : 0.06827354431152344 length of segment : 374 time for calcul the mask position with numpy : 0.0005862712860107422 nb_pixel_total : 33860 time to create 1 rle with old method : 0.04233145713806152 length of segment : 161 time for calcul the mask position with numpy : 0.003180980682373047 nb_pixel_total : 125233 time to create 1 rle with old method : 0.14200377464294434 length of segment : 437 time for calcul the mask position with numpy : 0.0009391307830810547 nb_pixel_total : 50344 time to create 1 rle with old method : 0.05618619918823242 length of segment : 259 time for calcul the mask position with numpy : 0.0018672943115234375 nb_pixel_total : 115581 time to create 1 rle with old method : 0.13076424598693848 length of segment : 463 time for calcul the mask position with numpy : 0.000782012939453125 nb_pixel_total : 56735 time to create 1 rle with old method : 0.0646212100982666 length of segment : 200 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 41763 time to create 1 rle with old method : 0.04791140556335449 length of segment : 348 time for calcul the mask position with numpy : 0.00033926963806152344 nb_pixel_total : 20291 time to create 1 rle with old method : 0.023602724075317383 length of segment : 154 time for calcul the mask position with numpy : 0.00043463706970214844 nb_pixel_total : 15556 time to create 1 rle with old method : 0.018530607223510742 length of segment : 219 time for calcul the mask position with numpy : 0.0008070468902587891 nb_pixel_total : 40599 time to create 1 rle with old method : 0.0461270809173584 length of segment : 347 time for calcul the mask position with numpy : 0.0002963542938232422 nb_pixel_total : 8819 time to create 1 rle with old method : 0.010520696640014648 length of segment : 75 time for calcul the mask position with numpy : 0.0007905960083007812 nb_pixel_total : 33085 time to create 1 rle with old method : 0.03784298896789551 length of segment : 208 time for calcul the mask position with numpy : 0.00048089027404785156 nb_pixel_total : 25231 time to create 1 rle with old method : 0.02884507179260254 length of segment : 236 time for calcul the mask position with numpy : 0.0006382465362548828 nb_pixel_total : 36734 time to create 1 rle with old method : 0.042128801345825195 length of segment : 208 time for calcul the mask position with numpy : 0.0004553794860839844 nb_pixel_total : 26570 time to create 1 rle with old method : 0.03569602966308594 length of segment : 121 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 14177 time to create 1 rle with old method : 0.01709151268005371 length of segment : 115 time for calcul the mask position with numpy : 0.0008308887481689453 nb_pixel_total : 42408 time to create 1 rle with old method : 0.04794478416442871 length of segment : 305 time for calcul the mask position with numpy : 0.0022089481353759766 nb_pixel_total : 109439 time to create 1 rle with old method : 0.12355661392211914 length of segment : 468 time for calcul the mask position with numpy : 0.0005834102630615234 nb_pixel_total : 33987 time to create 1 rle with old method : 0.04525613784790039 length of segment : 220 time for calcul the mask position with numpy : 0.0018906593322753906 nb_pixel_total : 94872 time to create 1 rle with old method : 0.10917496681213379 length of segment : 561 time for calcul the mask position with numpy : 0.0016663074493408203 nb_pixel_total : 43445 time to create 1 rle with old method : 0.052145957946777344 length of segment : 408 time for calcul the mask position with numpy : 0.0018846988677978516 nb_pixel_total : 56088 time to create 1 rle with old method : 0.06595826148986816 length of segment : 354 time for calcul the mask position with numpy : 0.0008697509765625 nb_pixel_total : 36394 time to create 1 rle with old method : 0.04501152038574219 length of segment : 194 time for calcul the mask position with numpy : 0.0006465911865234375 nb_pixel_total : 14525 time to create 1 rle with old method : 0.016831159591674805 length of segment : 169 time for calcul the mask position with numpy : 0.0006158351898193359 nb_pixel_total : 6721 time to create 1 rle with old method : 0.008996009826660156 length of segment : 180 time for calcul the mask position with numpy : 0.0010251998901367188 nb_pixel_total : 34452 time to create 1 rle with old method : 0.03911876678466797 length of segment : 177 time for calcul the mask position with numpy : 0.0030753612518310547 nb_pixel_total : 123285 time to create 1 rle with old method : 0.14176297187805176 length of segment : 547 time for calcul the mask position with numpy : 0.000701904296875 nb_pixel_total : 18672 time to create 1 rle with old method : 0.02176380157470703 length of segment : 159 time for calcul the mask position with numpy : 0.0004532337188720703 nb_pixel_total : 23160 time to create 1 rle with old method : 0.027034521102905273 length of segment : 266 time for calcul the mask position with numpy : 0.0023577213287353516 nb_pixel_total : 150877 time to create 1 rle with new method : 0.009218454360961914 length of segment : 544 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 31053 time to create 1 rle with old method : 0.03554844856262207 length of segment : 281 time for calcul the mask position with numpy : 0.0008924007415771484 nb_pixel_total : 40490 time to create 1 rle with old method : 0.04617714881896973 length of segment : 689 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 24285 time to create 1 rle with old method : 0.027912378311157227 length of segment : 285 time for calcul the mask position with numpy : 0.001428842544555664 nb_pixel_total : 76626 time to create 1 rle with old method : 0.08722758293151855 length of segment : 316 time for calcul the mask position with numpy : 0.0004067420959472656 nb_pixel_total : 16673 time to create 1 rle with old method : 0.019575119018554688 length of segment : 191 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 20559 time to create 1 rle with old method : 0.024116039276123047 length of segment : 168 time for calcul the mask position with numpy : 0.0005946159362792969 nb_pixel_total : 8149 time to create 1 rle with old method : 0.009625911712646484 length of segment : 182 time for calcul the mask position with numpy : 0.0007967948913574219 nb_pixel_total : 35903 time to create 1 rle with old method : 0.041364192962646484 length of segment : 285 time for calcul the mask position with numpy : 0.0012178421020507812 nb_pixel_total : 26269 time to create 1 rle with old method : 0.030121803283691406 length of segment : 379 time for calcul the mask position with numpy : 0.00045037269592285156 nb_pixel_total : 18773 time to create 1 rle with old method : 0.022576570510864258 length of segment : 266 time for calcul the mask position with numpy : 0.0008270740509033203 nb_pixel_total : 47150 time to create 1 rle with old method : 0.05351901054382324 length of segment : 292 time for calcul the mask position with numpy : 0.0003590583801269531 nb_pixel_total : 23726 time to create 1 rle with old method : 0.027394533157348633 length of segment : 130 time for calcul the mask position with numpy : 0.0006601810455322266 nb_pixel_total : 29645 time to create 1 rle with old method : 0.03812861442565918 length of segment : 280 time for calcul the mask position with numpy : 0.0017015933990478516 nb_pixel_total : 42375 time to create 1 rle with old method : 0.04867672920227051 length of segment : 457 time for calcul the mask position with numpy : 0.003267526626586914 nb_pixel_total : 131751 time to create 1 rle with old method : 0.14699006080627441 length of segment : 480 time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 9064 time to create 1 rle with old method : 0.010500431060791016 length of segment : 111 time for calcul the mask position with numpy : 0.0016651153564453125 nb_pixel_total : 42815 time to create 1 rle with old method : 0.04865217208862305 length of segment : 484 time for calcul the mask position with numpy : 0.0006020069122314453 nb_pixel_total : 11958 time to create 1 rle with old method : 0.014150857925415039 length of segment : 115 time for calcul the mask position with numpy : 0.0009291172027587891 nb_pixel_total : 28081 time to create 1 rle with old method : 0.0326237678527832 length of segment : 256 time for calcul the mask position with numpy : 0.0014674663543701172 nb_pixel_total : 47135 time to create 1 rle with old method : 0.05377650260925293 length of segment : 302 time for calcul the mask position with numpy : 0.0008273124694824219 nb_pixel_total : 47541 time to create 1 rle with old method : 0.05422544479370117 length of segment : 305 time for calcul the mask position with numpy : 0.0017313957214355469 nb_pixel_total : 54504 time to create 1 rle with old method : 0.06139492988586426 length of segment : 344 time for calcul the mask position with numpy : 0.0013856887817382812 nb_pixel_total : 56278 time to create 1 rle with old method : 0.0637216567993164 length of segment : 320 time for calcul the mask position with numpy : 0.0030655860900878906 nb_pixel_total : 116517 time to create 1 rle with old method : 0.13264799118041992 length of segment : 717 time for calcul the mask position with numpy : 0.0018665790557861328 nb_pixel_total : 64558 time to create 1 rle with old method : 0.07536458969116211 length of segment : 284 time for calcul the mask position with numpy : 0.000804901123046875 nb_pixel_total : 15406 time to create 1 rle with old method : 0.026039600372314453 length of segment : 209 time for calcul the mask position with numpy : 0.0007920265197753906 nb_pixel_total : 18211 time to create 1 rle with old method : 0.02106165885925293 length of segment : 203 time for calcul the mask position with numpy : 0.00037384033203125 nb_pixel_total : 21110 time to create 1 rle with old method : 0.024898052215576172 length of segment : 161 time for calcul the mask position with numpy : 0.002637624740600586 nb_pixel_total : 109822 time to create 1 rle with old method : 0.12476587295532227 length of segment : 434 time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 10952 time to create 1 rle with old method : 0.01294708251953125 length of segment : 322 time for calcul the mask position with numpy : 0.001111745834350586 nb_pixel_total : 48435 time to create 1 rle with old method : 0.05523395538330078 length of segment : 190 time for calcul the mask position with numpy : 0.0015552043914794922 nb_pixel_total : 62789 time to create 1 rle with old method : 0.0711982250213623 length of segment : 312 time for calcul the mask position with numpy : 0.0004534721374511719 nb_pixel_total : 13595 time to create 1 rle with old method : 0.015738964080810547 length of segment : 161 time for calcul the mask position with numpy : 0.0011065006256103516 nb_pixel_total : 39106 time to create 1 rle with old method : 0.04503583908081055 length of segment : 475 time for calcul the mask position with numpy : 0.005963563919067383 nb_pixel_total : 180732 time to create 1 rle with new method : 0.016072511672973633 length of segment : 651 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 13541 time to create 1 rle with old method : 0.01568746566772461 length of segment : 114 time for calcul the mask position with numpy : 0.001310110092163086 nb_pixel_total : 28355 time to create 1 rle with old method : 0.03340554237365723 length of segment : 311 time for calcul the mask position with numpy : 0.007031917572021484 nb_pixel_total : 269161 time to create 1 rle with new method : 0.023064613342285156 length of segment : 682 time for calcul the mask position with numpy : 0.0006585121154785156 nb_pixel_total : 11945 time to create 1 rle with old method : 0.013687610626220703 length of segment : 225 time for calcul the mask position with numpy : 0.00127410888671875 nb_pixel_total : 54396 time to create 1 rle with old method : 0.06188011169433594 length of segment : 252 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 31476 time to create 1 rle with old method : 0.03582000732421875 length of segment : 184 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 8479 time to create 1 rle with old method : 0.009807348251342773 length of segment : 258 time for calcul the mask position with numpy : 0.0006797313690185547 nb_pixel_total : 26340 time to create 1 rle with old method : 0.031072616577148438 length of segment : 158 time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 9761 time to create 1 rle with old method : 0.0113372802734375 length of segment : 114 time for calcul the mask position with numpy : 0.0033578872680664062 nb_pixel_total : 114014 time to create 1 rle with old method : 0.12782931327819824 length of segment : 375 time for calcul the mask position with numpy : 0.0040209293365478516 nb_pixel_total : 142315 time to create 1 rle with old method : 0.15615510940551758 length of segment : 496 time for calcul the mask position with numpy : 0.0013730525970458984 nb_pixel_total : 50920 time to create 1 rle with old method : 0.058545589447021484 length of segment : 157 time for calcul the mask position with numpy : 0.0016422271728515625 nb_pixel_total : 33507 time to create 1 rle with old method : 0.0429379940032959 length of segment : 244 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 23920 time to create 1 rle with old method : 0.027776241302490234 length of segment : 213 time for calcul the mask position with numpy : 0.0002911090850830078 nb_pixel_total : 3908 time to create 1 rle with old method : 0.005659341812133789 length of segment : 76 time for calcul the mask position with numpy : 0.0024907588958740234 nb_pixel_total : 73338 time to create 1 rle with old method : 0.08356523513793945 length of segment : 437 time for calcul the mask position with numpy : 0.002331256866455078 nb_pixel_total : 33611 time to create 1 rle with old method : 0.0400240421295166 length of segment : 448 time for calcul the mask position with numpy : 0.0012431144714355469 nb_pixel_total : 44482 time to create 1 rle with old method : 0.053114891052246094 length of segment : 217 time for calcul the mask position with numpy : 0.002170085906982422 nb_pixel_total : 59521 time to create 1 rle with old method : 0.07094264030456543 length of segment : 312 time for calcul the mask position with numpy : 0.0006208419799804688 nb_pixel_total : 11381 time to create 1 rle with old method : 0.013283491134643555 length of segment : 203 time for calcul the mask position with numpy : 0.001344919204711914 nb_pixel_total : 59649 time to create 1 rle with old method : 0.07483458518981934 length of segment : 255 time for calcul the mask position with numpy : 0.0013463497161865234 nb_pixel_total : 41944 time to create 1 rle with old method : 0.04770469665527344 length of segment : 279 time for calcul the mask position with numpy : 0.000759124755859375 nb_pixel_total : 25754 time to create 1 rle with old method : 0.029877424240112305 length of segment : 202 time for calcul the mask position with numpy : 0.0005512237548828125 nb_pixel_total : 24456 time to create 1 rle with old method : 0.028644800186157227 length of segment : 142 time for calcul the mask position with numpy : 0.0004405975341796875 nb_pixel_total : 17348 time to create 1 rle with old method : 0.020049571990966797 length of segment : 207 time for calcul the mask position with numpy : 0.001119375228881836 nb_pixel_total : 51673 time to create 1 rle with old method : 0.05928683280944824 length of segment : 390 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 10073 time to create 1 rle with old method : 0.011739492416381836 length of segment : 145 time for calcul the mask position with numpy : 0.0003440380096435547 nb_pixel_total : 9910 time to create 1 rle with old method : 0.011716365814208984 length of segment : 103 time for calcul the mask position with numpy : 0.0009627342224121094 nb_pixel_total : 48075 time to create 1 rle with old method : 0.055840492248535156 length of segment : 287 time for calcul the mask position with numpy : 0.16245293617248535 nb_pixel_total : 1729628 time to create 1 rle with new method : 0.6130335330963135 length of segment : 2342 time for calcul the mask position with numpy : 0.0006577968597412109 nb_pixel_total : 28945 time to create 1 rle with old method : 0.03558707237243652 length of segment : 177 time for calcul the mask position with numpy : 0.01210331916809082 nb_pixel_total : 171797 time to create 1 rle with new method : 0.05078387260437012 length of segment : 856 time for calcul the mask position with numpy : 0.0005245208740234375 nb_pixel_total : 10255 time to create 1 rle with old method : 0.016635894775390625 length of segment : 107 time for calcul the mask position with numpy : 0.0015075206756591797 nb_pixel_total : 61643 time to create 1 rle with old method : 0.07039976119995117 length of segment : 294 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 12406 time to create 1 rle with old method : 0.014456033706665039 length of segment : 120 time for calcul the mask position with numpy : 0.0010528564453125 nb_pixel_total : 36288 time to create 1 rle with old method : 0.042804718017578125 length of segment : 242 time for calcul the mask position with numpy : 0.0008697509765625 nb_pixel_total : 27059 time to create 1 rle with old method : 0.035501718521118164 length of segment : 181 time for calcul the mask position with numpy : 0.0016241073608398438 nb_pixel_total : 59082 time to create 1 rle with old method : 0.06894373893737793 length of segment : 307 time for calcul the mask position with numpy : 0.0003094673156738281 nb_pixel_total : 11875 time to create 1 rle with old method : 0.013730049133300781 length of segment : 90 time for calcul the mask position with numpy : 0.0020062923431396484 nb_pixel_total : 82045 time to create 1 rle with old method : 0.09329628944396973 length of segment : 336 time for calcul the mask position with numpy : 0.012753725051879883 nb_pixel_total : 265710 time to create 1 rle with new method : 0.022815942764282227 length of segment : 1531 time spent for convertir_results : 14.33089303970337 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 120 chid ids of type : 3594 Number RLEs to save : 37142 save missing photos in datou_result : time spend for datou_step_exec : 93.58627319335938 time spend to save output : 2.156860828399658 total time spend for step 1 : 95.74313402175903 step2:crop_condition Fri Sep 5 14:52:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 120 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 98 About to insert : list_path_to_insert length 98 new photo from crops ! About to upload 98 photos upload in portfolio : 3736932 init cache_photo without model_param we have 98 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757076752_477835 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 98 photos in the portfolio 3736932 time of upload the photos Elapsed time : 24.360841989517212 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757076779_477835 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6496267318725586 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757076784_477835 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2333807945251465 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757076798_477835 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.4844298362731934 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757076804_477835 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.032853126525879 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757076806_477835 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6111631393432617 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1381749647, 1381749411, 1381749364, 1381749337, 1381749301, 1381749255, 1381749192, 1381748821, 1381748794, 1381748786] Looping around the photos to save general results len do output : 120 /1381762140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381762383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749647', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749411', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749364', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749337', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749301', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749255', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749192', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748821', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748794', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748786', None, None, None, None, None, '3670239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 370 time used for this insertion : 0.029477596282958984 save_final save missing photos in datou_result : time spend for datou_step_exec : 81.38239073753357 time spend to save output : 0.03381085395812988 total time spend for step 2 : 81.4162015914917 step3:rle_unique_nms_with_priority Fri Sep 5 14:53:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 120 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 6.623810529708862 time for calcul the mask position with numpy : 1.0108437538146973 nb_pixel_total : 7414317 time to create 1 rle with new method : 1.3292627334594727 time for calcul the mask position with numpy : 0.04607963562011719 nb_pixel_total : 59320 time to create 1 rle with old method : 0.06777381896972656 time for calcul the mask position with numpy : 0.046257972717285156 nb_pixel_total : 10448 time to create 1 rle with old method : 0.012996196746826172 time for calcul the mask position with numpy : 0.044596195220947266 nb_pixel_total : 11262 time to create 1 rle with old method : 0.012731790542602539 time for calcul the mask position with numpy : 0.04687952995300293 nb_pixel_total : 17702 time to create 1 rle with old method : 0.034093379974365234 time for calcul the mask position with numpy : 0.050740718841552734 nb_pixel_total : 35197 time to create 1 rle with old method : 0.0674126148223877 time for calcul the mask position with numpy : 0.04346728324890137 nb_pixel_total : 80728 time to create 1 rle with old method : 0.105438232421875 time for calcul the mask position with numpy : 0.04259490966796875 nb_pixel_total : 48681 time to create 1 rle with old method : 0.061033010482788086 time for calcul the mask position with numpy : 0.04328465461730957 nb_pixel_total : 17691 time to create 1 rle with old method : 0.022236347198486328 time for calcul the mask position with numpy : 0.040526628494262695 nb_pixel_total : 24517 time to create 1 rle with old method : 0.03264260292053223 time for calcul the mask position with numpy : 0.03966379165649414 nb_pixel_total : 14667 time to create 1 rle with old method : 0.02079463005065918 time for calcul the mask position with numpy : 0.028193950653076172 nb_pixel_total : 36691 time to create 1 rle with old method : 0.04259490966796875 time for calcul the mask position with numpy : 0.02604532241821289 nb_pixel_total : 44291 time to create 1 rle with old method : 0.049880266189575195 time for calcul the mask position with numpy : 0.025811433792114258 nb_pixel_total : 143366 time to create 1 rle with old method : 0.15934085845947266 time for calcul the mask position with numpy : 0.025720834732055664 nb_pixel_total : 20438 time to create 1 rle with old method : 0.022821903228759766 time for calcul the mask position with numpy : 0.027775049209594727 nb_pixel_total : 315084 time to create 1 rle with new method : 2.2467198371887207 create new chi : 5.946427583694458 time to delete rle : 0.019297122955322266 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10026 TO DO : save crop sub photo not yet done ! save time : 0.6106679439544678 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 4.860313653945923 time for calcul the mask position with numpy : 0.7024762630462646 nb_pixel_total : 7727303 time to create 1 rle with new method : 0.8300111293792725 time for calcul the mask position with numpy : 0.04916095733642578 nb_pixel_total : 25231 time to create 1 rle with old method : 0.037876129150390625 time for calcul the mask position with numpy : 0.04404425621032715 nb_pixel_total : 33085 time to create 1 rle with old method : 0.037384748458862305 time for calcul the mask position with numpy : 0.04218411445617676 nb_pixel_total : 8819 time to create 1 rle with old method : 0.010062217712402344 time for calcul the mask position with numpy : 0.04639482498168945 nb_pixel_total : 40599 time to create 1 rle with old method : 0.045495033264160156 time for calcul the mask position with numpy : 0.04050254821777344 nb_pixel_total : 15556 time to create 1 rle with old method : 0.017746925354003906 time for calcul the mask position with numpy : 0.041611433029174805 nb_pixel_total : 20291 time to create 1 rle with old method : 0.02269577980041504 time for calcul the mask position with numpy : 0.03837871551513672 nb_pixel_total : 41763 time to create 1 rle with old method : 0.04664325714111328 time for calcul the mask position with numpy : 0.026149511337280273 nb_pixel_total : 56735 time to create 1 rle with old method : 0.06323003768920898 time for calcul the mask position with numpy : 0.028807640075683594 nb_pixel_total : 115581 time to create 1 rle with old method : 0.1301581859588623 time for calcul the mask position with numpy : 0.026652812957763672 nb_pixel_total : 50344 time to create 1 rle with old method : 0.05611300468444824 time for calcul the mask position with numpy : 0.0319666862487793 nb_pixel_total : 125233 time to create 1 rle with old method : 0.13794684410095215 time for calcul the mask position with numpy : 0.03991413116455078 nb_pixel_total : 33860 time to create 1 rle with old method : 0.03662252426147461 create new chi : 2.6785364151000977 time to delete rle : 0.0014154911041259766 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8374 TO DO : save crop sub photo not yet done ! save time : 0.50579833984375 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 6.688639879226685 time for calcul the mask position with numpy : 0.645747184753418 nb_pixel_total : 7602631 time to create 1 rle with new method : 0.8109791278839111 time for calcul the mask position with numpy : 0.025025129318237305 nb_pixel_total : 18672 time to create 1 rle with old method : 0.024483442306518555 time for calcul the mask position with numpy : 0.04257678985595703 nb_pixel_total : 123285 time to create 1 rle with old method : 0.1406865119934082 time for calcul the mask position with numpy : 0.042577505111694336 nb_pixel_total : 34452 time to create 1 rle with old method : 0.03911590576171875 time for calcul the mask position with numpy : 0.03967785835266113 nb_pixel_total : 6721 time to create 1 rle with old method : 0.007569074630737305 time for calcul the mask position with numpy : 0.03889870643615723 nb_pixel_total : 14525 time to create 1 rle with old method : 0.08119750022888184 time for calcul the mask position with numpy : 0.04011201858520508 nb_pixel_total : 36394 time to create 1 rle with old method : 0.03998446464538574 time for calcul the mask position with numpy : 0.03921198844909668 nb_pixel_total : 56088 time to create 1 rle with old method : 0.06208086013793945 time for calcul the mask position with numpy : 0.03903937339782715 nb_pixel_total : 43445 time to create 1 rle with old method : 0.047135114669799805 time for calcul the mask position with numpy : 0.0395658016204834 nb_pixel_total : 94872 time to create 1 rle with old method : 0.10339021682739258 time for calcul the mask position with numpy : 0.038687944412231445 nb_pixel_total : 33987 time to create 1 rle with old method : 0.038207292556762695 time for calcul the mask position with numpy : 0.033048152923583984 nb_pixel_total : 109439 time to create 1 rle with old method : 0.11997079849243164 time for calcul the mask position with numpy : 0.024601221084594727 nb_pixel_total : 42408 time to create 1 rle with old method : 0.045766353607177734 time for calcul the mask position with numpy : 0.025014400482177734 nb_pixel_total : 14177 time to create 1 rle with old method : 0.0159604549407959 time for calcul the mask position with numpy : 0.024771451950073242 nb_pixel_total : 26570 time to create 1 rle with old method : 0.02965998649597168 time for calcul the mask position with numpy : 0.030425310134887695 nb_pixel_total : 36734 time to create 1 rle with old method : 0.040137290954589844 create new chi : 2.8588507175445557 time to delete rle : 0.002213001251220703 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10532 TO DO : save crop sub photo not yet done ! save time : 0.6299638748168945 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 5.921280860900879 time for calcul the mask position with numpy : 0.5070338249206543 nb_pixel_total : 7721062 time to create 1 rle with new method : 0.7667660713195801 time for calcul the mask position with numpy : 0.041667938232421875 nb_pixel_total : 29645 time to create 1 rle with old method : 0.032989501953125 time for calcul the mask position with numpy : 0.03606915473937988 nb_pixel_total : 23726 time to create 1 rle with old method : 0.0256805419921875 time for calcul the mask position with numpy : 0.02439117431640625 nb_pixel_total : 47150 time to create 1 rle with old method : 0.0522768497467041 time for calcul the mask position with numpy : 0.024387836456298828 nb_pixel_total : 18773 time to create 1 rle with old method : 0.023461580276489258 time for calcul the mask position with numpy : 0.026293039321899414 nb_pixel_total : 26269 time to create 1 rle with old method : 0.029027700424194336 time for calcul the mask position with numpy : 0.024967193603515625 nb_pixel_total : 35903 time to create 1 rle with old method : 0.03956913948059082 time for calcul the mask position with numpy : 0.024662494659423828 nb_pixel_total : 8149 time to create 1 rle with old method : 0.009192943572998047 time for calcul the mask position with numpy : 0.0272519588470459 nb_pixel_total : 20559 time to create 1 rle with old method : 0.022872447967529297 time for calcul the mask position with numpy : 0.025171756744384766 nb_pixel_total : 16673 time to create 1 rle with old method : 0.01810598373413086 time for calcul the mask position with numpy : 0.024533510208129883 nb_pixel_total : 76626 time to create 1 rle with old method : 0.08693647384643555 time for calcul the mask position with numpy : 0.03934288024902344 nb_pixel_total : 24285 time to create 1 rle with old method : 0.026424884796142578 time for calcul the mask position with numpy : 0.04131650924682617 nb_pixel_total : 40490 time to create 1 rle with old method : 0.04610490798950195 time for calcul the mask position with numpy : 0.04189586639404297 nb_pixel_total : 31053 time to create 1 rle with old method : 0.03816866874694824 time for calcul the mask position with numpy : 0.042109012603759766 nb_pixel_total : 150877 time to create 1 rle with new method : 0.6598405838012695 time for calcul the mask position with numpy : 0.03696942329406738 nb_pixel_total : 23160 time to create 1 rle with old method : 0.026105403900146484 create new chi : 2.9755501747131348 time to delete rle : 0.0017859935760498047 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 11268 TO DO : save crop sub photo not yet done ! save time : 0.6580371856689453 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.743168354034424 time for calcul the mask position with numpy : 0.7670574188232422 nb_pixel_total : 7980448 time to create 1 rle with new method : 0.9590418338775635 time for calcul the mask position with numpy : 0.04228949546813965 nb_pixel_total : 773 time to create 1 rle with old method : 0.0012433528900146484 time for calcul the mask position with numpy : 0.04490804672241211 nb_pixel_total : 47135 time to create 1 rle with old method : 0.05477404594421387 time for calcul the mask position with numpy : 0.04043889045715332 nb_pixel_total : 28081 time to create 1 rle with old method : 0.033365488052368164 time for calcul the mask position with numpy : 0.04265546798706055 nb_pixel_total : 11958 time to create 1 rle with old method : 0.014268636703491211 time for calcul the mask position with numpy : 0.03474235534667969 nb_pixel_total : 42815 time to create 1 rle with old method : 0.04830598831176758 time for calcul the mask position with numpy : 0.028621435165405273 nb_pixel_total : 9064 time to create 1 rle with old method : 0.010437250137329102 time for calcul the mask position with numpy : 0.026587963104248047 nb_pixel_total : 131751 time to create 1 rle with old method : 0.1503281593322754 time for calcul the mask position with numpy : 0.027736186981201172 nb_pixel_total : 42375 time to create 1 rle with old method : 0.04797482490539551 create new chi : 2.420421838760376 time to delete rle : 0.001050710678100586 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6859 TO DO : save crop sub photo not yet done ! save time : 0.4299600124359131 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 6.331603050231934 time for calcul the mask position with numpy : 0.5562031269073486 nb_pixel_total : 7487241 time to create 1 rle with new method : 1.1992802619934082 time for calcul the mask position with numpy : 0.04414176940917969 nb_pixel_total : 180732 time to create 1 rle with new method : 0.9978234767913818 time for calcul the mask position with numpy : 0.04454302787780762 nb_pixel_total : 39106 time to create 1 rle with old method : 0.04553842544555664 time for calcul the mask position with numpy : 0.04490375518798828 nb_pixel_total : 13595 time to create 1 rle with old method : 0.014724493026733398 time for calcul the mask position with numpy : 0.041464805603027344 nb_pixel_total : 62789 time to create 1 rle with old method : 0.06976819038391113 time for calcul the mask position with numpy : 0.042656898498535156 nb_pixel_total : 48435 time to create 1 rle with old method : 0.05340170860290527 time for calcul the mask position with numpy : 0.0410916805267334 nb_pixel_total : 10952 time to create 1 rle with old method : 0.012261390686035156 time for calcul the mask position with numpy : 0.04134321212768555 nb_pixel_total : 109822 time to create 1 rle with old method : 0.12009954452514648 time for calcul the mask position with numpy : 0.04007220268249512 nb_pixel_total : 16254 time to create 1 rle with old method : 0.01857590675354004 time for calcul the mask position with numpy : 0.03940415382385254 nb_pixel_total : 18211 time to create 1 rle with old method : 0.020198583602905273 time for calcul the mask position with numpy : 0.034470558166503906 nb_pixel_total : 15406 time to create 1 rle with old method : 0.01708245277404785 time for calcul the mask position with numpy : 0.026958703994750977 nb_pixel_total : 64558 time to create 1 rle with old method : 0.0725405216217041 time for calcul the mask position with numpy : 0.03452491760253906 nb_pixel_total : 116517 time to create 1 rle with old method : 0.12952375411987305 time for calcul the mask position with numpy : 0.04456925392150879 nb_pixel_total : 56278 time to create 1 rle with old method : 0.15993762016296387 time for calcul the mask position with numpy : 0.0566866397857666 nb_pixel_total : 54504 time to create 1 rle with old method : 0.09803104400634766 create new chi : 4.242031097412109 time to delete rle : 0.0032553672790527344 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11618 TO DO : save crop sub photo not yet done ! save time : 0.7065107822418213 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 4.248578310012817 time for calcul the mask position with numpy : 0.9556822776794434 nb_pixel_total : 7841342 time to create 1 rle with new method : 0.7450351715087891 time for calcul the mask position with numpy : 0.035855770111083984 nb_pixel_total : 9365 time to create 1 rle with old method : 0.010655403137207031 time for calcul the mask position with numpy : 0.025954484939575195 nb_pixel_total : 26340 time to create 1 rle with old method : 0.030318498611450195 time for calcul the mask position with numpy : 0.02662372589111328 nb_pixel_total : 8479 time to create 1 rle with old method : 0.009844541549682617 time for calcul the mask position with numpy : 0.02646470069885254 nb_pixel_total : 31476 time to create 1 rle with old method : 0.035494327545166016 time for calcul the mask position with numpy : 0.026720285415649414 nb_pixel_total : 54396 time to create 1 rle with old method : 0.0668482780456543 time for calcul the mask position with numpy : 0.027979612350463867 nb_pixel_total : 11945 time to create 1 rle with old method : 0.013550281524658203 time for calcul the mask position with numpy : 0.027319908142089844 nb_pixel_total : 269161 time to create 1 rle with new method : 0.7102670669555664 time for calcul the mask position with numpy : 0.027235746383666992 nb_pixel_total : 28355 time to create 1 rle with old method : 0.035010337829589844 time for calcul the mask position with numpy : 0.03179121017456055 nb_pixel_total : 13541 time to create 1 rle with old method : 0.015761613845825195 create new chi : 2.9571914672851562 time to delete rle : 0.0018768310546875 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6752 TO DO : save crop sub photo not yet done ! save time : 0.4326026439666748 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 5.3556294441223145 time for calcul the mask position with numpy : 0.34353089332580566 nb_pixel_total : 7715534 time to create 1 rle with new method : 0.7447724342346191 time for calcul the mask position with numpy : 0.025209903717041016 nb_pixel_total : 11381 time to create 1 rle with old method : 0.012852191925048828 time for calcul the mask position with numpy : 0.040760040283203125 nb_pixel_total : 59521 time to create 1 rle with old method : 0.06634020805358887 time for calcul the mask position with numpy : 0.042849063873291016 nb_pixel_total : 44482 time to create 1 rle with old method : 0.048864126205444336 time for calcul the mask position with numpy : 0.03521728515625 nb_pixel_total : 33611 time to create 1 rle with old method : 0.03752875328063965 time for calcul the mask position with numpy : 0.026680469512939453 nb_pixel_total : 73338 time to create 1 rle with old method : 0.08286786079406738 time for calcul the mask position with numpy : 0.025050878524780273 nb_pixel_total : 3908 time to create 1 rle with old method : 0.004376649856567383 time for calcul the mask position with numpy : 0.025529146194458008 nb_pixel_total : 11869 time to create 1 rle with old method : 0.013389348983764648 time for calcul the mask position with numpy : 0.025197505950927734 nb_pixel_total : 33507 time to create 1 rle with old method : 0.03750729560852051 time for calcul the mask position with numpy : 0.02508258819580078 nb_pixel_total : 50920 time to create 1 rle with old method : 0.057342529296875 time for calcul the mask position with numpy : 0.026113033294677734 nb_pixel_total : 142315 time to create 1 rle with old method : 0.1575000286102295 time for calcul the mask position with numpy : 0.028248071670532227 nb_pixel_total : 114014 time to create 1 rle with old method : 0.15517544746398926 create new chi : 2.133974313735962 time to delete rle : 0.0012481212615966797 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8308 TO DO : save crop sub photo not yet done ! save time : 0.5125625133514404 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 6.631091356277466 time for calcul the mask position with numpy : 0.4187500476837158 nb_pixel_total : 6157855 time to create 1 rle with new method : 0.8861596584320068 time for calcul the mask position with numpy : 0.026903867721557617 nb_pixel_total : 171797 time to create 1 rle with new method : 0.6328027248382568 time for calcul the mask position with numpy : 0.02652263641357422 nb_pixel_total : 28945 time to create 1 rle with old method : 0.032418251037597656 time for calcul the mask position with numpy : 0.04406166076660156 nb_pixel_total : 1646921 time to create 1 rle with new method : 0.7120308876037598 time for calcul the mask position with numpy : 0.02711939811706543 nb_pixel_total : 48075 time to create 1 rle with old method : 0.05911850929260254 time for calcul the mask position with numpy : 0.026178598403930664 nb_pixel_total : 9910 time to create 1 rle with old method : 0.01130986213684082 time for calcul the mask position with numpy : 0.02441120147705078 nb_pixel_total : 10073 time to create 1 rle with old method : 0.011048555374145508 time for calcul the mask position with numpy : 0.024557113647460938 nb_pixel_total : 51673 time to create 1 rle with old method : 0.05590009689331055 time for calcul the mask position with numpy : 0.024753093719482422 nb_pixel_total : 17348 time to create 1 rle with old method : 0.019023656845092773 time for calcul the mask position with numpy : 0.025743484497070312 nb_pixel_total : 24456 time to create 1 rle with old method : 0.027281761169433594 time for calcul the mask position with numpy : 0.025986433029174805 nb_pixel_total : 25754 time to create 1 rle with old method : 0.028760910034179688 time for calcul the mask position with numpy : 0.02854323387145996 nb_pixel_total : 41944 time to create 1 rle with old method : 0.04706287384033203 time for calcul the mask position with numpy : 0.029694795608520508 nb_pixel_total : 59649 time to create 1 rle with old method : 0.07612895965576172 create new chi : 3.46069598197937 time to delete rle : 0.0027816295623779297 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 12570 TO DO : save crop sub photo not yet done ! save time : 1.1556007862091064 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.184998512268066 time for calcul the mask position with numpy : 0.8114328384399414 nb_pixel_total : 7728037 time to create 1 rle with new method : 1.3439264297485352 time for calcul the mask position with numpy : 0.04870247840881348 nb_pixel_total : 265710 time to create 1 rle with new method : 1.1902594566345215 time for calcul the mask position with numpy : 0.04207944869995117 nb_pixel_total : 82045 time to create 1 rle with old method : 0.09049868583679199 time for calcul the mask position with numpy : 0.042688846588134766 nb_pixel_total : 11875 time to create 1 rle with old method : 0.013395547866821289 time for calcul the mask position with numpy : 0.04350018501281738 nb_pixel_total : 59082 time to create 1 rle with old method : 0.06657075881958008 time for calcul the mask position with numpy : 0.04314231872558594 nb_pixel_total : 27059 time to create 1 rle with old method : 0.030552148818969727 time for calcul the mask position with numpy : 0.04160261154174805 nb_pixel_total : 36288 time to create 1 rle with old method : 0.04087018966674805 time for calcul the mask position with numpy : 0.042737483978271484 nb_pixel_total : 12406 time to create 1 rle with old method : 0.0140533447265625 time for calcul the mask position with numpy : 0.040900230407714844 nb_pixel_total : 61643 time to create 1 rle with old method : 0.06947112083435059 time for calcul the mask position with numpy : 0.03292393684387207 nb_pixel_total : 10255 time to create 1 rle with old method : 0.011358976364135742 create new chi : 4.13425350189209 time to delete rle : 0.0013976097106933594 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8576 TO DO : save crop sub photo not yet done ! save time : 0.5242142677307129 map_output_result : {1381749647: (0.0, 'Should be the crop_list due to order', 0), 1381749411: (0.0, 'Should be the crop_list due to order', 0), 1381749364: (0.0, 'Should be the crop_list due to order', 0), 1381749337: (0.0, 'Should be the crop_list due to order', 0), 1381749301: (0.0, 'Should be the crop_list due to order', 0), 1381749255: (0.0, 'Should be the crop_list due to order', 0), 1381749192: (0.0, 'Should be the crop_list due to order', 0), 1381748821: (0.0, 'Should be the crop_list due to order', 0), 1381748794: (0.0, 'Should be the crop_list due to order', 0), 1381748786: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1381749647, 1381749411, 1381749364, 1381749337, 1381749301, 1381749255, 1381749192, 1381748821, 1381748794, 1381748786] Looping around the photos to save general results len do output : 10 /1381749647.Didn't retrieve data . /1381749411.Didn't retrieve data . /1381749364.Didn't retrieve data . /1381749337.Didn't retrieve data . /1381749301.Didn't retrieve data . /1381749255.Didn't retrieve data . /1381749192.Didn't retrieve data . /1381748821.Didn't retrieve data . /1381748794.Didn't retrieve data . /1381748786.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749647', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749411', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749364', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749337', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749301', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749255', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749192', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748821', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748794', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748786', None, None, None, None, None, '3670239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.017970800399780273 save_final save missing photos in datou_result : time spend for datou_step_exec : 97.08008027076721 time spend to save output : 0.018497705459594727 total time spend for step 3 : 97.0985779762268 step4:ventilate_hashtags_in_portfolio Fri Sep 5 14:55:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26579614 get user id for portfolio 26579614 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579614 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','pehd','pet_clair','background','carton','flou','metal','papier','environnement','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579614 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','pehd','pet_clair','background','carton','flou','metal','papier','environnement','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579614 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','pehd','pet_clair','background','carton','flou','metal','papier','environnement','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26580557,26580558,26580559,26580560,26580561,26580562,26580563,26580564,26580565,26580566,26580567?tags=mal_croppe,pet_fonce,pehd,pet_clair,background,carton,flou,metal,papier,environnement,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1381749647, 1381749411, 1381749364, 1381749337, 1381749301, 1381749255, 1381749192, 1381748821, 1381748794, 1381748786] Looping around the photos to save general results len do output : 1 /26579614. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749647', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749411', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749364', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749337', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749301', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749255', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749192', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748821', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748794', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748786', None, None, None, None, None, '3670239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016724824905395508 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8366341590881348 time spend to save output : 0.017055511474609375 total time spend for step 4 : 1.8536896705627441 step5:final Fri Sep 5 14:55:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1381749647: ('0.09124505690586421',), 1381749411: ('0.09124505690586421',), 1381749364: ('0.09124505690586421',), 1381749337: ('0.09124505690586421',), 1381749301: ('0.09124505690586421',), 1381749255: ('0.09124505690586421',), 1381749192: ('0.09124505690586421',), 1381748821: ('0.09124505690586421',), 1381748794: ('0.09124505690586421',), 1381748786: ('0.09124505690586421',)} new output for save of step final : {1381749647: ('0.09124505690586421',), 1381749411: ('0.09124505690586421',), 1381749364: ('0.09124505690586421',), 1381749337: ('0.09124505690586421',), 1381749301: ('0.09124505690586421',), 1381749255: ('0.09124505690586421',), 1381749192: ('0.09124505690586421',), 1381748821: ('0.09124505690586421',), 1381748794: ('0.09124505690586421',), 1381748786: ('0.09124505690586421',)} [1381749647, 1381749411, 1381749364, 1381749337, 1381749301, 1381749255, 1381749192, 1381748821, 1381748794, 1381748786] Looping around the photos to save general results len do output : 10 /1381749647.Didn't retrieve data . /1381749411.Didn't retrieve data . /1381749364.Didn't retrieve data . /1381749337.Didn't retrieve data . /1381749301.Didn't retrieve data . /1381749255.Didn't retrieve data . /1381749192.Didn't retrieve data . /1381748821.Didn't retrieve data . /1381748794.Didn't retrieve data . /1381748786.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749647', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749411', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749364', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749337', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749301', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749255', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749192', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748821', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748794', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748786', None, None, None, None, None, '3670239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.016219377517700195 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12941741943359375 time spend to save output : 0.046991825103759766 total time spend for step 5 : 0.17640924453735352 step6:blur_detection Fri Sep 5 14:55:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a.jpg resize: (2160, 3840) 1381749647 -6.779973465406352 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264.jpg resize: (2160, 3840) 1381749411 -6.65294303270428 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e.jpg resize: (2160, 3840) 1381749364 -6.708739274780791 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed.jpg resize: (2160, 3840) 1381749337 -6.743986883347808 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8.jpg resize: (2160, 3840) 1381749301 -6.507272875382147 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846.jpg resize: (2160, 3840) 1381749255 -6.459722682738137 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a.jpg resize: (2160, 3840) 1381749192 -6.501585864716125 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4.jpg resize: (2160, 3840) 1381748821 -6.22029302793742 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e.jpg resize: (2160, 3840) 1381748794 -5.3553173199034925 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689.jpg resize: (2160, 3840) 1381748786 -5.749293750054363 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228353_0.png resize: (660, 745) 1381762140 -3.848591409206301 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228356_0.png resize: (217, 283) 1381762142 -0.8626281289510723 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228357_0.png resize: (199, 273) 1381762143 -1.0853547842976015 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228359_0.png resize: (246, 150) 1381762144 -1.9466638868361128 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228360_0.png resize: (174, 145) 1381762146 -0.05542108400624678 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228361_0.png resize: (305, 255) 1381762147 -2.549362137221282 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228362_0.png resize: (350, 312) 1381762148 -1.731584650392764 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228365_0.png resize: (135, 141) 1381762149 -1.1774384731325431 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228368_0.png resize: (161, 332) 1381762151 1.6790263020795972 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228369_0.png resize: (393, 559) 1381762152 -3.6196646047781655 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228370_0.png resize: (256, 252) 1381762153 6.837540126902269 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228371_0.png resize: (345, 491) 1381762155 -2.5492601863929156 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228372_0.png resize: (198, 370) 1381762156 0.5897632608045886 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228373_0.png resize: (323, 214) 1381762158 -2.6658936260765826 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228374_0.png resize: (152, 165) 1381762159 5.454058623265423 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228375_0.png resize: (198, 152) 1381762160 -3.021704379774543 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228376_0.png resize: (290, 238) 1381762162 -4.642013184064916 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228377_0.png resize: (73, 134) 1381762163 3.5211072938267542 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228378_0.png resize: (198, 268) 1381762164 -2.1355361924973706 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228380_0.png resize: (203, 239) 1381762165 -4.4141672147497095 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228381_0.png resize: (118, 290) 1381762167 0.6148570236323029 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228382_0.png resize: (106, 217) 1381762168 -3.9830815329198384 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228383_0.png resize: (282, 285) 1381762169 -3.299352888098413 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228384_0.png resize: (349, 523) 1381762171 -2.356141368486167 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228385_0.png resize: (217, 199) 1381762172 -0.8540204016998748 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228386_0.png resize: (383, 420) 1381762173 -3.2334320022424707 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228387_0.png resize: (408, 177) 1381762175 -2.827574822712462 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228388_0.png resize: (303, 247) 1381762176 -4.297021262997137 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228389_0.png resize: (193, 238) 1381762177 0.5255621884374216 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228390_0.png resize: (140, 170) 1381762179 -4.49958868735064 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228391_0.png resize: (125, 215) 1381762180 -3.079411727050918 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228393_0.png resize: (402, 425) 1381762181 -3.6107825451060434 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228394_0.png resize: (158, 194) 1381762183 -2.8890569197120772 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228395_0.png resize: (265, 127) 1381762184 -0.13666458188481578 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228397_0.png resize: (275, 140) 1381762185 -3.524949861752688 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228398_0.png resize: (564, 125) 1381762187 -3.447862143907491 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228399_0.png resize: (211, 181) 1381762188 -2.99080057049031 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228401_0.png resize: (187, 174) 1381762189 -3.7322906915859377 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228402_0.png resize: (150, 234) 1381762191 -4.245531065578034 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228403_0.png resize: (180, 96) 1381762192 -3.2395239645842913 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228404_0.png resize: (295, 277) 1381762193 -2.274256925715152 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228405_0.png resize: (272, 200) 1381762195 0.21756010983332108 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228406_0.png resize: (265, 99) 1381762196 -3.2437333526405063 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228407_0.png resize: (291, 248) 1381762197 -3.5934198378330797 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228408_0.png resize: (127, 233) 1381762199 -2.1875533008735415 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228409_0.png resize: (280, 186) 1381762200 -2.830693576556498 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228410_0.png resize: (267, 378) 1381762201 -3.751648074742001 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228411_0.png resize: (479, 391) 1381762203 1.1422644494381273 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228412_0.png resize: (104, 117) 1381762204 4.711423567947013 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228413_0.png resize: (484, 147) 1381762205 -3.8562647246360706 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228414_0.png resize: (113, 181) 1381762206 -2.1467358874516975 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228415_0.png resize: (184, 277) 1381762207 -4.026690081182414 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228418_0.png resize: (338, 290) 1381762208 -1.3092027147806 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228419_0.png resize: (319, 215) 1381762209 0.7272443222962706 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228420_0.png resize: (558, 333) 1381762210 -3.9722891260192195 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228421_0.png resize: (282, 453) 1381762211 -2.5318400189464665 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228422_0.png resize: (209, 144) 1381762212 -0.3491111708618254 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228423_0.png resize: (203, 185) 1381762213 -3.2254897779730975 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228424_0.png resize: (161, 201) 1381762214 -3.519962850860886 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228426_0.png resize: (172, 135) 1381762215 -2.217560734509013 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228427_0.png resize: (172, 351) 1381762216 -3.950717277345993 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228428_0.png resize: (304, 234) 1381762217 -4.634580911908204 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228429_0.png resize: (161, 104) 1381762218 -2.582459020946344 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228430_0.png resize: (361, 200) 1381762219 -1.7238588375135062 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228431_0.png resize: (399, 783) 1381762220 -3.7504647731775003 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228432_0.png resize: (113, 141) 1381762221 -3.359063965656725 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228433_0.png resize: (311, 160) 1381762222 -2.0678840292800693 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228434_0.png resize: (682, 696) 1381762223 1.151974016672059 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228435_0.png resize: (238, 100) 1381762224 -2.918250879965878 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228436_0.png resize: (252, 298) 1381762225 1.6512208123461907 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228438_0.png resize: (173, 69) 1381762226 -3.838000013848285 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228439_0.png resize: (140, 280) 1381762227 -3.256594334319449 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228440_0.png resize: (113, 106) 1381762228 -3.242768490791322 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228441_0.png resize: (355, 478) 1381762229 0.2303546801653778 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228442_0.png resize: (428, 522) 1381762230 -3.0766684320896363 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228443_0.png resize: (157, 449) 1381762231 0.548507915447064 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228444_0.png resize: (241, 231) 1381762232 -2.0771350762060377 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228445_0.png resize: (180, 258) 1381762233 -2.2338425917522535 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228446_0.png resize: (70, 75) 1381762234 -3.230923848678077 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228447_0.png resize: (437, 219) 1381762235 -4.031910637574166 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228448_0.png resize: (359, 302) 1381762236 -3.172969884008968 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228449_0.png resize: (210, 256) 1381762237 4.542302104904525 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228451_0.png resize: (200, 86) 1381762238 -3.711592049650931 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228452_0.png resize: (251, 306) 1381762239 -4.6572335183354845 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228453_0.png resize: (279, 278) 1381762240 -4.9848998211913855 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228454_0.png resize: (202, 215) 1381762241 -4.367511356100182 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228455_0.png resize: (117, 256) 1381762242 -3.334852578350964 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228456_0.png resize: (197, 128) 1381762243 -5.000406256753589 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228457_0.png resize: (383, 261) 1381762244 -4.76621807296919 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228458_0.png resize: (145, 98) 1381762245 -4.5466864092225565 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228459_0.png resize: (103, 130) 1381762246 -4.719706367305025 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228460_0.png resize: (287, 203) 1381762247 -5.257263321722708 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228463_0.png resize: (852, 372) 1381762248 -3.2187450121613477 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228464_0.png resize: (105, 140) 1381762249 -0.9117523000637707 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228465_0.png resize: (213, 389) 1381762250 -3.986689241263628 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228466_0.png resize: (113, 166) 1381762251 -2.602342295065778 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228471_0.png resize: (280, 407) 1381762252 -5.121796225097916 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228472_0.png resize: (1082, 535) 1381762253 -3.2522755736384905 treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228379_0.png resize: (234, 159) 1381762254 -4.387322782289816 treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228392_0.png resize: (171, 261) 1381762255 -4.6438763362542215 treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228437_0.png resize: (183, 243) 1381762256 -3.3248183440915873 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228462_0.png resize: (177, 232) 1381762257 -3.6761408326967784 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228364_0.png resize: (138, 156) 1381762260 -4.028987739391028 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228469_0.png resize: (307, 258) 1381762261 -4.979394805042628 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228470_0.png resize: (90, 155) 1381762262 -3.4280548522385375 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228354_0.png resize: (205, 129) 1381762339 -4.4638480773778415 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228355_0.png resize: (349, 534) 1381762341 -3.5364058299996284 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228358_0.png resize: (79, 284) 1381762342 -0.38920631646607046 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228363_0.png resize: (232, 232) 1381762343 -4.391634893380368 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228366_0.png resize: (108, 128) 1381762345 -2.0283933755595256 treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228367_0.png resize: (217, 418) 1381762346 -3.3785751926618164 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228396_0.png resize: (516, 390) 1381762347 -3.881959059004854 treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228400_0.png resize: (291, 383) 1381762349 -4.561574950249724 treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228425_0.png resize: (434, 342) 1381762350 -3.9311948637034324 treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228450_0.png resize: (302, 258) 1381762351 -4.255610672687698 treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228461_0.png resize: (1516, 2353) 1381762353 -3.8108482766411993 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228416_0.png resize: (301, 242) 1381762373 -2.877929900988013 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228467_0.png resize: (242, 215) 1381762375 -4.062548972317342 treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228468_0.png resize: (180, 180) 1381762376 -4.342757825640043 treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228417_0.png resize: (305, 237) 1381762383 -2.9470284095816393 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 130 time used for this insertion : 0.017776012420654297 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 130 time used for this insertion : 0.032243967056274414 save missing photos in datou_result : time spend for datou_step_exec : 45.37570095062256 time spend to save output : 0.05541491508483887 total time spend for step 6 : 45.4311158657074 step7:brightness Fri Sep 5 14:55:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a.jpg treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264.jpg treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e.jpg treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed.jpg treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8.jpg treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846.jpg treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a.jpg treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4.jpg treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e.jpg treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689.jpg treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228353_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228356_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228357_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228359_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228360_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228361_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228362_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228365_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228368_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228369_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228370_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228371_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228372_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228373_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228374_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228375_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228376_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228377_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228378_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228380_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228381_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228382_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228383_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228384_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228385_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228386_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228387_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228388_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228389_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228390_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228391_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228393_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228394_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228395_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228397_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228398_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228399_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228401_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228402_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228403_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228404_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228405_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228406_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228407_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228408_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228409_0.png treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228410_0.png treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228411_0.png treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228412_0.png treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228413_0.png treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228414_0.png treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228415_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228418_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228419_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228420_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228421_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228422_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228423_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228424_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228426_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228427_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228428_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228429_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228430_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228431_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228432_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228433_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228434_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228435_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228436_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228438_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228439_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228440_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228441_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228442_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228443_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228444_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228445_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228446_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228447_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228448_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228449_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228451_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228452_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228453_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228454_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228455_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228456_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228457_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228458_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228459_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228460_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228463_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228464_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228465_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228466_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228471_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228472_0.png treat image : temp/1757076628_477835_1381749411_edab578300ef23e755a6e5ac39af0264_rle_crop_3946228379_0.png treat image : temp/1757076628_477835_1381749364_4cfefa535309b39b5b2655e50d72936e_rle_crop_3946228392_0.png treat image : temp/1757076628_477835_1381749192_907804fccc158cf3a4b85fa9decf387a_rle_crop_3946228437_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228462_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228364_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228469_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228470_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228354_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228355_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228358_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228363_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228366_0.png treat image : temp/1757076628_477835_1381749647_11adbfd55cadd8bd3dd3d35d40c7618a_rle_crop_3946228367_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228396_0.png treat image : temp/1757076628_477835_1381749337_6179a3d8f9d0df82c810fbdefeb175ed_rle_crop_3946228400_0.png treat image : temp/1757076628_477835_1381749255_72b0e1107caac33a7483efc7d33a4846_rle_crop_3946228425_0.png treat image : temp/1757076628_477835_1381748821_cd9e259c4cc2d56409acf7306391ddd4_rle_crop_3946228450_0.png treat image : temp/1757076628_477835_1381748794_8a5c35e3621803f22543293ecba6c27e_rle_crop_3946228461_0.png treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228416_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228467_0.png treat image : temp/1757076628_477835_1381748786_16b0a352a44a2055c05f21afbbb90689_rle_crop_3946228468_0.png treat image : temp/1757076628_477835_1381749301_99191afed9f2b8bb87186bd312d87eb8_rle_crop_3946228417_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 130 time used for this insertion : 0.018065452575683594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 130 time used for this insertion : 0.032297611236572266 save missing photos in datou_result : time spend for datou_step_exec : 10.453869342803955 time spend to save output : 0.05629229545593262 total time spend for step 7 : 10.510161638259888 step8:velours_tree Fri Sep 5 14:56:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.42144083976745605 time spend to save output : 6.246566772460938e-05 total time spend for step 8 : 0.42150330543518066 step9:send_mail_cod Fri Sep 5 14:56:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26579614_05-09-2025_14_56_02.pdf 26580557 imagette265805571757076962 26580558 change filename to text .imagette265805581757076962 26580559 imagette265805591757076962 26580560 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265805601757076962 26580561 imagette265805611757076963 26580562 change filename to text .change filename to text .change filename to text .change filename to text .imagette265805621757076963 26580563 imagette265805631757076964 26580564 change filename to text .change filename to text .change filename to text .imagette265805641757076964 26580565 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265805651757076964 26580567 change filename to text .change filename to text .change filename to text .imagette265805671757076966 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26579614 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26580557,26580558,26580559,26580560,26580561,26580562,26580563,26580564,26580565,26580566,26580567?tags=mal_croppe,pet_fonce,pehd,pet_clair,background,carton,flou,metal,papier,environnement,autre args[1381749647] : ((1381749647, -6.779973465406352, 492609224), (1381749647, 1.4980832226151966, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381749411] : ((1381749411, -6.65294303270428, 492609224), (1381749411, 1.4717744788699074, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381749364] : ((1381749364, -6.708739274780791, 492609224), (1381749364, 1.4887950102792875, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381749337] : ((1381749337, -6.743986883347808, 492609224), (1381749337, 1.4676440931328352, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381749301] : ((1381749301, -6.507272875382147, 492609224), (1381749301, 1.5774601773144483, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381749255] : ((1381749255, -6.459722682738137, 492609224), (1381749255, 1.5531081481650229, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381749192] : ((1381749192, -6.501585864716125, 492609224), (1381749192, 1.4544436516967436, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381748821] : ((1381748821, -6.22029302793742, 492609224), (1381748821, 1.5408838219254155, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381748794] : ((1381748794, -5.3553173199034925, 492609224), (1381748794, 0.4577847801829511, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com args[1381748786] : ((1381748786, -5.749293750054363, 492609224), (1381748786, 0.5615313880185162, 2107752395), '0.09124505690586421') We are sending mail with results at report@fotonower.com refus_total : 0.09124505690586421 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26579614 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579614_05-09-2025_14_56_02.pdf results_Auto_P26579614_05-09-2025_14_56_02.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579614_05-09-2025_14_56_02.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26579614','results_Auto_P26579614_05-09-2025_14_56_02.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579614_05-09-2025_14_56_02.pdf','pdf','','0.7','0.09124505690586421') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26579614

https://www.fotonower.com/image?json=false&list_photos_id=1381749647
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381749411
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381749364
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381749337
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381749301
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381749255
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381749192
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381748821
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381748794
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381748786
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.12%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26580558?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26580560?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26580562?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26580564?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26580565?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26580567?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579614_05-09-2025_14_56_02.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26580557,26580558,26580559,26580560,26580561,26580562,26580563,26580564,26580565,26580566,26580567?tags=mal_croppe,pet_fonce,pehd,pet_clair,background,carton,flou,metal,papier,environnement,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 05 Sep 2025 12:56:10 GMT Content-Length: 0 Connection: close X-Message-Id: pKY_kKhGQbOkxv3tdgOgRw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1381749647, 1381749411, 1381749364, 1381749337, 1381749301, 1381749255, 1381749192, 1381748821, 1381748794, 1381748786] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749647', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749411', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749364', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749337', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749301', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749255', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749192', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748821', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748794', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748786', None, None, None, None, None, '3670239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.019071578979492188 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.601089239120483 time spend to save output : 0.019317626953125 total time spend for step 9 : 7.620406866073608 step10:split_time_score Fri Sep 5 14:56:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05092025 26579614 Nombre de photos uploadées : 10 / 23040 (0%) 05092025 26579614 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 05092025 26579614 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007462501525878906 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22214579582214355 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.039801469434054416 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26567363_05-09-2025_08_43_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26567363 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26567363 AND mptpi.`type`=3726 To do Qualite : 0.03246848149762702 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26569619_05-09-2025_09_47_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26569619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26569619 AND mptpi.`type`=3726 To do Qualite : 0.08177850919495884 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26573164_05-09-2025_11_21_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26573164 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26573164 AND mptpi.`type`=3594 To do Qualite : 0.02766889116869236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26573999_05-09-2025_11_38_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26573999 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26573999 AND mptpi.`type`=3726 To do Qualite : 0.020968054637391136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26574000_05-09-2025_11_36_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26574000 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26574000 AND mptpi.`type`=3726 To do Qualite : 0.06326802484187678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579608_05-09-2025_14_38_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579608 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579609 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579611 order by id desc limit 1 Qualite : 0.09124505690586421 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579614_05-09-2025_14_56_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579614 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579614 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579639 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05092025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1381749647, 1381749411, 1381749364, 1381749337, 1381749301, 1381749255, 1381749192, 1381748821, 1381748794, 1381748786] Looping around the photos to save general results len do output : 1 /26579614Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749647', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749411', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749364', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749337', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749301', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749255', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381749192', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748821', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748794', None, None, None, None, None, '3670239') ('3318', None, None, None, None, None, None, None, '3670239') ('3318', '26579614', '1381748786', None, None, None, None, None, '3670239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013354301452636719 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.6023128032684326 time spend to save output : 0.013662099838256836 total time spend for step 10 : 3.6159749031066895 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 146.74user 147.70system 5:48.50elapsed 84%CPU (0avgtext+0avgdata 3372436maxresident)k 2035664inputs+128896outputs (30023major+13858321minor)pagefaults 0swaps