python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2782182 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2874096'] with mtr_portfolio_ids : ['23051725'] and first list_photo_ids : [] new path : /proc/2782182/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.6188693046569824 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri May 16 08:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6595 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-16 08:20:33.821909: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-16 08:20:33.847068: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-16 08:20:33.848993: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff2ac000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-16 08:20:33.849025: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-16 08:20:33.853032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-16 08:20:33.988599: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1a02e1c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-16 08:20:33.988658: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-16 08:20:33.989696: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 08:20:33.990133: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 08:20:33.993162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 08:20:33.996152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 08:20:33.996648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 08:20:34.000235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 08:20:34.002001: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 08:20:34.006996: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 08:20:34.008298: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 08:20:34.008392: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 08:20:34.009038: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 08:20:34.009055: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 08:20:34.009064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 08:20:34.010590: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5851 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-16 08:20:34.362569: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 08:20:34.362688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 08:20:34.362706: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 08:20:34.362723: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 08:20:34.362738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 08:20:34.362753: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 08:20:34.362768: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 08:20:34.362784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 08:20:34.363822: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 08:20:34.364889: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 08:20:34.364924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 08:20:34.364940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 08:20:34.364954: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 08:20:34.364968: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 08:20:34.364982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 08:20:34.364996: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 08:20:34.365010: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 08:20:34.366011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 08:20:34.366047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 08:20:34.366055: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 08:20:34.366063: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 08:20:34.367142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5851 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-16 08:20:44.514673: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 08:20:44.708487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 Detection mask done ! Trying to reset tf kernel 2782936 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3694 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8983 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008995532989501953 nb_pixel_total : 17325 time to create 1 rle with old method : 0.022316932678222656 length of segment : 130 time for calcul the mask position with numpy : 0.00022745132446289062 nb_pixel_total : 10900 time to create 1 rle with old method : 0.0134124755859375 length of segment : 132 time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 28090 time to create 1 rle with old method : 0.03510928153991699 length of segment : 220 time for calcul the mask position with numpy : 0.0007266998291015625 nb_pixel_total : 34214 time to create 1 rle with old method : 0.038805246353149414 length of segment : 249 time for calcul the mask position with numpy : 0.0003681182861328125 nb_pixel_total : 19005 time to create 1 rle with old method : 0.021775007247924805 length of segment : 219 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 10211 time to create 1 rle with old method : 0.0121917724609375 length of segment : 135 time for calcul the mask position with numpy : 0.0014185905456542969 nb_pixel_total : 61788 time to create 1 rle with old method : 0.09610414505004883 length of segment : 384 time for calcul the mask position with numpy : 0.0003020763397216797 nb_pixel_total : 15993 time to create 1 rle with old method : 0.01893472671508789 length of segment : 168 time for calcul the mask position with numpy : 0.0008096694946289062 nb_pixel_total : 42297 time to create 1 rle with old method : 0.04813075065612793 length of segment : 389 time for calcul the mask position with numpy : 0.00022220611572265625 nb_pixel_total : 9699 time to create 1 rle with old method : 0.011202096939086914 length of segment : 105 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 12555 time to create 1 rle with old method : 0.0146234035491time to create 1 rle with old method : 0.14827966690063477 length of segment : 888 time for calcul the mask position with numpy : 0.0020372867584228516 nb_pixel_total : 45686 time to create 1 rle with old method : 0.05344057083129883 length of segment : 309 time for calcul the mask position with numpy : 0.0012781620025634766 nb_pixel_total : 25589 time to create 1 rle with old method : 0.030428409576416016 length of segment : 145 time for calcul the mask position with numpy : 0.0017199516296386719 nb_pixel_total : 53653 time to create 1 rle with old method : 0.05951428413391113 length of segment : 285 time for calcul the mask position with numpy : 0.002579927444458008 nb_pixel_total : 78257 time to create 1 rle with old method : 0.09110140800476074 length of segment : 251 time for calcul the mask position with numpy : 0.0008256435394287109 nb_pixel_total : 20586 time to create 1 rle with old method : 0.024005413055419922 length of segment : 176 time for calcul the mask position with numpy : 0.002704143524169922 nb_pixel_total : 93772 time to create 1 rle with old method : 0.10535192489624023 length of segment : 533 time for calcul the mask position with numpy : 0.0007855892181396484 nb_pixel_total : 13947 time to create 1 rle with old method : 0.017420053482055664 length of segment : 175 time for calcul the mask position with numpy : 0.0005660057067871094 nb_pixel_total : 19214 time to create 1 rle with old method : 0.030418872833251953 length of segment : 151 time for calcul the mask position with numpy : 0.0018634796142578125 nb_pixel_total : 20324 time to create 1 rle with old method : 0.03202962875366211 length of segment : 340 time for calcul the mask position with numpy : 0.0007543563842773438 nb_pixel_total : 11675 time to create 1 rle with old method : 0.013844728469848633 length of segment : 155 time for calcul the mask position with numpy : 0.0026590824127197266 nb_pixel_total : 49366 time to create 1 rle with old method : 0.05639362335205078 length of segment : 311 time for calcul the mask position with numpy : 0.0009131431579589844 nb_pixel_total : 16550 time to create 1 rle with old method : 0.019076108932495117 length of segment : 210 time for calcul the mask position with numpy : 0.0035593509674072266 nb_pixel_total : 100757 time to create 1 rle with old method : 0.11234092712402344 length of segment : 357 time for calcul the mask position with numpy : 0.006047964096069336 nb_pixel_total : 150239 time to create 1 rle with new method : 0.01058650016784668 length of segment : 601 time for calcul the mask position with numpy : 0.002660512924194336 nb_pixel_total : 61241 time to create 1 rle with old method : 0.06944561004638672 length of segment : 367 time for calcul the mask position with numpy : 0.0006995201110839844 nb_pixel_total : 14845 time to create 1 rle with old method : 0.01786494255065918 length of segment : 105 time for calcul the mask position with numpy : 0.0012748241424560547 nb_pixel_total : 32393 time to create 1 rle with old method : 0.036971092224121094 length of segment : 180 time for calcul the mask position with numpy : 0.0007605552673339844 nb_pixel_total : 20538 time to create 1 rle with old method : 0.023748159408569336 length of segment : 155 time for calcul the mask position with numpy : 0.0012059211730957031 nb_pixel_total : 22402 time to create 1 rle with old method : 0.0261232852935791 length of segment : 214 time for calcul the mask position with numpy : 0.0008454322814941406 nb_pixel_total : 23685 time to create 1 rle with old method : 0.02743816375732422 length of segment : 176 time for calcul the mask position with numpy : 0.004703521728515625 nb_pixel_total : 107761 time to create 1 rle with old method : 0.12395405769348145 length of segment : 431 time for calcul the mask position with numpy : 0.027730464935302734 nb_pixel_total : 423175 time to create 1 rle with new method : 0.05554652214050293 length of segment : 1156 time for calcul the mask position with numpy : 0.0010068416595458984 nb_pixel_total : 16561 time to create 1 rle with old method : 0.018683910369873047 length of segment : 222 time for calcul the mask position with numpy : 0.001195669174194336 nb_pixel_total : 30732 time to create 1 rle with old method : 0.039379119873046875 length of segment : 217 time for calcul the mask position with numpy : 0.002032041549682617 nb_pixel_total : 41500 time to create 1 rle with old method : 0.058356523513793945 length of segment : 336 time for calcul the mask position with numpy : 0.0006015300750732422 nb_pixel_total : 11907 time to create 1 rle with old method : 0.013665914535522461 length of segment : 171 time for calcul the mask position with numpy : 0.005889177322387695 nb_pixel_total : 197456 time to create 1 rle with new method : 0.007861852645874023 length of segment : 528 time for calcul the mask position with numpy : 0.004872560501098633 nb_pixel_total : 120980 time to create 1 rle with old method : 0.13741612434387207 length of segment : 343 time for calcul the mask position with numpy : 0.007806301116943359 nb_pixel_total : 239999 time to create 1 rle with new method : 0.012365579605102539 length of segment : 382 time for calcul the mask position with numpy : 0.0009102821350097656 nb_pixel_total : 20820 time to create 1 rle with old method : 0.024087905883789062 length of segment : 183 time for calcul the mask position with numpy : 0.015434503555297852 nb_pixel_total : 426859 time to create 1 rle with new method : 0.3256864547729492 length of segment : 884 time for calcul the mask position with numpy : 0.003437519073486328 nb_pixel_total : 99191 time to create 1 rle with old method : 0.10845232009887695 length of segment : 411 time for calcul the mask position with numpy : 0.006805896759033203 nb_pixel_total : 103810 time to create 1 rle with old method : 0.11935949325561523 length of segment : 392 time for calcul the mask position with numpy : 0.001314401626586914 nb_pixel_total : 37455 time to create 1 rle with old method : 0.043335676193237305 length of segment : 191 time for calcul the mask position with numpy : 0.0020046234130859375 nb_pixel_total : 41899 time to create 1 rle with old method : 0.048250675201416016 length of segment : 282 time for calcul the mask position with numpy : 0.0006346702575683594 nb_pixel_total : 24654 time to create 1 rle with old method : 0.02823662757873535 length of segment : 181 time for calcul the mask position with numpy : 0.0041506290435791016 nb_pixel_total : 182603 time to create 1 rle with new method : 0.009073257446289062 length of segment : 619 time for calcul the mask position with numpy : 0.0047304630279541016 nb_pixel_total : 163973 time to create 1 rle with new method : 0.0056302547454833984 length of segment : 635 time for calcul the mask position with numpy : 0.003358602523803711 nb_pixel_total : 107301 time to create 1 rle with old method : 0.12981557846069336 length of segment : 335 time for calcul the mask position with numpy : 0.01052403450012207 nb_pixel_total : 242819 time to create 1 rle with new method : 0.02758049964904785 length of segment : 566 time for calcul the mask position with numpy : 0.0013015270233154297 nb_pixel_total : 32651 time to create 1 rle with old method : 0.03866386413574219 length of segment : 202 time for calcul the mask position with numpy : 0.028072118759155273 nb_pixel_total : 522297 time to create 1 rle with new method : 1.0734694004058838 length of segment : 731 time for calcul the mask position with numpy : 0.00371551513671875 nb_pixel_total : 193597 time to create 1 rle with new method : 0.010965585708618164 length of segment : 402 time for calcul the mask position with numpy : 0.001341104507446289 nb_pixel_total : 30198 time to create 1 rle with old method : 0.03429555892944336 length of segment : 401 time for calcul the mask position with numpy : 0.010530233383178711 nb_pixel_total : 471467 time to create 1 rle with new method : 0.03511333465576172 length of segment : 745 time for calcul the mask position with numpy : 0.0015938282012939453 nb_pixel_total : 44233 time to create 1 rle with old method : 0.050099849700927734 length of segment : 367 time for calcul the mask position with numpy : 0.0017735958099365234 nb_pixel_total : 82086 time to create 1 rle with old method : 0.09000086784362793 length of segment : 499 time for calcul the mask position with numpy : 0.0009355545043945312 nb_pixel_total : 20016 time to create 1 rle with old method : 0.03258776664733887 length of segment : 193 time for calcul the mask position with numpy : 0.0009622573852539062 nb_pixel_total : 62013 time to create 1 rle with old method : 0.07289958000183105 length of segment : 308 time for calcul the mask position with numpy : 0.0016181468963623047 nb_pixel_total : 70548 time to create 1 rle with old method : 0.07917928695678711 length of segment : 281 time for calcul the mask position with numpy : 0.0025408267974853516 nb_pixel_total : 43375 time to create 1 rle with old method : 0.04931807518005371 length of segment : 418 time for calcul the mask position with numpy : 0.003881216049194336 nb_pixel_total : 126505 time to create 1 rle with old method : 0.17290949821472168 length of segment : 463 time for calcul the mask position with numpy : 0.0011839866638183594 nb_pixel_total : 44003 time to create 1 rle with old method : 0.050612688064575195 length of segment : 281 time for calcul the mask position with numpy : 0.0005259513854980469 nb_pixel_total : 16266 time to create 1 rle with old method : 0.01956939697265625 length of segment : 169 time for calcul the mask position with numpy : 0.005525112152099609 nb_pixel_total : 216818 time to create 1 rle with new method : 0.01136922836303711 length of segment : 764 time for calcul the mask position with numpy : 0.0036346912384033203 nb_pixel_total : 90762 time to create 1 rle with old method : 0.10570693016052246 length of segment : 467 time for calcul the mask position with numpy : 0.003133058547973633 nb_pixel_total : 76146 time to create 1 rle with old method : 0.12513136863708496 length of segment : 580 time for calcul the mask position with numpy : 0.0033292770385742188 nb_pixel_total : 168810 time to create 1 rle with new method : 0.006669521331787109 length of segment : 571 time for calcul the mask position with numpy : 0.0017099380493164062 nb_pixel_total : 63291 time to create 1 rle with old method : 0.07262063026428223 length of segment : 329 time for calcul the mask position with numpy : 0.0031464099884033203 nb_pixel_total : 117744 time to create 1 rle with old method : 0.13394808769226074 length of segment : 349 time for calcul the mask position with numpy : 0.0030035972595214844 nb_pixel_total : 79343 time to create 1 rle with old method : 0.09066295623779297 length of segment : 258 time for calcul the mask position with numpy : 0.002494335174560547 nb_pixel_total : 61193 time to create 1 rle with old method : 0.06855964660644531 length of segment : 395 time for calcul the mask position with numpy : 0.0025587081909179688 nb_pixel_total : 111591 time to create 1 rle with old method : 0.12553834915161133 length of segment : 363 time for calcul the mask position with numpy : 0.004155874252319336 nb_pixel_total : 140830 time to create 1 rle with old method : 0.15703272819519043 length of segment : 624 time for calcul the mask position with numpy : 0.000583648681640625 nb_pixel_total : 11428 time to create 1 rle with old method : 0.013467788696289062 length of segment : 130 time for calcul the mask position with numpy : 0.0014774799346923828 nb_pixel_total : 58627 time to create 1 rle with old method : 0.0670478343963623 length of segment : 216 time for calcul the mask position with numpy : 0.0005114078521728516 nb_pixel_total : 23970 time to create 1 rle with old method : 0.02803206443786621 length of segment : 188 time for calcul the mask position with numpy : 0.009402036666870117 nb_pixel_total : 373667 time to create 1 rle with new method : 0.032301902770996094 length of segment : 827 time for calcul the mask position with numpy : 0.0013546943664550781 nb_pixel_total : 27301 time to create 1 rle with old method : 0.03069162368774414 length of segment : 363 time for calcul the mask position with numpy : 0.0011208057403564453 nb_pixel_total : 24224 time to create 1 rle with old method : 0.027299165725708008 length of segment : 173 time for calcul the mask position with numpy : 0.0028548240661621094 nb_pixel_total : 121581 time to create 1 rle with old method : 0.13834905624389648 length of segment : 613 time for calcul the mask position with numpy : 0.0003459453582763672 nb_pixel_total : 7209 time to create 1 rle with old method : 0.008398294448852539 length of segment : 126 time for calcul the mask position with numpy : 0.007286548614501953 nb_pixel_total : 187250 time to create 1 rle with new method : 0.01385188102722168 length of segment : 510 time for calcul the mask position with numpy : 0.0021216869354248047 nb_pixel_total : 53447 time to create 1 rle with old method : 0.06194162368774414 length of segment : 262 time for calcul the mask position with numpy : 0.0013713836669921875 nb_pixel_total : 26513 time to create 1 rle with old method : 0.030330896377563477 length of segment : 264 time for calcul the mask position with numpy : 0.001116037368774414 nb_pixel_total : 25925 time to create 1 rle with old method : 0.029717683792114258 length of segment : 222 time for calcul the mask position with numpy : 0.0007374286651611328 nb_pixel_total : 16782 time to create 1 rle with old method : 0.021824121475219727 length of segment : 156 time for calcul the mask position with numpy : 0.002277851104736328 nb_pixel_total : 45762 time to create 1 rle with old method : 0.052275896072387695 length of segment : 405 time for calcul the mask position with numpy : 0.0008301734924316406 nb_pixel_total : 17539 time to create 1 rle with old method : 0.019817352294921875 length of segment : 157 time for calcul the mask position with numpy : 0.0011630058288574219 nb_pixel_total : 27152 time to create 1 rle with old method : 0.03175663948059082 length of segment : 188 time for calcul the mask position with numpy : 0.0041351318359375 nb_pixel_total : 73832 time to create 1 rle with old method : 0.08723926544189453 length of segment : 351 time for calcul the mask position with numpy : 0.0012969970703125 nb_pixel_total : 35914 time to create 1 rle with old method : 0.0426638126373291 length of segment : 150 time for calcul the mask position with numpy : 0.0005166530609130859 nb_pixel_total : 12686 time to create 1 rle with old method : 0.01509714126586914 length of segment : 101 time for calcul the mask position with numpy : 0.0005421638488769531 nb_pixel_total : 11879 time to create 1 rle with old method : 0.014436960220336914 length of segment : 78 time for calcul the mask position with numpy : 0.0007047653198242188 nb_pixel_total : 6496 time to create 1 rle with old method : 0.00783395767211914 length of segment : 164 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 7603 time to create 1 rle with old method : 0.008752822875976562 length of segment : 102 time for calcul the mask position with numpy : 0.0013995170593261719 nb_pixel_total : 23504 time to create 1 rle with old method : 0.030123233795166016 length of segment : 182 time for calcul the mask position with numpy : 0.001360177993774414 nb_pixel_total : 28442 time to create 1 rle with old method : 0.0478672981262207 length of segment : 122 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 25356 time to create 1 rle with old method : 0.02926945686340332 length of segment : 195 time for calcul the mask position with numpy : 0.0018558502197265625 nb_pixel_total : 35580 time to create 1 rle with old method : 0.04008078575134277 length of segment : 262 time for calcul the mask position with numpy : 0.0004627704620361328 nb_pixel_total : 10025 time to create 1 rle with old method : 0.011425971984863281 length of segment : 106 time for calcul the mask position with numpy : 0.0012364387512207031 nb_pixel_total : 34182 time to create 1 rle with old method : 0.038823843002319336 length of segment : 227 time for calcul the mask position with numpy : 0.0004456043243408203 nb_pixel_total : 8833 time to create 1 rle with old method : 0.010064840316772461 length of segment : 96 time for calcul the mask position with numpy : 0.0008101463317871094 nb_pixel_total : 23051 time to create 1 rle with old method : 0.02692866325378418 length of segment : 130 time for calcul the mask position with numpy : 0.0010180473327636719 nb_pixel_total : 23052 time to create 1 rle with old method : 0.02646803855895996 length of segment : 293 time for calcul the mask position with numpy : 0.0011093616485595703 nb_pixel_total : 20887 time to create 1 rle with old method : 0.0243833065032959 length of segment : 217 time for calcul the mask position with numpy : 0.0025010108947753906 nb_pixel_total : 69098 time to create 1 rle with old method : 0.08114886283874512 length of segment : 332 time for calcul the mask position with numpy : 0.0008382797241210938 nb_pixel_total : 12305 time to create 1 rle with old method : 0.014076709747314453 length of segment : 203 time for calcul the mask position with numpy : 0.000583648681640625 nb_pixel_total : 11854 time to create 1 rle with old method : 0.013930320739746094 length of segment : 156 time for calcul the mask position with numpy : 0.001056671142578125 nb_pixel_total : 20653 time to create 1 rle with old method : 0.023563146591186523 length of segment : 346 time for calcul the mask position with numpy : 0.005382061004638672 nb_pixel_total : 83207 time to create 1 rle with old method : 0.09469342231750488 length of segment : 472 time for calcul the mask position with numpy : 0.001964092254638672 nb_pixel_total : 38233 time to create 1 rle with old method : 0.04767584800720215 length of segment : 330 time for calcul the mask position with numpy : 0.0008471012115478516 nb_pixel_total : 21303 time to create 1 rle with old method : 0.02469182014465332 length of segment : 202 time for calcul the mask position with numpy : 0.0017082691192626953 nb_pixel_total : 44481 time to create 1 rle with old method : 0.05121326446533203 length of segment : 172 time for calcul the mask position with numpy : 0.0004680156707763672 nb_pixel_total : 8179 time to create 1 rle with old method : 0.009884834289550781 length of segment : 115 time for calcul the mask position with numpy : 0.0003838539123535156 nb_pixel_total : 6024 time to create 1 rle with old method : 0.0072154998779296875 length of segment : 93 time for calcul the mask position with numpy : 0.0007512569427490234 nb_pixel_total : 14220 time to create 1 rle with old method : 0.016745328903198242 length of segment : 165 time for calcul the mask position with numpy : 0.0017223358154296875 nb_pixel_total : 39441 time to create 1 rle with old method : 0.04568982124328613 length of segment : 295 time for calcul the mask position with numpy : 0.0023534297943115234 nb_pixel_total : 50646 time to create 1 rle with old method : 0.059685707092285156 length of segment : 427 time for calcul the mask position with numpy : 0.0005376338958740234 nb_pixel_total : 12574 time to create 1 rle with old method : 0.01467275619506836 length of segment : 137 time for calcul the mask position with numpy : 0.0014641284942626953 nb_pixel_total : 46669 time to create 1 rle with old method : 0.0755150318145752 length of segment : 316 time for calcul the mask position with numpy : 0.0005967617034912109 nb_pixel_total : 25957 time to create 1 rle with old method : 0.030429363250732422 length of segment : 152 time for calcul the mask position with numpy : 0.0007987022399902344 nb_pixel_total : 33158 time to create 1 rle with old method : 0.03822517395019531 length of segment : 169 time for calcul the mask position with numpy : 0.0013005733489990234 nb_pixel_total : 37477 time to create 1 rle with old method : 0.042395591735839844 length of segment : 337 time for calcul the mask position with numpy : 0.0003478527069091797 nb_pixel_total : 10472 time to create 1 rle with old method : 0.01223611831665039 length of segment : 105 time for calcul the mask position with numpy : 0.0012431144714355469 nb_pixel_total : 39175 time to create 1 rle with old method : 0.04515814781188965 length of segment : 201 time for calcul the mask position with numpy : 0.0022339820861816406 nb_pixel_total : 83083 time to create 1 rle with old method : 0.0936884880065918 length of segment : 346 time for calcul the mask position with numpy : 0.0007488727569580078 nb_pixel_total : 19613 time to create 1 rle with old method : 0.022312164306640625 length of segment : 147 time for calcul the mask position with numpy : 0.0010678768157958984 nb_pixel_total : 22282 time to create 1 rle with old method : 0.02591085433959961 length of segment : 295 time for calcul the mask position with numpy : 0.0014247894287109375 nb_pixel_total : 27727 time to create 1 rle with old method : 0.03336286544799805 length of segment : 268 time for calcul the mask position with numpy : 0.0018639564514160156 nb_pixel_total : 52913 time to create 1 rle with old method : 0.06276893615722656 length of segment : 235 time for calcul the mask position with numpy : 0.0014417171478271484 nb_pixel_total : 38941 time to create 1 rle with old method : 0.044016361236572266 length of segment : 319 time for calcul the mask position with numpy : 0.002971172332763672 nb_pixel_total : 85743 time to create 1 rle with old method : 0.09709978103637695 length of segment : 399 time for calcul the mask position with numpy : 0.0010373592376708984 nb_pixel_total : 21393 time to create 1 rle with old method : 0.027582883834838867 length of segment : 184 time for calcul the mask position with numpy : 0.001975536346435547 nb_pixel_total : 43504 time to create 1 rle with old method : 0.04912686347961426 length of segment : 344 time for calcul the mask position with numpy : 0.0009799003601074219 nb_pixel_total : 23726 time to create 1 rle with old method : 0.02957630157470703 length of segment : 208 time for calcul the mask position with numpy : 0.0005178451538085938 nb_pixel_total : 15358 time to create 1 rle with old method : 0.017807483673095703 length of segment : 199 time for calcul the mask position with numpy : 0.0012102127075195312 nb_pixel_total : 27010 time to create 1 rle with old method : 0.03205251693725586 length of segment : 190 time for calcul the mask position with numpy : 0.0009398460388183594 nb_pixel_total : 41268 time to create 1 rle with old method : 0.04755353927612305 length of segment : 237 time for calcul the mask position with numpy : 0.0005002021789550781 nb_pixel_total : 15007 time to create 1 rle with old method : 0.020711898803710938 length of segment : 111 time for calcul the mask position with numpy : 0.0011334419250488281 nb_pixel_total : 34215 time to create 1 rle with old method : 0.040865182876586914 length of segment : 197 time for calcul the mask position with numpy : 0.0007202625274658203 nb_pixel_total : 15504 time to create 1 rle with old method : 0.019882917404174805 length of segment : 118 time for calcul the mask position with numpy : 0.0011830329895019531 nb_pixel_total : 20857 time to create 1 rle with old method : 0.02744460105895996 length of segment : 237 time for calcul the mask position with numpy : 0.0014688968658447266 nb_pixel_total : 33327 time to create 1 rle with old method : 0.03828716278076172 length of segment : 195 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 8990 time to create 1 rle with old method : 0.010484933853149414 length of segment : 108 time for calcul the mask position with numpy : 0.0010123252868652344 nb_pixel_total : 11771 time to create 1 rle with old method : 0.014043807983398438 length of segment : 236 time for calcul the mask position with numpy : 0.0001964569091796875 nb_pixel_total : 7690 time to create 1 rle with old method : 0.008820056915283203 length of segment : 136 time spent for convertir_results : 18.894442558288574 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 178 chid ids of type : 3594 Number RLEs to save : 53416 save missing photos in datou_result : time spend for datou_step_exec : 97.91949844360352 time spend to save output : 268.7266490459442 total time spend for step 1 : 366.64614748954773 step2:crop_condition Fri May 16 08:26:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 178 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 108 About to insert : list_path_to_insert length 108 new photo from crops ! About to upload 108 photos upload in portfolio : 3736932 init cache_photo without model_param we have 108 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747376830_2782182 we have uploaded 108 photos in the portfolio 3736932 time of upload the photos Elapsed time : 27.739700078964233 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747376865_2782182 we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.295208930969238 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747376873_2782182 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.190990686416626 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 3736932 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747376891_2782182 we have uploaded 45 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.02646517753601 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747376905_2782182 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9837291240692139 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747376908_2782182 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5979719161987305 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358841588, 1358841556, 1358841523, 1358841492, 1358841380, 1358841351, 1358841321, 1358840926, 1358840881, 1358840844, 1358840793] Looping around the photos to save general results len do output : 178 /1358859579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358859803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841588', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841556', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841523', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841492', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841380', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841351', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841321', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840926', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840881', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840844', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840793', None, None, None, None, None, '2874096') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 545 time used for this insertion : 0.32805728912353516 save_final save missing photos in datou_result : time spend for datou_step_exec : 111.07765293121338 time spend to save output : 0.4201993942260742 total time spend for step 2 : 111.49785232543945 step3:rle_unique_nms_with_priority Fri May 16 08:28:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 178 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 4.789563417434692 time for calcul the mask position with numpy : 0.41286396980285645 nb_pixel_total : 6726737 time to create 1 rle with new method : 0.7538917064666748 time for calcul the mask position with numpy : 0.0374448299407959 nb_pixel_total : 14279 time to create 1 rle with old method : 0.017657041549682617 time for calcul the mask position with numpy : 0.03747415542602539 nb_pixel_total : 33255 time to create 1 rle with old method : 0.037482261657714844 time for calcul the mask position with numpy : 0.034763336181640625 nb_pixel_total : 13892 time to create 1 rle with old method : 0.015743494033813477 time for calcul the mask position with numpy : 0.02966141700744629 nb_pixel_total : 12555 time to create 1 rle with old method : 0.013978004455566406 time for calcul the mask position with numpy : 0.020986318588256836 nb_pixel_total : 9699 time to create 1 rle with old method : 0.010592460632324219 time for calcul the mask position with numpy : 0.02188420295715332 nb_pixel_total : 42297 time to create 1 rle with old method : 0.04555463790893555 time for calcul the mask position with numpy : 0.02164602279663086 nb_pixel_total : 15993 time to create 1 rle with old method : 0.017812252044677734 time for calcul the mask position with numpy : 0.022260189056396484 nb_pixel_total : 61788 time to create 1 rle with old method : 0.07324361801147461 time for calcul the mask position with numpy : 0.0231935977935791 nb_pixel_total : 10211 time to create 1 rle with old method : 0.012458562850952148 time for calcul the mask position with numpy : 0.026874303817749023 nb_pixel_total : 19005 time to create 1 rle with old method : 0.021404266357421875 time for calcul the mask position with numpy : 0.02315998077392578 nb_pixel_total : 34214 time to create 1 rle with old method : 0.03888702392578125 time for calcul the mask position with numpy : 0.027213096618652344 nb_pixel_total : 28090 time to create 1 rle with old method : 0.03194379806518555 time for calcul the mask position with numpy : 0.030554771423339844 nb_pixel_total : 10900 time to create 1 rle with old method : 0.01244354248046875 time for calcul the mask position with numpy : 0.0348513126373291 nb_pixel_total : 17325 time to create 1 rle with old method : 0.02021956443786621 create new chi : 1.9618756771087646 time to delete rle : 0.02239537239074707 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 7648 TO DO : save crop sub photo not yet done ! save time : 32.43253207206726 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 4.166526556015015 time for calcul the mask position with numpy : 0.28411126136779785 nb_pixel_total : 6040654 time to create 1 rle with new method : 0.3814842700958252 time for calcul the mask position with numpy : 0.03818821907043457 nb_pixel_total : 119852 time to create 1 rle with old method : 0.14332342147827148 time for calcul the mask position with numpy : 0.03501462936401367 nb_pixel_total : 7235 time to create 1 rle with old method : 0.008200645446777344 time for calcul the mask position with numpy : 0.034551143646240234 nb_pixel_total : 35941 time to create 1 rle with old method : 0.040221214294433594 time for calcul the mask position with numpy : 0.03478574752807617 nb_pixel_total : 7472 time to create 1 rle with old method : 0.008447408676147461 time for calcul the mask position with numpy : 0.03322482109069824 nb_pixel_total : 85626 time to create 1 rle with old method : 0.10629582405090332 time for calcul the mask position with numpy : 0.02822279930114746 nb_pixel_total : 135632 time to create 1 rle with old method : 0.15390992164611816 time for calcul the mask position with numpy : 0.02348637580871582 nb_pixel_total : 78193 time to create 1 rle with old method : 0.08810138702392578 time for calcul the mask position with numpy : 0.021190404891967773 nb_pixel_total : 33687 time to create 1 rle with old method : 0.04122447967529297 time for calcul the mask position with numpy : 0.02279829978942871 nb_pixel_total : 39583 time to create 1 rle with old method : 0.044226646423339844 time for calcul the mask position with numpy : 0.022767066955566406 nb_pixel_total : 128297 time to create 1 rle with old method : 0.1425917148590088 time for calcul the mask position with numpy : 0.02171015739440918 nb_pixel_total : 34873 time to create 1 rle with old method : 0.039162397384643555 time for calcul the mask position with numpy : 0.02370166778564453 nb_pixel_total : 66428 time to create 1 rle with old method : 0.07934451103210449 time for calcul the mask position with numpy : 0.021562576293945312 nb_pixel_total : 28094 time to create 1 rle with old method : 0.039318084716796875 time for calcul the mask position with numpy : 0.027909040451049805 nb_pixel_total : 43336 time to create 1 rle with old method : 0.060907840728759766 time for calcul the mask position with numpy : 0.03620553016662598 nb_pixel_total : 78323 time to create 1 rle with old method : 0.08711981773376465 time for calcul the mask position with numpy : 0.03460836410522461 nb_pixel_total : 87014 time to create 1 rle with old method : 0.10002470016479492 create new chi : 2.3482918739318848 time to delete rle : 0.0017704963684082031 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 12014 TO DO : save crop sub photo not yet done ! save time : 60.126317501068115 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 10.704684019088745 time for calcul the mask position with numpy : 1.4063527584075928 nb_pixel_total : 5788533 time to create 1 rle with new method : 0.4571805000305176 time for calcul the mask position with numpy : 0.035318851470947266 nb_pixel_total : 11675 time to create 1 rle with old method : 0.040476322174072266 time for calcul the mask position with numpy : 0.03798699378967285 nb_pixel_total : 20324 time to create 1 rle with old method : 0.02453017234802246 time for calcul the mask position with numpy : 0.04126405715942383 nb_pixel_total : 19214 time to create 1 rle with old method : 0.021747112274169922 time for calcul the mask position with numpy : 0.039116859436035156 nb_pixel_total : 13947 time to create 1 rle with old method : 0.015768051147460938 time for calcul the mask position with numpy : 0.04426169395446777 nb_pixel_total : 93772 time to create 1 rle with old method : 0.10830092430114746 time for calcul the mask position with numpy : 0.03648972511291504 nb_pixel_total : 20586 time to create 1 rle with old method : 0.022905349731445312 time for calcul the mask position with numpy : 0.03528237342834473 nb_pixel_total : 78257 time to create 1 rle with old method : 0.08752942085266113 time for calcul the mask position with numpy : 0.03382372856140137 nb_pixel_total : 53653 time to create 1 rle with old method : 0.08694887161254883 time for calcul the mask position with numpy : 0.0788261890411377 nb_pixel_total : 25589 time to create 1 rle with old method : 0.030626535415649414 time for calcul the mask position with numpy : 0.03738808631896973 nb_pixel_total : 45686 time to create 1 rle with old method : 0.0520319938659668 time for calcul the mask position with numpy : 0.04212331771850586 nb_pixel_total : 128771 time to create 1 rle with old method : 0.19170022010803223 time for calcul the mask position with numpy : 0.04409289360046387 nb_pixel_total : 209119 time to create 1 rle with new method : 1.0039262771606445 time for calcul the mask position with numpy : 0.03427004814147949 nb_pixel_total : 74833 time to create 1 rle with old method : 0.08583378791809082 time for calcul the mask position with numpy : 0.034046173095703125 nb_pixel_total : 59977 time to create 1 rle with old method : 0.0878148078918457 time for calcul the mask position with numpy : 0.034906625747680664 nb_pixel_total : 133482 time to create 1 rle with old method : 0.15557122230529785 time for calcul the mask position with numpy : 0.03527712821960449 nb_pixel_total : 14538 time to create 1 rle with old method : 0.016203880310058594 time for calcul the mask position with numpy : 0.033228397369384766 nb_pixel_total : 57690 time to create 1 rle with old method : 0.06421709060668945 time for calcul the mask position with numpy : 0.03513765335083008 nb_pixel_total : 25972 time to create 1 rle with old method : 0.032862186431884766 time for calcul the mask position with numpy : 0.034128665924072266 nb_pixel_total : 72662 time to create 1 rle with old method : 0.08574056625366211 time for calcul the mask position with numpy : 0.03406524658203125 nb_pixel_total : 21153 time to create 1 rle with old method : 0.026748180389404297 time for calcul the mask position with numpy : 0.030914783477783203 nb_pixel_total : 80807 time to create 1 rle with old method : 0.0951390266418457 create new chi : 5.0789384841918945 time to delete rle : 0.00445866584777832 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 16800 TO DO : save crop sub photo not yet done ! save time : 66.92112469673157 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 6.799417972564697 time for calcul the mask position with numpy : 0.274003267288208 nb_pixel_total : 5732421 time to create 1 rle with new method : 0.3590233325958252 time for calcul the mask position with numpy : 0.023508548736572266 nb_pixel_total : 197456 time to create 1 rle with new method : 0.5217006206512451 time for calcul the mask position with numpy : 0.0241241455078125 nb_pixel_total : 11907 time to create 1 rle with old method : 0.017895221710205078 time for calcul the mask position with numpy : 0.024419307708740234 nb_pixel_total : 41500 time to create 1 rle with old method : 0.047022104263305664 time for calcul the mask position with numpy : 0.02492499351501465 nb_pixel_total : 30732 time to create 1 rle with old method : 0.04565000534057617 time for calcul the mask position with numpy : 0.023481369018554688 nb_pixel_total : 16561 time to create 1 rle with old method : 0.026767969131469727 time for calcul the mask position with numpy : 0.027009963989257812 nb_pixel_total : 419886 time to create 1 rle with new method : 0.35751914978027344 time for calcul the mask position with numpy : 0.021028995513916016 nb_pixel_total : 107761 time to create 1 rle with old method : 0.11704683303833008 time for calcul the mask position with numpy : 0.0207822322845459 nb_pixel_total : 23685 time to create 1 rle with old method : 0.026439189910888672 time for calcul the mask position with numpy : 0.026792287826538086 nb_pixel_total : 22402 time to create 1 rle with old method : 0.025597333908081055 time for calcul the mask position with numpy : 0.03427886962890625 nb_pixel_total : 20538 time to create 1 rle with old method : 0.022938013076782227 time for calcul the mask position with numpy : 0.03370809555053711 nb_pixel_total : 32393 time to create 1 rle with old method : 0.03562641143798828 time for calcul the mask position with numpy : 0.03377699851989746 nb_pixel_total : 14845 time to create 1 rle with old method : 0.016761302947998047 time for calcul the mask position with numpy : 0.03799009323120117 nb_pixel_total : 61241 time to create 1 rle with old method : 0.07510733604431152 time for calcul the mask position with numpy : 0.0453944206237793 nb_pixel_total : 150239 time to create 1 rle with new method : 0.4538722038269043 time for calcul the mask position with numpy : 0.03192853927612305 nb_pixel_total : 100757 time to create 1 rle with old method : 0.10922050476074219 time for calcul the mask position with numpy : 0.030333280563354492 nb_pixel_total : 16550 time to create 1 rle with old method : 0.018197059631347656 time for calcul the mask position with numpy : 0.028841018676757812 nb_pixel_total : 49366 time to create 1 rle with old method : 0.05383181571960449 create new chi : 3.2051966190338135 time to delete rle : 0.0020449161529541016 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 13439 TO DO : save crop sub photo not yet done ! save time : 52.94597554206848 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 5.8936686515808105 time for calcul the mask position with numpy : 0.7462062835693359 nb_pixel_total : 5205667 time to create 1 rle with new method : 0.7022807598114014 time for calcul the mask position with numpy : 0.021103620529174805 nb_pixel_total : 32651 time to create 1 rle with old method : 0.03493666648864746 time for calcul the mask position with numpy : 0.026226043701171875 nb_pixel_total : 242819 time to create 1 rle with new method : 0.797929048538208 time for calcul the mask position with numpy : 0.021617650985717773 nb_pixel_total : 106860 time to create 1 rle with old method : 0.11860108375549316 time for calcul the mask position with numpy : 0.026416778564453125 nb_pixel_total : 163973 time to create 1 rle with new method : 0.7340035438537598 time for calcul the mask position with numpy : 0.023058652877807617 nb_pixel_total : 182603 time to create 1 rle with new method : 0.868269681930542 time for calcul the mask position with numpy : 0.0216367244720459 nb_pixel_total : 24654 time to create 1 rle with old method : 0.027309894561767578 time for calcul the mask position with numpy : 0.021828413009643555 nb_pixel_total : 41899 time to create 1 rle with old method : 0.04893827438354492 time for calcul the mask position with numpy : 0.02213573455810547 nb_pixel_total : 37455 time to create 1 rle with old method : 0.04154157638549805 time for calcul the mask position with numpy : 0.022279024124145508 nb_pixel_total : 103810 time to create 1 rle with old method : 0.11300492286682129 time for calcul the mask position with numpy : 0.020677566528320312 nb_pixel_total : 99191 time to create 1 rle with old method : 0.1066446304321289 time for calcul the mask position with numpy : 0.02368330955505371 nb_pixel_total : 426859 time to create 1 rle with new method : 0.6741001605987549 time for calcul the mask position with numpy : 0.021172046661376953 nb_pixel_total : 20820 time to create 1 rle with old method : 0.0224459171295166 time for calcul the mask position with numpy : 0.021205663681030273 nb_pixel_total : 239999 time to create 1 rle with new method : 0.4500081539154053 time for calcul the mask position with numpy : 0.03657889366149902 nb_pixel_total : 120980 time to create 1 rle with old method : 0.13226962089538574 create new chi : 6.111526250839233 time to delete rle : 0.00185394287109375 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 13357 TO DO : save crop sub photo not yet done ! save time : 59.52381229400635 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 9.047302961349487 time for calcul the mask position with numpy : 0.7455153465270996 nb_pixel_total : 5395570 time to create 1 rle with new method : 1.0218732357025146 time for calcul the mask position with numpy : 0.03704500198364258 nb_pixel_total : 16257 time to create 1 rle with old method : 0.0186769962310791 time for calcul the mask position with numpy : 0.03579831123352051 nb_pixel_total : 44003 time to create 1 rle with old method : 0.050211429595947266 time for calcul the mask position with numpy : 0.023413896560668945 nb_pixel_total : 74216 time to create 1 rle with old method : 0.08212780952453613 time for calcul the mask position with numpy : 0.021589040756225586 nb_pixel_total : 42856 time to create 1 rle with old method : 0.04781699180603027 time for calcul the mask position with numpy : 0.022147417068481445 nb_pixel_total : 70548 time to create 1 rle with old method : 0.07898545265197754 time for calcul the mask position with numpy : 0.023519515991210938 nb_pixel_total : 42896 time to create 1 rle with old method : 0.0482335090637207 time for calcul the mask position with numpy : 0.022325754165649414 nb_pixel_total : 20016 time to create 1 rle with old method : 0.022375106811523438 time for calcul the mask position with numpy : 0.022548198699951172 nb_pixel_total : 82086 time to create 1 rle with old method : 0.10407447814941406 time for calcul the mask position with numpy : 0.022972583770751953 nb_pixel_total : 44233 time to create 1 rle with old method : 0.053734779357910156 time for calcul the mask position with numpy : 0.022943496704101562 nb_pixel_total : 471467 time to create 1 rle with new method : 0.8480169773101807 time for calcul the mask position with numpy : 0.02207040786743164 nb_pixel_total : 30198 time to create 1 rle with old method : 0.033455610275268555 time for calcul the mask position with numpy : 0.022069454193115234 nb_pixel_total : 193597 time to create 1 rle with new method : 0.8807837963104248 time for calcul the mask position with numpy : 0.025283098220825195 nb_pixel_total : 522297 time to create 1 rle with new method : 0.8969016075134277 create new chi : 5.37506365776062 time to delete rle : 0.0019664764404296875 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12176 TO DO : save crop sub photo not yet done ! save time : 54.698670625686646 nb_obj : 20 nb_hashtags : 4 time to prepare the origin masks : 8.674204349517822 time for calcul the mask position with numpy : 0.39983201026916504 nb_pixel_total : 5046350 time to create 1 rle with new method : 0.5706346035003662 time for calcul the mask position with numpy : 0.023085594177246094 nb_pixel_total : 53447 time to create 1 rle with old method : 0.06879758834838867 time for calcul the mask position with numpy : 0.025730133056640625 nb_pixel_total : 184344 time to create 1 rle with new method : 0.49719905853271484 time for calcul the mask position with numpy : 0.03927040100097656 nb_pixel_total : 7209 time to create 1 rle with old method : 0.00848841667175293 time for calcul the mask position with numpy : 0.03933548927307129 nb_pixel_total : 121581 time to create 1 rle with old method : 0.14309096336364746 time for calcul the mask position with numpy : 0.03953361511230469 nb_pixel_total : 24224 time to create 1 rle with old method : 0.03662991523742676 time for calcul the mask position with numpy : 0.04178047180175781 nb_pixel_total : 27301 time to create 1 rle with old method : 0.0345149040222168 time for calcul the mask position with numpy : 0.04244279861450195 nb_pixel_total : 373667 time to create 1 rle with new method : 0.43381690979003906 time for calcul the mask position with numpy : 0.03417658805847168 nb_pixel_total : 23970 time to create 1 rle with old method : 0.027285337448120117 time for calcul the mask position with numpy : 0.03617668151855469 nb_pixel_total : 58627 time to create 1 rle with old method : 0.06864118576049805 time for calcul the mask position with numpy : 0.03365945816040039 nb_pixel_total : 3037 time to create 1 rle with old method : 0.003337860107421875 time for calcul the mask position with numpy : 0.034689903259277344 nb_pixel_total : 140830 time to create 1 rle with old method : 0.16815972328186035 time for calcul the mask position with numpy : 0.025250673294067383 nb_pixel_total : 111591 time to create 1 rle with old method : 0.12778353691101074 time for calcul the mask position with numpy : 0.022552967071533203 nb_pixel_total : 61193 time to create 1 rle with old method : 0.06893348693847656 time for calcul the mask position with numpy : 0.032697200775146484 nb_pixel_total : 79343 time to create 1 rle with old method : 0.08698010444641113 time for calcul the mask position with numpy : 0.035332441329956055 nb_pixel_total : 117744 time to create 1 rle with old method : 0.12906455993652344 time for calcul the mask position with numpy : 0.0401759147644043 nb_pixel_total : 63291 time to create 1 rle with old method : 0.06938958168029785 time for calcul the mask position with numpy : 0.036084651947021484 nb_pixel_total : 168765 time to create 1 rle with new method : 0.46959996223449707 time for calcul the mask position with numpy : 0.03702354431152344 nb_pixel_total : 76146 time to create 1 rle with old method : 0.08399009704589844 time for calcul the mask position with numpy : 0.03428506851196289 nb_pixel_total : 90762 time to create 1 rle with old method : 0.12411141395568848 time for calcul the mask position with numpy : 0.037322282791137695 nb_pixel_total : 216818 time to create 1 rle with new method : 0.7888815402984619 create new chi : 5.23405122756958 time to delete rle : 0.005176544189453125 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 18051 TO DO : save crop sub photo not yet done ! save time : 86.94693636894226 nb_obj : 20 nb_hashtags : 5 time to prepare the origin masks : 8.453516721725464 time for calcul the mask position with numpy : 0.7324292659759521 nb_pixel_total : 6553184 time to create 1 rle with new method : 0.5216038227081299 time for calcul the mask position with numpy : 0.040116310119628906 nb_pixel_total : 23051 time to create 1 rle with old method : 0.027030467987060547 time for calcul the mask position with numpy : 0.03532910346984863 nb_pixel_total : 8833 time to create 1 rle with old method : 0.010018587112426758 time for calcul the mask position with numpy : 0.0361638069152832 nb_pixel_total : 34182 time to create 1 rle with old method : 0.04244279861450195 time for calcul the mask position with numpy : 0.03563666343688965 nb_pixel_total : 10025 time to create 1 rle with old method : 0.011550188064575195 time for calcul the mask position with numpy : 0.03828144073486328 nb_pixel_total : 35580 time to create 1 rle with old method : 0.04097890853881836 time for calcul the mask position with numpy : 0.0355074405670166 nb_pixel_total : 25356 time to create 1 rle with old method : 0.02855372428894043 time for calcul the mask position with numpy : 0.036565542221069336 nb_pixel_total : 28442 time to create 1 rle with old method : 0.037790775299072266 time for calcul the mask position with numpy : 0.03481888771057129 nb_pixel_total : 23504 time to create 1 rle with old method : 0.027691364288330078 time for calcul the mask position with numpy : 0.03849530220031738 nb_pixel_total : 7603 time to create 1 rle with old method : 0.3747541904449463 time for calcul the mask position with numpy : 0.0257110595703125 nb_pixel_total : 6496 time to create 1 rle with old method : 0.007814168930053711 time for calcul the mask position with numpy : 0.022189855575561523 nb_pixel_total : 11879 time to create 1 rle with old method : 0.013519763946533203 time for calcul the mask position with numpy : 0.023365020751953125 nb_pixel_total : 12686 time to create 1 rle with old method : 0.014510869979858398 time for calcul the mask position with numpy : 0.022617101669311523 nb_pixel_total : 35914 time to create 1 rle with old method : 0.040302276611328125 time for calcul the mask position with numpy : 0.027239561080932617 nb_pixel_total : 73832 time to create 1 rle with old method : 0.0852818489074707 time for calcul the mask position with numpy : 0.02290058135986328 nb_pixel_total : 27152 time to create 1 rle with old method : 0.030539751052856445 time for calcul the mask position with numpy : 0.021921873092651367 nb_pixel_total : 17539 time to create 1 rle with old method : 0.019953250885009766 time for calcul the mask position with numpy : 0.02196955680847168 nb_pixel_total : 45762 time to create 1 rle with old method : 0.05177950859069824 time for calcul the mask position with numpy : 0.021875619888305664 nb_pixel_total : 16782 time to create 1 rle with old method : 0.018916606903076172 time for calcul the mask position with numpy : 0.021628618240356445 nb_pixel_total : 25925 time to create 1 rle with old method : 0.02912592887878418 time for calcul the mask position with numpy : 0.021474599838256836 nb_pixel_total : 26513 time to create 1 rle with old method : 0.02971172332763672 create new chi : 2.827110528945923 time to delete rle : 0.0015153884887695312 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 9476 TO DO : save crop sub photo not yet done ! save time : 41.54132390022278 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 7.521921157836914 time for calcul the mask position with numpy : 0.6383745670318604 nb_pixel_total : 6574083 time to create 1 rle with new method : 1.2322947978973389 time for calcul the mask position with numpy : 0.040201663970947266 nb_pixel_total : 12574 time to create 1 rle with old method : 0.01439356803894043 time for calcul the mask position with numpy : 0.0374605655670166 nb_pixel_total : 50646 time to create 1 rle with old method : 0.0569605827331543 time for calcul the mask position with numpy : 0.0368654727935791 nb_pixel_total : 39441 time to create 1 rle with old method : 0.048925161361694336 time for calcul the mask position with numpy : 0.044189453125 nb_pixel_total : 14220 time to create 1 rle with old method : 0.019492626190185547 time for calcul the mask position with numpy : 0.02619647979736328 nb_pixel_total : 6024 time to create 1 rle with old method : 0.0072171688079833984 time for calcul the mask position with numpy : 0.02513718605041504 nb_pixel_total : 8179 time to create 1 rle with old method : 0.009348630905151367 time for calcul the mask position with numpy : 0.03539395332336426 nb_pixel_total : 44481 time to create 1 rle with old method : 0.07232332229614258 time for calcul the mask position with numpy : 0.03744029998779297 nb_pixel_total : 21303 time to create 1 rle with old method : 0.02408289909362793 time for calcul the mask position with numpy : 0.036171913146972656 nb_pixel_total : 38233 time to create 1 rle with old method : 0.04277157783508301 time for calcul the mask position with numpy : 0.03654336929321289 nb_pixel_total : 83207 time to create 1 rle with old method : 0.0934133529663086 time for calcul the mask position with numpy : 0.0367739200592041 nb_pixel_total : 20653 time to create 1 rle with old method : 0.023174047470092773 time for calcul the mask position with numpy : 0.04038262367248535 nb_pixel_total : 11854 time to create 1 rle with old method : 0.019560575485229492 time for calcul the mask position with numpy : 0.04241013526916504 nb_pixel_total : 12305 time to create 1 rle with old method : 0.017935752868652344 time for calcul the mask position with numpy : 0.03379535675048828 nb_pixel_total : 69098 time to create 1 rle with old method : 0.1041569709777832 time for calcul the mask position with numpy : 0.032726287841796875 nb_pixel_total : 20887 time to create 1 rle with old method : 0.023306846618652344 time for calcul the mask position with numpy : 0.028982877731323242 nb_pixel_total : 23052 time to create 1 rle with old method : 0.029782533645629883 create new chi : 3.0966320037841797 time to delete rle : 0.0016336441040039062 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10070 TO DO : save crop sub photo not yet done ! save time : 46.312193393707275 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 6.123286485671997 time for calcul the mask position with numpy : 1.003523349761963 nb_pixel_total : 6732354 time to create 1 rle with new method : 0.8277883529663086 time for calcul the mask position with numpy : 0.03529548645019531 nb_pixel_total : 22282 time to create 1 rle with old method : 0.0252687931060791 time for calcul the mask position with numpy : 0.03755760192871094 nb_pixel_total : 19613 time to create 1 rle with old method : 0.022112607955932617 time for calcul the mask position with numpy : 0.035236358642578125 nb_pixel_total : 83083 time to create 1 rle with old method : 0.09174323081970215 time for calcul the mask position with numpy : 0.03732705116271973 nb_pixel_total : 39175 time to create 1 rle with old method : 0.04847288131713867 time for calcul the mask position with numpy : 0.04424643516540527 nb_pixel_total : 10472 time to create 1 rle with old method : 0.013300180435180664 time for calcul the mask position with numpy : 0.0384366512298584 nb_pixel_total : 37477 time to create 1 rle with old method : 0.04324030876159668 time for calcul the mask position with numpy : 0.03344416618347168 nb_pixel_total : 33158 time to create 1 rle with old method : 0.03718161582946777 time for calcul the mask position with numpy : 0.021715164184570312 nb_pixel_total : 25957 time to create 1 rle with old method : 0.02961277961730957 time for calcul the mask position with numpy : 0.024756908416748047 nb_pixel_total : 46669 time to create 1 rle with old method : 0.055197715759277344 create new chi : 2.5492098331451416 time to delete rle : 0.001622915267944336 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6296 TO DO : save crop sub photo not yet done ! save time : 18.204877614974976 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 7.607558250427246 time for calcul the mask position with numpy : 0.5302162170410156 nb_pixel_total : 6527590 time to create 1 rle with new method : 0.57332444190979 time for calcul the mask position with numpy : 0.03346610069274902 nb_pixel_total : 5396 time to create 1 rle with old method : 0.00576329231262207 time for calcul the mask position with numpy : 0.034238338470458984 nb_pixel_total : 11771 time to create 1 rle with old method : 0.013148784637451172 time for calcul the mask position with numpy : 0.03432297706604004 nb_pixel_total : 8990 time to create 1 rle with old method : 0.01013636589050293 time for calcul the mask position with numpy : 0.037050724029541016 nb_pixel_total : 33327 time to create 1 rle with old method : 0.03751182556152344 time for calcul the mask position with numpy : 0.03683757781982422 nb_pixel_total : 20857 time to create 1 rle with old method : 0.023672819137573242 time for calcul the mask position with numpy : 0.03346967697143555 nb_pixel_total : 15504 time to create 1 rle with old method : 0.018997907638549805 time for calcul the mask position with numpy : 0.023398876190185547 nb_pixel_total : 34215 time to create 1 rle with old method : 0.03925943374633789 time for calcul the mask position with numpy : 0.031494140625 nb_pixel_total : 15007 time to create 1 rle with old method : 0.016889333724975586 time for calcul the mask position with numpy : 0.03505444526672363 nb_pixel_total : 41268 time to create 1 rle with old method : 0.15960049629211426 time for calcul the mask position with numpy : 0.03447079658508301 nb_pixel_total : 27010 time to create 1 rle with old method : 0.03186154365539551 time for calcul the mask position with numpy : 0.03650665283203125 nb_pixel_total : 15358 time to create 1 rle with old method : 0.016880035400390625 time for calcul the mask position with numpy : 0.034111738204956055 nb_pixel_total : 23726 time to create 1 rle with old method : 0.026719093322753906 time for calcul the mask position with numpy : 0.033457279205322266 nb_pixel_total : 43504 time to create 1 rle with old method : 0.049849748611450195 time for calcul the mask position with numpy : 0.0348057746887207 nb_pixel_total : 21393 time to create 1 rle with old method : 0.024054765701293945 time for calcul the mask position with numpy : 0.03318643569946289 nb_pixel_total : 85743 time to create 1 rle with old method : 0.10083127021789551 time for calcul the mask position with numpy : 0.034522294998168945 nb_pixel_total : 38941 time to create 1 rle with old method : 0.06683564186096191 time for calcul the mask position with numpy : 0.023936748504638672 nb_pixel_total : 52913 time to create 1 rle with old method : 0.07230687141418457 time for calcul the mask position with numpy : 0.026954174041748047 nb_pixel_total : 27727 time to create 1 rle with old method : 0.03671717643737793 create new chi : 2.484800338745117 time to delete rle : 0.0021321773529052734 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 9891 TO DO : save crop sub photo not yet done ! save time : 42.995747327804565 map_output_result : {1358841588: (0.0, 'Should be the crop_list due to order', 0), 1358841556: (0.0, 'Should be the crop_list due to order', 0), 1358841523: (0.0, 'Should be the crop_list due to order', 0), 1358841492: (0.0, 'Should be the crop_list due to order', 0), 1358841380: (0.0, 'Should be the crop_list due to order', 0), 1358841351: (0.0, 'Should be the crop_list due to order', 0), 1358841321: (0.0, 'Should be the crop_list due to order', 0), 1358840926: (0.0, 'Should be the crop_list due to order', 0), 1358840881: (0.0, 'Should be the crop_list due to order', 0), 1358840844: (0.0, 'Should be the crop_list due to order', 0), 1358840793: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358841588, 1358841556, 1358841523, 1358841492, 1358841380, 1358841351, 1358841321, 1358840926, 1358840881, 1358840844, 1358840793] Looping around the photos to save general results len do output : 11 /1358841588.Didn't retrieve data . /1358841556.Didn't retrieve data . /1358841523.Didn't retrieve data . /1358841492.Didn't retrieve data . /1358841380.Didn't retrieve data . /1358841351.Didn't retrieve data . /1358841321.Didn't retrieve data . /1358840926.Didn't retrieve data . /1358840881.Didn't retrieve data . /1358840844.Didn't retrieve data . /1358840793.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841588', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841556', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841523', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841492', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841380', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841351', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841321', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840926', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840881', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840844', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840793', None, None, None, None, None, '2874096') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.028590679168701172 save_final save missing photos in datou_result : time spend for datou_step_exec : 684.3149151802063 time spend to save output : 0.03105926513671875 total time spend for step 3 : 684.345974445343 step4:ventilate_hashtags_in_portfolio Fri May 16 08:39:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23051725 get user id for portfolio 23051725 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23051725 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','papier','metal','environnement','mal_croppe','pehd','background','autre','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23051725 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','papier','metal','environnement','mal_croppe','pehd','background','autre','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23051725 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','papier','metal','environnement','mal_croppe','pehd','background','autre','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23052963,23052965,23052966,23052967,23052968,23052969,23052970,23052971,23052972,23052973,23052974?tags=pet_fonce,flou,pet_clair,papier,metal,environnement,mal_croppe,pehd,background,autre,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358841588, 1358841556, 1358841523, 1358841492, 1358841380, 1358841351, 1358841321, 1358840926, 1358840881, 1358840844, 1358840793] Looping around the photos to save general results len do output : 1 /23051725. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841588', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841556', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841523', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841492', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841380', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841351', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841321', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840926', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840881', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840844', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840793', None, None, None, None, None, '2874096') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.1181492805480957 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.9738993644714355 time spend to save output : 0.11856865882873535 total time spend for step 4 : 3.092468023300171 step5:final Fri May 16 08:39:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358841588: ('0.14479838468426087',), 1358841556: ('0.14479838468426087',), 1358841523: ('0.14479838468426087',), 1358841492: ('0.14479838468426087',), 1358841380: ('0.14479838468426087',), 1358841351: ('0.14479838468426087',), 1358841321: ('0.14479838468426087',), 1358840926: ('0.14479838468426087',), 1358840881: ('0.14479838468426087',), 1358840844: ('0.14479838468426087',), 1358840793: ('0.14479838468426087',)} new output for save of step final : {1358841588: ('0.14479838468426087',), 1358841556: ('0.14479838468426087',), 1358841523: ('0.14479838468426087',), 1358841492: ('0.14479838468426087',), 1358841380: ('0.14479838468426087',), 1358841351: ('0.14479838468426087',), 1358841321: ('0.14479838468426087',), 1358840926: ('0.14479838468426087',), 1358840881: ('0.14479838468426087',), 1358840844: ('0.14479838468426087',), 1358840793: ('0.14479838468426087',)} [1358841588, 1358841556, 1358841523, 1358841492, 1358841380, 1358841351, 1358841321, 1358840926, 1358840881, 1358840844, 1358840793] Looping around the photos to save general results len do output : 11 /1358841588.Didn't retrieve data . /1358841556.Didn't retrieve data . /1358841523.Didn't retrieve data . /1358841492.Didn't retrieve data . /1358841380.Didn't retrieve data . /1358841351.Didn't retrieve data . /1358841321.Didn't retrieve data . /1358840926.Didn't retrieve data . /1358840881.Didn't retrieve data . /1358840844.Didn't retrieve data . /1358840793.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841588', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841556', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841523', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841492', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841380', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841351', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841321', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840926', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840881', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840844', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840793', None, None, None, None, None, '2874096') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.03983259201049805 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.21526050567626953 time spend to save output : 0.040566205978393555 total time spend for step 5 : 0.2558267116546631 step6:blur_detection Fri May 16 08:39:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65.jpg resize: (2160, 3264) 1358841588 -0.36028770910002655 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a.jpg resize: (2160, 3264) 1358841556 -0.2587542050257654 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5.jpg resize: (2160, 3264) 1358841523 -1.3186714591712467 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116.jpg resize: (2160, 3264) 1358841492 -0.9121608736216602 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2.jpg resize: (2160, 3264) 1358841380 0.9126375813314893 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c.jpg resize: (2160, 3264) 1358841351 -0.9431436489390618 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94.jpg resize: (2160, 3264) 1358841321 0.5727068350900059 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf.jpg resize: (2160, 3264) 1358840926 -3.421102239398691 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b.jpg resize: (2160, 3264) 1358840881 -2.604196098147227 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf.jpg resize: (2160, 3264) 1358840844 -2.8427088910151994 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265.jpg resize: (2160, 3264) 1358840793 -2.946513753277242 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142294_0.png resize: (371, 239) 1358859579 -1.0530089920653085 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142293_0.png resize: (134, 100) 1358859580 -1.030124453403387 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142290_0.png resize: (197, 207) 1358859581 -1.3557478162467078 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142291_0.png resize: (246, 234) 1358859582 -2.8263247311371043 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142300_0.png resize: (183, 240) 1358859583 -0.8749643629739531 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142292_0.png resize: (210, 135) 1358859584 -1.3270243523580925 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142298_0.png resize: (137, 126) 1358859585 -0.4427602935862182 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142299_0.png resize: (158, 157) 1358859586 -1.3400133396403713 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142295_0.png resize: (168, 118) 1358859587 0.7632148129060009 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142288_0.png resize: (129, 218) 1358859588 -0.865316080189744 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142296_0.png resize: (373, 173) 1358859589 -0.585347778394708 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142307_0.png resize: (295, 165) 1358859590 -1.350243644721875 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142306_0.png resize: (304, 332) 1358859591 -1.5028736582351936 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142304_0.png resize: (252, 237) 1358859592 -1.6828579310617406 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142303_0.png resize: (348, 327) 1358859593 -0.13282384870882474 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142302_0.png resize: (274, 550) 1358859594 0.5056462176561632 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142305_0.png resize: (147, 273) 1358859595 0.63462077561165 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142311_0.png resize: (324, 572) 1358859596 -0.7364778851729891 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142312_0.png resize: (446, 579) 1358859597 0.36985860164305895 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142314_0.png resize: (111, 103) 1358859598 0.1623013710152357 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142316_0.png resize: (104, 107) 1358859599 -0.9173134559166736 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142334_0.png resize: (511, 231) 1358859600 -0.9601287268307812 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142335_0.png resize: (175, 133) 1358859601 -1.8538079363802917 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142321_0.png resize: (366, 118) 1358859602 -1.9821493811277546 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142319_0.png resize: (146, 239) 1358859604 -1.3442750212459065 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142330_0.png resize: (131, 282) 1358859605 -2.0171191657268577 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142336_0.png resize: (150, 169) 1358859606 -0.9190476044934383 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142337_0.png resize: (202, 224) 1358859607 -3.1897396500816857 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142324_0.png resize: (478, 518) 1358859608 -2.010166947796121 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142318_0.png resize: (346, 359) 1358859609 -1.0420135921331621 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142333_0.png resize: (175, 165) 1358859610 -1.0034436196115326 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142320_0.png resize: (362, 386) 1358859611 -1.5586618351318582 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142323_0.png resize: (186, 141) 1358859612 -0.5279072679171724 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142329_0.png resize: (286, 313) 1358859613 1.8491883683786121 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142322_0.png resize: (235, 340) 1358859614 -0.5497638253239022 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142338_0.png resize: (155, 176) 1358859615 -1.331878230931413 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142332_0.png resize: (251, 481) 1358859616 -1.0338530241341823 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142328_0.png resize: (633, 368) 1358859617 -0.8080530204495927 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142341_0.png resize: (322, 408) 1358859618 -0.7079668135068314 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142355_0.png resize: (507, 452) 1358859619 0.04854963030872444 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142344_0.png resize: (104, 217) 1358859620 -0.4845218739308906 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142339_0.png resize: (308, 294) 1358859621 -1.558095203492034 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142345_0.png resize: (180, 291) 1358859622 -0.980951813165086 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142350_0.png resize: (826, 969) 1358859623 -1.8270620441932859 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142349_0.png resize: (431, 440) 1358859624 -0.8582902025452768 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142340_0.png resize: (209, 121) 1358859626 -0.06985688360419101 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142342_0.png resize: (599, 390) 1358859627 0.14218641812089702 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142354_0.png resize: (169, 81) 1358859628 -0.7438013044185959 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142353_0.png resize: (264, 202) 1358859629 -1.8644725548719019 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142356_0.png resize: (281, 698) 1358859630 -0.4943582955139629 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142364_0.png resize: (181, 185) 1358859631 -0.8494584595998398 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142358_0.png resize: (183, 162) 1358859632 -0.3288452780022915 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142362_0.png resize: (191, 240) 1358859633 -0.41219081428889337 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142365_0.png resize: (583, 448) 1358859634 -1.070354646854072 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142369_0.png resize: (197, 258) 1358859635 -0.6078842557543133 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142359_0.png resize: (861, 598) 1358859636 -0.22716636881117527 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142373_0.png resize: (610, 1029) 1358859637 -0.02692848986080462 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142377_0.png resize: (249, 391) 1358859638 -1.4611524441793058 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142372_0.png resize: (397, 199) 1358859639 -0.8318374302599469 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142375_0.png resize: (370, 295) 1358859640 -1.8335811074274904 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142399_0.png resize: (612, 293) 1358859641 -0.8118244081968707 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142385_0.png resize: (470, 263) 1358859642 -1.6841444992035337 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142401_0.png resize: (417, 668) 1358859643 -0.7870062387128504 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142386_0.png resize: (549, 390) 1358859644 0.033583316491607486 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142384_0.png resize: (467, 297) 1358859645 -0.535758969740581 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142402_0.png resize: (250, 332) 1358859646 -1.9495221339843694 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142396_0.png resize: (805, 656) 1358859647 -0.0428464608218097 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142387_0.png resize: (324, 269) 1358859648 0.7370189061289141 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142397_0.png resize: (356, 150) 1358859649 -1.5554775150732199 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142409_0.png resize: (301, 450) 1358859650 -1.978507936277197 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142406_0.png resize: (383, 172) 1358859651 -1.3760889992287049 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142410_0.png resize: (150, 343) 1358859652 -0.7237036276226374 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142411_0.png resize: (101, 177) 1358859653 -0.31771555081092806 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142408_0.png resize: (188, 230) 1358859654 -0.9212542891059939 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142404_0.png resize: (176, 245) 1358859655 0.24628123728807597 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142415_0.png resize: (174, 201) 1358859656 -0.8384049476501222 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142412_0.png resize: (76, 189) 1358859657 0.1200661807741657 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142413_0.png resize: (129, 148) 1358859658 -2.334901646045537 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142407_0.png resize: (157, 173) 1358859659 -2.1134474553095837 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142421_0.png resize: (95, 110) 1358859660 -1.3229264688390563 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142418_0.png resize: (262, 201) 1358859661 -1.9505025553775743 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142431_0.png resize: (148, 206) 1358859662 -1.1788278813636768 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142429_0.png resize: (467, 666) 1358859663 -0.9143250743625481 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142428_0.png resize: (343, 78) 1358859664 -1.2064102137706194 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142425_0.png resize: (332, 329) 1358859665 -1.1269458952696336 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142427_0.png resize: (155, 104) 1358859666 -0.5171603799705409 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142424_0.png resize: (206, 194) 1358859667 -1.0940516187275444 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142437_0.png resize: (328, 313) 1358859668 -1.7814128341909325 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142434_0.png resize: (93, 95) 1358859669 -0.46790407419068086 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142436_0.png resize: (295, 208) 1358859670 -0.41222726113785585 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142433_0.png resize: (83, 183) 1358859671 -1.9744507248812426 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142423_0.png resize: (233, 142) 1358859672 -2.2479550835373434 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142447_0.png resize: (286, 177) 1358859673 -2.2094008246298165 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142439_0.png resize: (263, 308) 1358859674 -1.2124602556154207 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142443_0.png resize: (105, 126) 1358859675 1.0841191284171816 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142444_0.png resize: (175, 314) 1358859676 -2.305425483073636 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142440_0.png resize: (150, 284) 1358859677 -1.593887473441004 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142449_0.png resize: (208, 396) 1358859678 -1.793493758291321 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142453_0.png resize: (287, 250) 1358859679 -2.213548094881845 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142459_0.png resize: (196, 266) 1358859680 -2.301768832297304 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142456_0.png resize: (183, 223) 1358859681 -1.9594079410620646 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142452_0.png resize: (176, 148) 1358859682 -0.7709058633608675 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142463_0.png resize: (108, 124) 1358859683 -2.721396805210365 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142460_0.png resize: (108, 221) 1358859684 -1.4108904965684896 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142454_0.png resize: (192, 174) 1358859685 -0.9219636144121975 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142461_0.png resize: (203, 264) 1358859686 -0.6529885315154089 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142465_0.png resize: (128, 84) 1358859687 1.3004681984518625 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142448_0.png resize: (268, 209) 1358859688 -1.3769528524562766 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142297_0.png resize: (104, 115) 1358859700 0.8820010366627591 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142315_0.png resize: (253, 213) 1358859701 -1.1227490982311188 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142310_0.png resize: (320, 172) 1358859702 -0.9531651676050577 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142326_0.png resize: (335, 334) 1358859703 -1.7129218385725813 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142370_0.png resize: (714, 922) 1358859704 -0.03948294382290376 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142379_0.png resize: (412, 351) 1358859705 -0.5422541675726784 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142376_0.png resize: (193, 185) 1358859707 -0.8831568057560617 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142374_0.png resize: (363, 229) 1358859708 -0.9320376130606328 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142392_0.png resize: (536, 434) 1358859709 -1.1323348595142873 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142395_0.png resize: (169, 199) 1358859710 -1.3128343038800043 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142393_0.png resize: (90, 183) 1358859711 -1.3699418031563178 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142390_0.png resize: (330, 404) 1358859712 -0.3750583479392799 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142394_0.png resize: (216, 386) 1358859713 -0.5783173718116856 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142417_0.png resize: (193, 220) 1358859714 -0.9779579590365077 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142403_0.png resize: (264, 150) 1358859715 -1.398694913458854 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142405_0.png resize: (151, 144) 1358859716 -0.7873734527098564 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142435_0.png resize: (148, 140) 1358859717 -2.1692915575041964 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142426_0.png resize: (202, 100) 1358859718 -1.0389462416303428 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142458_0.png resize: (110, 166) 1358859719 0.3885533736290058 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142301_0.png resize: (133, 141) 1358859724 -1.7106716936023376 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142419_0.png resize: (105, 111) 1358859725 -1.9219101950924522 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142420_0.png resize: (225, 188) 1358859726 -2.5721343213323573 treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142289_0.png resize: (132, 96) 1358859751 0.2978679271359215 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142309_0.png resize: (159, 305) 1358859752 -3.3756998263018785 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142308_0.png resize: (452, 419) 1358859753 -1.2568994045741906 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142317_0.png resize: (431, 411) 1358859755 -0.10776137518558618 treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142313_0.png resize: (402, 325) 1358859756 -1.1201221955561411 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142325_0.png resize: (331, 237) 1358859757 -1.2503170886462183 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142331_0.png resize: (276, 252) 1358859758 -1.919196851473819 treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142327_0.png resize: (649, 479) 1358859759 0.5277351666601123 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142348_0.png resize: (176, 181) 1358859760 -3.303928236058288 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142352_0.png resize: (216, 182) 1358859761 -1.0988377392124586 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142351_0.png resize: (222, 124) 1358859762 -1.9547562571138668 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142347_0.png resize: (213, 185) 1358859763 -1.7678160838366745 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142343_0.png resize: (354, 228) 1358859764 -1.1477355269397822 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142357_0.png resize: (380, 818) 1358859765 -0.6248641974093916 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142361_0.png resize: (391, 787) 1358859766 -1.060176943500693 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142368_0.png resize: (489, 831) 1358859767 -0.8061034410220862 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142360_0.png resize: (345, 456) 1358859768 -1.3735633842583401 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142366_0.png resize: (461, 475) 1358859769 -0.19171599204651354 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142363_0.png resize: (275, 266) 1358859770 -0.928824315375869 treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142367_0.png resize: (279, 550) 1358859771 -0.11949328980381205 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142371_0.png resize: (358, 971) 1358859772 -1.5125437988587158 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142381_0.png resize: (281, 231) 1358859773 -0.24424612344143284 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142378_0.png resize: (275, 340) 1358859774 -0.39060812873039297 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142380_0.png resize: (362, 578) 1358859775 -1.1604483707855906 treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142382_0.png resize: (164, 292) 1358859776 -2.0505151482397506 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142398_0.png resize: (168, 211) 1358859777 -0.8708344166885498 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142389_0.png resize: (241, 577) 1358859778 -2.1369102577631205 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142391_0.png resize: (316, 543) 1358859779 -1.5187606244808942 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142388_0.png resize: (349, 501) 1358859780 -1.3709356350790434 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142383_0.png resize: (764, 337) 1358859782 -0.7468316381561432 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142416_0.png resize: (116, 322) 1358859783 -3.134808693522793 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142422_0.png resize: (115, 251) 1358859784 -3.2028377492298574 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142438_0.png resize: (136, 122) 1358859785 -1.2019619310108682 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142432_0.png resize: (145, 401) 1358859786 -1.7205792971047489 treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142430_0.png resize: (316, 168) 1358859787 -2.3106554319024544 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142446_0.png resize: (147, 222) 1358859788 -2.183170708579926 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142441_0.png resize: (153, 277) 1358859789 -0.9132658388876554 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142445_0.png resize: (238, 511) 1358859790 -1.501108761795693 treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142442_0.png resize: (331, 167) 1358859791 -0.0035417827611194355 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142457_0.png resize: (232, 208) 1358859792 -3.8547335598221184 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142451_0.png resize: (337, 392) 1358859793 -2.5582918206278387 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142462_0.png resize: (182, 237) 1358859794 -3.1200411282277773 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142464_0.png resize: (148, 166) 1358859795 -2.263868733275366 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142455_0.png resize: (195, 97) 1358859796 -0.7640244200785518 treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142450_0.png resize: (309, 161) 1358859797 -2.265350486777815 treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142400_0.png resize: (126, 70) 1358859799 1.5237828232881576 treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142414_0.png resize: (102, 90) 1358859800 -0.8446273667863716 treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142346_0.png resize: (155, 161) 1358859803 0.371627434284237 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 189 time used for this insertion : 0.019373655319213867 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 189 time used for this insertion : 0.7926580905914307 save missing photos in datou_result : time spend for datou_step_exec : 45.383264780044556 time spend to save output : 0.8181815147399902 total time spend for step 6 : 46.201446294784546 step7:brightness Fri May 16 08:40:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65.jpg treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a.jpg treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5.jpg treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116.jpg treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2.jpg treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c.jpg treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94.jpg treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf.jpg treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b.jpg treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf.jpg treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265.jpg treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142294_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142293_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142290_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142291_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142300_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142292_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142298_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142299_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142295_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142288_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142296_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142307_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142306_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142304_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142303_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142302_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142305_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142311_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142312_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142314_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142316_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142334_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142335_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142321_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142319_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142330_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142336_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142337_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142324_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142318_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142333_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142320_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142323_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142329_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142322_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142338_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142332_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142328_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142341_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142355_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142344_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142339_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142345_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142350_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142349_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142340_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142342_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142354_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142353_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142356_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142364_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142358_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142362_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142365_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142369_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142359_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142373_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142377_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142372_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142375_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142399_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142385_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142401_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142386_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142384_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142402_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142396_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142387_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142397_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142409_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142406_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142410_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142411_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142408_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142404_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142415_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142412_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142413_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142407_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142421_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142418_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142431_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142429_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142428_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142425_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142427_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142424_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142437_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142434_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142436_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142433_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142423_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142447_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142439_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142443_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142444_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142440_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142449_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142453_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142459_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142456_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142452_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142463_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142460_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142454_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142461_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142465_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142448_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142297_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142315_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142310_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142326_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142370_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142379_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142376_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142374_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142392_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142395_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142393_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142390_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142394_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142417_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142403_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142405_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142435_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142426_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142458_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142301_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142419_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142420_0.png treat image : temp/1747376429_2782182_1358841588_2e73adbeb9be3cbf8ab282b787dbfb65_rle_crop_3801142289_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142309_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142308_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142317_0.png treat image : temp/1747376429_2782182_1358841556_30cb0c83c3e00c8c095bc50c88326f4a_rle_crop_3801142313_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142325_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142331_0.png treat image : temp/1747376429_2782182_1358841523_40f42ac5af3cd6f6252d045eb9c591f5_rle_crop_3801142327_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142348_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142352_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142351_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142347_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142343_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142357_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142361_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142368_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142360_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142366_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142363_0.png treat image : temp/1747376429_2782182_1358841380_3498ad36678c53e7ea04121a062c0ce2_rle_crop_3801142367_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142371_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142381_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142378_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142380_0.png treat image : temp/1747376429_2782182_1358841351_fc16387a3ee56541150c29a47df9fa1c_rle_crop_3801142382_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142398_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142389_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142391_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142388_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142383_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142416_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142422_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142438_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142432_0.png treat image : temp/1747376429_2782182_1358840881_a9a03700e1a8da888eb18f888b6b311b_rle_crop_3801142430_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142446_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142441_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142445_0.png treat image : temp/1747376429_2782182_1358840844_721c7276bfb83c9e94dbebef645d8abf_rle_crop_3801142442_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142457_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142451_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142462_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142464_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142455_0.png treat image : temp/1747376429_2782182_1358840793_7b164e764930b5d882436d3b8e6cf265_rle_crop_3801142450_0.png treat image : temp/1747376429_2782182_1358841321_72f64d9e959a2074255b0cfc7430cc94_rle_crop_3801142400_0.png treat image : temp/1747376429_2782182_1358840926_69143adaef8801df6479546fb6e3c3bf_rle_crop_3801142414_0.png treat image : temp/1747376429_2782182_1358841492_844e02e3ae9d384c38a0516287429116_rle_crop_3801142346_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 189 time used for this insertion : 0.04300570487976074 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 189 time used for this insertion : 0.664581298828125 save missing photos in datou_result : time spend for datou_step_exec : 12.248934507369995 time spend to save output : 0.7133629322052002 total time spend for step 7 : 12.962297439575195 step8:velours_tree Fri May 16 08:40:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 2.582355260848999 time spend to save output : 8.177757263183594e-05 total time spend for step 8 : 2.582437038421631 step9:send_mail_cod Fri May 16 08:40:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23051725_16-05-2025_08_40_58.pdf 23052963 change filename to text .imagette230529631747377658 23052965 imagette230529651747377658 23052966 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230529661747377658 23052967 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230529671747377660 23052968 change filename to text .change filename to text .change filename to text .imagette230529681747377661 23052970 imagette230529701747377662 23052971 imagette230529711747377662 23052972 imagette230529721747377662 23052973 change filename to text .change filename to text .imagette230529731747377662 23052974 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230529741747377662 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23051725 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23052963,23052965,23052966,23052967,23052968,23052969,23052970,23052971,23052972,23052973,23052974?tags=pet_fonce,flou,pet_clair,papier,metal,environnement,mal_croppe,pehd,background,autre,carton args[1358841588] : ((1358841588, -0.36028770910002655, 492688767), (1358841588, 0.20052709694464566, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358841556] : ((1358841556, -0.2587542050257654, 492688767), (1358841556, 0.16862968958057606, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358841523] : ((1358841523, -1.3186714591712467, 492688767), (1358841523, 0.1888159034011969, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358841492] : ((1358841492, -0.9121608736216602, 492688767), (1358841492, 0.11612367873669985, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358841380] : ((1358841380, 0.9126375813314893, 492688767), (1358841380, 0.027544752371360486, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358841351] : ((1358841351, -0.9431436489390618, 492688767), (1358841351, 0.46313623916970015, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358841321] : ((1358841321, 0.5727068350900059, 492688767), (1358841321, -0.0019189234551905993, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358840926] : ((1358840926, -3.421102239398691, 492609224), (1358840926, 0.26301459150102885, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358840881] : ((1358840881, -2.604196098147227, 492609224), (1358840881, 0.1427465767320506, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358840844] : ((1358840844, -2.8427088910151994, 492609224), (1358840844, 0.10288307727616892, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com args[1358840793] : ((1358840793, -2.946513753277242, 492609224), (1358840793, 0.0759516758085519, 2107752395), '0.14479838468426087') We are sending mail with results at report@fotonower.com refus_total : 0.14479838468426087 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23051725 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23051725_16-05-2025_08_40_58.pdf results_Auto_P23051725_16-05-2025_08_40_58.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23051725_16-05-2025_08_40_58.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23051725','results_Auto_P23051725_16-05-2025_08_40_58.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23051725_16-05-2025_08_40_58.pdf','pdf','','0.68','0.14479838468426087') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23051725

https://www.fotonower.com/image?json=false&list_photos_id=1358841588
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358841556
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358841523
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358841492
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358841380
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358841351
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358841321
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358840926
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358840881
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358840844
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358840793
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.48%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23052963?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23052966?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23052967?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23052968?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23052973?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23052974?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23051725_16-05-2025_08_40_58.pdf.

Lien vers velours :https://www.fotonower.com/velours/23052963,23052965,23052966,23052967,23052968,23052969,23052970,23052971,23052972,23052973,23052974?tags=pet_fonce,flou,pet_clair,papier,metal,environnement,mal_croppe,pehd,background,autre,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 16 May 2025 06:41:06 GMT Content-Length: 0 Connection: close X-Message-Id: vH9Ek8tQToiICORfpYQGjw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358841588, 1358841556, 1358841523, 1358841492, 1358841380, 1358841351, 1358841321, 1358840926, 1358840881, 1358840844, 1358840793] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841588', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841556', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841523', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841492', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841380', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841351', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841321', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840926', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840881', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840844', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840793', None, None, None, None, None, '2874096') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.07108712196350098 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.117667198181152 time spend to save output : 0.0716240406036377 total time spend for step 9 : 8.18929123878479 step10:split_time_score Fri May 16 08:41:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16052025 23051725 Nombre de photos uploadées : 11 / 23040 (0%) 16052025 23051725 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 16052025 23051725 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 6.198883056640625e-06 elapsed_time : order_list_meta_photo_and_scores 1.8358230590820312e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.002603292465209961 elapsed_time : insert_dashboard_record_day_entry 0.03236722946166992 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14479838468426087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23051725_16-05-2025_08_40_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23051725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23051725 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23051727 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358841588, 1358841556, 1358841523, 1358841492, 1358841380, 1358841351, 1358841321, 1358840926, 1358840881, 1358840844, 1358840793] Looping around the photos to save general results len do output : 1 /23051725Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841588', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841556', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841523', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841492', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841380', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841351', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358841321', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840926', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840881', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840844', None, None, None, None, None, '2874096') ('3318', None, None, None, None, None, None, None, '2874096') ('3318', '23051725', '1358840793', None, None, None, None, None, '2874096') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.03061389923095703 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1778943538665771 time spend to save output : 0.03090357780456543 total time spend for step 10 : 1.2087979316711426 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 181.92user 172.90system 20:42.88elapsed 28%CPU (0avgtext+0avgdata 4789484maxresident)k 1443328inputs+99392outputs (39156major+17203308minor)pagefaults 0swaps