python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 314713 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2864930'] with mtr_portfolio_ids : ['23018467'] and first list_photo_ids : [] new path : /proc/314713/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.2307920455932617 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 15 18:10:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4184 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-15 18:10:33.685598: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-15 18:10:33.715146: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-15 18:10:33.717830: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f243c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-15 18:10:33.717877: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-15 18:10:33.725166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-15 18:10:34.006287: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x15783d80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-15 18:10:34.006344: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-15 18:10:34.007822: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 18:10:34.008319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 18:10:34.015888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 18:10:34.020445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 18:10:34.022623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 18:10:34.032159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 18:10:34.035865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 18:10:34.062922: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 18:10:34.064260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 18:10:34.064341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 18:10:34.065060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-15 18:10:34.065080: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-15 18:10:34.065091: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-15 18:10:34.066936: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3732 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-15 18:10:34.454729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 18:10:34.454808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 18:10:34.454828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 18:10:34.454846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 18:10:34.454864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 18:10:34.454881: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 18:10:34.454912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 18:10:34.454934: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 18:10:34.456002: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 18:10:34.457042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 18:10:34.457080: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 18:10:34.457101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 18:10:34.457120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 18:10:34.457140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 18:10:34.457159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 18:10:34.457178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 18:10:34.457197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 18:10:34.458260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 18:10:34.458290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-15 18:10:34.458300: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-15 18:10:34.458310: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-15 18:10:34.459489: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3732 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-15 18:10:44.322279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 18:10:44.491626: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 18:10:46.459792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:46.461084: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.83G (3040542720 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.334844: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-05-15 18:10:47.398770: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.398874: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.400173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.400224: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.408274: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.408304: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.416449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.416472: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.417137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.417173: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.451958: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.452017: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.452030: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-15 18:10:47.452876: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.452896: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.453728: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.453747: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.462166: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.462211: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-15 18:10:47.463304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.464411: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.465496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.475392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.476509: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.501462: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.502597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.503704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.504789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.510360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.511457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.512543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.513620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.516219: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.526588: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.527697: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.537663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.538340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.539038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.539709: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.540387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-15 18:10:47.541054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.15G (3378380800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 Detection mask done ! Trying to reset tf kernel 315444 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2991 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4184 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001367330551147461 nb_pixel_total : 41215 time to create 1 rle with old method : 0.047481536865234375 length of segment : 304 time for calcul the mask position with numpy : 0.0009963512420654297 nb_pixel_total : 41904 time to create 1 rle with old method : 0.052289724349975586 length of segment : 260 time for calcul the mask position with numpy : 0.0008449554443359375 nb_pixel_total : 46198 time to create 1 rle with old method : 0.05255532264709473 length of segment : 199 time for calcul the mask position with numpy : 0.0004937648773193359 nb_pixel_total : 25311 time to create 1 rle with old method : 0.028912067413330078 length of segment : 170 time for calcul the mask position with numpy : 0.0005249977111816406 nb_pixel_total : 24469 time to create 1 rle with old method : 0.029331445693969727 length of segment : 227 time for calcul the mask position with numpy : 0.0013203620910644531 nb_pixel_total : 63569 time to create 1 rle with old method : 0.07512164115905762 length of segment : 361 time for calcul the mask position with numpy : 0.0018625259399414062 nb_pixel_total : 77620 time to create 1 rle with old method : 0.09314274787902832 length of segment : 394 time for calcul the mask position with numpy : 0.0014259815216064453 nb_pixel_total : 78755 time to create 1 rle with old method : 0.08956432342529297 length of segment : 372 time for calcul the mask position with numpy : 0.0004253387451171875 nb_pixel_total : 12580 time to create 1 rle with old method : 0.015929222106933594 length of segment : 163 time for calcul the mask position with numpy : 0.0013811588287353516 nb_pixel_total : 64069 time to create 1 rle with old method : 0.08773589134216309 length of segment : 340 time for calcul the mask position with numpy : 0.00030112266540527344 nb_pixel_total : 10313 time to create 1 rle with old method : 0.01213693618774414 length of segment : 123 time for calcul the mask position with numpy : 0.00018286705017089844 nb_pixel_total : 8448 time to create 1 rle with old method : 0.010206460952758789 length of segment : 108 time for calcul the mask position with numpy : 0.00046515464782714844 nb_pixel_total : 24033 time to create 1 rle with old method : 0.027657270431518555 length of segment : 172 time for calcul the mask position with numpy : 0.002366304397583008 nb_pixel_total : 93236 time to create 1 rle with old method : 0.10532474517822266 length of segment : 355 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 10650 time to create 1 rle with old method : 0.013522863388061523 length of segment : 118 time for calcul the mask position with numpy : 0.0032224655151367188 nb_pixel_total : 124938 time to create 1 rle with old method : 0.16480278968811035 length of segment : 351 time for calcul the mask position with numpy : 0.00037980079650878906 nb_pixel_total : 10870 time to create 1 rle with old method : 0.012760400772094727 length of segment : 134 time for calcul the mask position with numpy : 0.0015337467193603516 nb_pixel_total : 69512 time to create 1 rle with old method : 0.08620142936706543 length of segment : 403 time for calcul the mask position with numpy : 0.0009124279022216797 nb_pixel_total : 47675 time to create 1 rle with old method : 0.0541689395904541 length of segment : 279 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 23611 time to create 1 rle with old method : 0.028829574584960938 length of segment : 244 time for calcul the mask position with numpy : 0.0006208419799804688 nb_pixel_total : 26445 time to create 1 rle with old method : 0.03950953483581543 length of segment : 178 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 15038 time to create 1 rle with old method : 0.019347190856933594 length of segment : 137 time for calcul the mask position with numpy : 0.000247955322265625 nb_pixel_total : 12570 time to create 1 rle with old method : 0.015302181243896484 length of segment : 137 time for calcul the mask position with numpy : 0.0003941059112548828 nb_pixel_total : 22603 time to create 1 rle with old method : 0.026776790618896484 length of segment : 149 time for calcul the mask position with numpy : 0.0002014636993408203 nb_pixel_total : 7359 time to create 1 rle with old method : 0.008858680725097656 length of segment : 109 time for calcul the mask position with numpy : 0.0012564659118652344 nb_pixel_total : 74721 time to create 1 rle with old method : 0.09068918228149414 length of segment : 512 time for calcul the mask position with numpy : 0.003889799118041992 nb_pixel_total : 144849 time to create 1 rle with old method : 0.16382408142089844 length of segment : 576 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 4560 time to create 1 rle with old method : 0.005687236785888672 length of segment : 93 time for calcul the mask position with numpy : 0.0007874965667724609 nb_pixel_total : 43590 time to create 1 rle with old method : 0.051253318786621094 length of segment : 187 time for calcul the mask position with numpy : 0.0005824565887451172 nb_pixel_total : 19055 time to create 1 rle with old method : 0.024233579635620117 length of segment : 250 time for calcul the mask position with numpy : 0.002151966094970703 nb_pixel_total : 132382 time to create 1 rle with old method : 0.15064549446105957 length of segment : 347 time for calcul the mask position with numpy : 0.0002295970916748047 nb_pixel_total : 9709 time to create 1 rle with old method : 0.011557340621948242 length of segment : 124 time for calcul the mask position with numpy : 0.0005128383636474609 nb_pixel_total : 34853 time to create 1 rle with old method : 0.04131197929382324 length of segment : 213 time for calcul the mask position with numpy : 0.0006923675537109375 nb_pixel_total : 18185 time to create 1 rle with old method : 0.023355960845947266 length of segment : 238 time for calcul the mask position with numpy : 0.0014591217041015625 nb_pixel_total : 49996 time to create 1 rle with old method : 0.058209896087646484 length of segment : 370 time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 14914 time to create 1 rle with old method : 0.017507076263427734 length of segment : 170 time for calcul the mask position with numpy : 0.0003991127014160156 nb_pixel_total : 17890 time to create 1 rle with old method : 0.020891189575195312 length of segment : 166 time for calcul the mask position with numpy : 0.0002994537353515625 nb_pixel_total : 8270 time to create 1 rle with old method : 0.010028839111328125 length of segment : 175 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 16661 time to create 1 rle with old method : 0.01951885223388672 length of segment : 219 time for calcul the mask position with numpy : 0.0015320777893066406 nb_pixel_total : 60780 time to create 1 rle with old method : 0.06969976425170898 length of segment : 647 time for calcul the mask position with numpy : 0.0009016990661621094 nb_pixel_total : 44898 time to create 1 rle with old method : 0.05151677131652832 length of segment : 266 time for calcul the mask position with numpy : 0.0002181529998779297 nb_pixel_total : 7956 time to create 1 rle with old method : 0.009526252746582031 length of segment : 110 time for calcul the mask position with numpy : 0.0014102458953857422 nb_pixel_total : 61369 time to create 1 rle with old method : 0.07231020927429199 length of segment : 309 time for calcul the mask position with numpy : 0.0006389617919921875 nb_pixel_total : 24800 time to create 1 rle with old method : 0.028725624084472656 length of segment : 216 time for calcul the mask position with numpy : 0.0006010532379150391 nb_pixel_total : 11243 time to create 1 rle with old method : 0.013334512710571289 length of segment : 125 time for calcul the mask position with numpy : 0.006372213363647461 nb_pixel_total : 187617 time to create 1 rle with new method : 0.015934467315673828 length of segment : 664 time for calcul the mask position with numpy : 0.0004067420959472656 nb_pixel_total : 19457 time to create 1 rle with old method : 0.022807598114013672 length of segment : 105 time for calcul the mask position with numpy : 0.0003170967102050781 nb_pixel_total : 8930 time to create 1 rle with old method : 0.01075124740600586 length of segment : 124 time for calcul the mask position with numpy : 0.0002617835998535156 nb_pixel_total : 9812 time to create 1 rle with old method : 0.011651754379272461 length of segment : 142 time for calcul the mask position with numpy : 0.00032520294189453125 nb_pixel_total : 12727 time to create 1 rle with old method : 0.01514577865600586 length of segment : 97 time for calcul the mask position with numpy : 0.0016949176788330078 nb_pixel_total : 34567 time to create 1 rle with old method : 0.04113173484802246 length of segment : 203 time for calcul the mask position with numpy : 0.0013017654418945312 nb_pixel_total : 46777 time to create 1 rle with old method : 0.05360078811645508 length of segment : 300 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 6389 time to create 1 rle with old method : 0.007740974426269531 length of segment : 79 time for calcul the mask position with numpy : 0.020939111709594727 nb_pixel_total : 404799 time to create 1 rle with new method : 0.0421605110168457 length of segment : 715 time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 5502 time to create 1 rle with old method : 0.006493091583251953 length of segment : 82 time for calcul the mask position with numpy : 0.0016782283782958984 nb_pixel_total : 54960 time to create 1 rle with old method : 0.06318116188049316 length of segment : 221 time for calcul the mask position with numpy : 0.0020508766174316406 nb_pixel_total : 39357 time to create 1 rle with old method : 0.04564189910888672 length of segment : 250 time for calcul the mask position with numpy : 0.00391387939453125 nb_pixel_total : 60205 time to create 1 rle with old method : 0.06736922264099121 length of segment : 728 time for calcul the mask position with numpy : 0.0020024776458740234 nb_pixel_total : 79159 time to create 1 rle with old method : 0.09017825126647949 length of segment : 314 time for calcul the mask position with numpy : 0.002597808837890625 nb_pixel_total : 61219 time to create 1 rle with old method : 0.07218289375305176 length of segment : 196 time for calcul the mask position with numpy : 0.0010688304901123047 nb_pixel_total : 21573 time to create 1 rle with old method : 0.025329113006591797 length of segment : 147 time for calcul the mask position with numpy : 0.0010137557983398438 nb_pixel_total : 20420 time to create 1 rle with old method : 0.02370285987854004 length of segment : 152 time for calcul the mask position with numpy : 0.00436711311340332 nb_pixel_total : 125141 time to create 1 rle with old method : 0.14321017265319824 length of segment : 382 time for calcul the mask position with numpy : 0.0008614063262939453 nb_pixel_total : 20294 time to create 1 rle with old method : 0.023846149444580078 length of segment : 164 time for calcul the mask position with numpy : 0.0010561943054199219 nb_pixel_total : 17772 time to create 1 rle with old method : 0.02995586395263672 length of segment : 153 time for calcul the mask position with numpy : 0.0009660720825195312 nb_pixel_total : 19728 time to create 1 rle with old method : 0.03538012504577637 length of segment : 144 time for calcul the mask position with numpy : 0.0011873245239257812 nb_pixel_total : 16153 time to create 1 rle with old method : 0.02805614471435547 length of segment : 151 time for calcul the mask position with numpy : 0.0010063648223876953 nb_pixel_total : 29348 time to create 1 rle with old method : 0.03428530693054199 length of segment : 181 time for calcul the mask position with numpy : 0.002106904983520508 nb_pixel_total : 38053 time to create 1 rle with old method : 0.04437398910522461 length of segment : 340 time for calcul the mask position with numpy : 0.003184795379638672 nb_pixel_total : 78125 time to create 1 rle with old method : 0.08901143074035645 length of segment : 317 time for calcul the mask position with numpy : 0.0008640289306640625 nb_pixel_total : 14510 time to create 1 rle with old method : 0.017167091369628906 length of segment : 164 time for calcul the mask position with numpy : 0.0004203319549560547 nb_pixel_total : 6043 time to create 1 rle with old method : 0.007302761077880859 length of segment : 107 time for calcul the mask position with numpy : 0.0003924369812011719 nb_pixel_total : 7368 time to create 1 rle with old method : 0.009107351303100586 length of segment : 85 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 6257 time to create 1 rle with old method : 0.007527351379394531 length of segment : 97 time for calcul the mask position with numpy : 0.0007386207580566406 nb_pixel_total : 25349 time to create 1 rle with old method : 0.029371976852416992 length of segment : 189 time for calcul the mask position with numpy : 0.0004012584686279297 nb_pixel_total : 6413 time to create 1 rle with old method : 0.011073112487792969 length of segment : 103 time for calcul the mask position with numpy : 0.0003476142883300781 nb_pixel_total : 11129 time to create 1 rle with old method : 0.019016027450561523 length of segment : 149 time for calcul the mask position with numpy : 0.0020568370819091797 nb_pixel_total : 34853 time to create 1 rle with old method : 0.039502620697021484 length of segment : 469 time for calcul the mask position with numpy : 0.0025870800018310547 nb_pixel_total : 62882 time to create 1 rle with old method : 0.07193493843078613 length of segment : 274 time for calcul the mask position with numpy : 0.003923654556274414 nb_pixel_total : 107665 time to create 1 rle with old method : 0.12103915214538574 length of segment : 467 time for calcul the mask position with numpy : 0.0020787715911865234 nb_pixel_total : 67736 time to create 1 rle with old method : 0.07703924179077148 length of segment : 277 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 3844 time to create 1 rle with old method : 0.00480198860168457 length of segment : 60 time for calcul the mask position with numpy : 0.00032901763916015625 nb_pixel_total : 14937 time to create 1 rle with old method : 0.018332242965698242 length of segment : 182 time for calcul the mask position with numpy : 0.0016434192657470703 nb_pixel_total : 37366 time to create 1 rle with old method : 0.04423117637634277 length of segment : 256 time for calcul the mask position with numpy : 0.0009613037109375 nb_pixel_total : 21488 time to create 1 rle with old method : 0.02477574348449707 length of segment : 234 time for calcul the mask position with numpy : 0.0009295940399169922 nb_pixel_total : 19415 time to create 1 rle with old method : 0.023639440536499023 length of segment : 136 time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 27833 time to create 1 rle with old method : 0.03250479698181152 length of segment : 185 time for calcul the mask position with numpy : 0.0007238388061523438 nb_pixel_total : 19392 time to create 1 rle with old method : 0.026093006134033203 length of segment : 141 time for calcul the mask position with numpy : 0.003698110580444336 nb_pixel_total : 90720 time to create 1 rle with old method : 0.10250735282897949 length of segment : 596 time for calcul the mask position with numpy : 0.0022661685943603516 nb_pixel_total : 67226 time to create 1 rle with old method : 0.07876110076904297 length of segment : 469 time for calcul the mask position with numpy : 0.0007560253143310547 nb_pixel_total : 15007 time to create 1 rle with old method : 0.026684045791625977 length of segment : 95 time for calcul the mask position with numpy : 0.0005428791046142578 nb_pixel_total : 12709 time to create 1 rle with old method : 0.02092576026916504 length of segment : 110 time for calcul the mask position with numpy : 0.008792400360107422 nb_pixel_total : 182229 time to create 1 rle with new method : 0.012317657470703125 length of segment : 484 time for calcul the mask position with numpy : 0.0012731552124023438 nb_pixel_total : 22314 time to create 1 rle with old method : 0.03672671318054199 length of segment : 239 time for calcul the mask position with numpy : 0.002283811569213867 nb_pixel_total : 52145 time to create 1 rle with old method : 0.05925869941711426 length of segment : 445 time for calcul the mask position with numpy : 0.0015735626220703125 nb_pixel_total : 73430 time to create 1 rle with old method : 0.08446621894836426 length of segment : 452 time for calcul the mask position with numpy : 0.0009260177612304688 nb_pixel_total : 27166 time to create 1 rle with old method : 0.03209733963012695 length of segment : 142 time for calcul the mask position with numpy : 0.002054452896118164 nb_pixel_total : 35218 time to create 1 rle with old method : 0.04106926918029785 length of segment : 338 time for calcul the mask position with numpy : 0.004354000091552734 nb_pixel_total : 124838 time to create 1 rle with old method : 0.1491103172302246 length of segment : 543 time for calcul the mask position with numpy : 0.0032672882080078125 nb_pixel_total : 108805 time to create 1 rle with old method : 0.12240767478942871 length of segment : 601 time for calcul the mask position with numpy : 0.0008823871612548828 nb_pixel_total : 26778 time to create 1 rle with old method : 0.0317232608795166 length of segment : 129 time for calcul the mask position with numpy : 0.0023915767669677734 nb_pixel_total : 62623 time to create 1 rle with old method : 0.07158541679382324 length of segment : 377 time for calcul the mask position with numpy : 0.0004870891571044922 nb_pixel_total : 11071 time to create 1 rle with old method : 0.012968301773071289 length of segment : 153 time for calcul the mask position with numpy : 0.0012900829315185547 nb_pixel_total : 33469 time to create 1 rle with old method : 0.03968691825866699 length of segment : 180 time for calcul the mask position with numpy : 0.0009980201721191406 nb_pixel_total : 10718 time to create 1 rle with old method : 0.013367414474487305 length of segment : 257 time for calcul the mask position with numpy : 0.0010848045349121094 nb_pixel_total : 34015 time to create 1 rle with old method : 0.043230533599853516 length of segment : 137 time for calcul the mask position with numpy : 0.0012137889862060547 nb_pixel_total : 16116 time to create 1 rle with old method : 0.019259929656982422 length of segment : 249 time for calcul the mask position with numpy : 0.00031876564025878906 nb_pixel_total : 10358 time to create 1 rle with old method : 0.013048648834228516 length of segment : 98 time for calcul the mask position with numpy : 0.0016825199127197266 nb_pixel_total : 48161 time to create 1 rle with old method : 0.06052899360656738 length of segment : 269 time for calcul the mask position with numpy : 0.0014617443084716797 nb_pixel_total : 42598 time to create 1 rle with old method : 0.048619985580444336 length of segment : 283 time for calcul the mask position with numpy : 0.0015687942504882812 nb_pixel_total : 30269 time to create 1 rle with old method : 0.03496861457824707 length of segment : 299 time for calcul the mask position with numpy : 0.002324819564819336 nb_pixel_total : 48615 time to create 1 rle with old method : 0.05633735656738281 length of segment : 508 time for calcul the mask position with numpy : 0.005007266998291016 nb_pixel_total : 151825 time to create 1 rle with new method : 0.008524894714355469 length of segment : 584 time for calcul the mask position with numpy : 0.004773855209350586 nb_pixel_total : 116954 time to create 1 rle with old method : 0.1609969139099121 length of segment : 609 time for calcul the mask position with numpy : 0.0006871223449707031 nb_pixel_total : 13011 time to create 1 rle with old method : 0.01532125473022461 length of segment : 125 time for calcul the mask position with numpy : 0.0006814002990722656 nb_pixel_total : 17506 time to create 1 rle with old method : 0.020960092544555664 length of segment : 181 time for calcul the mask position with numpy : 0.0006313323974609375 nb_pixel_total : 22245 time to create 1 rle with old method : 0.03133749961853027 length of segment : 186 time for calcul the mask position with numpy : 0.0016078948974609375 nb_pixel_total : 56711 time to create 1 rle with old method : 0.06501936912536621 length of segment : 388 time spent for convertir_results : 9.903242349624634 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 118 chid ids of type : 3594 Number RLEs to save : 30552 save missing photos in datou_result : time spend for datou_step_exec : 72.80880832672119 time spend to save output : 1.8753547668457031 total time spend for step 1 : 74.6841630935669 step2:crop_condition Thu May 15 18:11:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 118 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 92 About to insert : list_path_to_insert length 92 new photo from crops ! About to upload 92 photos upload in portfolio : 3736932 init cache_photo without model_param we have 92 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747325524_314713 we have uploaded 92 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.455361366271973 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747325549_314713 we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3362114429473877 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747325558_314713 we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.1317005157470703 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747325563_314713 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6651802062988281 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747325566_314713 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.188581943511963 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358563015, 1358563012, 1358563010, 1358563002, 1358562869, 1358562822] Looping around the photos to save general results len do output : 118 /1358582338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358582828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563015', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563012', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563010', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563002', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562869', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562822', None, None, None, None, None, '2864930') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 360 time used for this insertion : 0.025720596313476562 save_final save missing photos in datou_result : time spend for datou_step_exec : 63.3347704410553 time spend to save output : 0.03046393394470215 total time spend for step 2 : 63.365234375 step3:rle_unique_nms_with_priority Thu May 15 18:12:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 118 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 21.791483640670776 time for calcul the mask position with numpy : 0.9462838172912598 nb_pixel_total : 7395430 time to create 1 rle with new method : 0.689530611038208 time for calcul the mask position with numpy : 0.042607784271240234 nb_pixel_total : 23611 time to create 1 rle with old method : 0.02760791778564453 time for calcul the mask position with numpy : 0.0276181697845459 nb_pixel_total : 47675 time to create 1 rle with old method : 0.06198596954345703 time for calcul the mask position with numpy : 0.02743053436279297 nb_pixel_total : 69512 time to create 1 rle with old method : 0.08399057388305664 time for calcul the mask position with numpy : 0.03888559341430664 nb_pixel_total : 10864 time to create 1 rle with old method : 0.012194395065307617 time for calcul the mask position with numpy : 0.041837215423583984 nb_pixel_total : 124938 time to create 1 rle with old method : 0.15061497688293457 time for calcul the mask position with numpy : 0.05502438545227051 nb_pixel_total : 10650 time to create 1 rle with old method : 0.019803285598754883 time for calcul the mask position with numpy : 0.05707693099975586 nb_pixel_total : 93236 time to create 1 rle with old method : 0.10404729843139648 time for calcul the mask position with numpy : 0.04107546806335449 nb_pixel_total : 24033 time to create 1 rle with old method : 0.027112245559692383 time for calcul the mask position with numpy : 0.0399930477142334 nb_pixel_total : 8448 time to create 1 rle with old method : 0.009212732315063477 time for calcul the mask position with numpy : 0.04053950309753418 nb_pixel_total : 10313 time to create 1 rle with old method : 0.01171565055847168 time for calcul the mask position with numpy : 0.04072070121765137 nb_pixel_total : 64069 time to create 1 rle with old method : 0.0816493034362793 time for calcul the mask position with numpy : 0.04424262046813965 nb_pixel_total : 12580 time to create 1 rle with old method : 0.016979455947875977 time for calcul the mask position with numpy : 0.02506089210510254 nb_pixel_total : 78755 time to create 1 rle with old method : 0.08807134628295898 time for calcul the mask position with numpy : 0.025525331497192383 nb_pixel_total : 77620 time to create 1 rle with old method : 0.08509421348571777 time for calcul the mask position with numpy : 0.024710655212402344 nb_pixel_total : 63569 time to create 1 rle with old method : 0.0695793628692627 time for calcul the mask position with numpy : 0.02530384063720703 nb_pixel_total : 24469 time to create 1 rle with old method : 0.02800750732421875 time for calcul the mask position with numpy : 0.026507139205932617 nb_pixel_total : 25311 time to create 1 rle with old method : 0.028403282165527344 time for calcul the mask position with numpy : 0.024900197982788086 nb_pixel_total : 46198 time to create 1 rle with old method : 0.05070996284484863 time for calcul the mask position with numpy : 0.02481985092163086 nb_pixel_total : 41904 time to create 1 rle with old method : 0.046927690505981445 time for calcul the mask position with numpy : 0.025937557220458984 nb_pixel_total : 41215 time to create 1 rle with old method : 0.04502725601196289 create new chi : 3.427987575531006 time to delete rle : 0.022646665573120117 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 12298 TO DO : save crop sub photo not yet done ! save time : 0.7836740016937256 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 19.002527236938477 time for calcul the mask position with numpy : 0.9844915866851807 nb_pixel_total : 7507856 time to create 1 rle with new method : 1.7108778953552246 time for calcul the mask position with numpy : 0.03509211540222168 nb_pixel_total : 7956 time to create 1 rle with old method : 0.008894920349121094 time for calcul the mask position with numpy : 0.023667573928833008 nb_pixel_total : 44898 time to create 1 rle with old method : 0.04854154586791992 time for calcul the mask position with numpy : 0.024527311325073242 nb_pixel_total : 60780 time to create 1 rle with old method : 0.06661725044250488 time for calcul the mask position with numpy : 0.024261474609375 nb_pixel_total : 16239 time to create 1 rle with old method : 0.018061161041259766 time for calcul the mask position with numpy : 0.024491071701049805 nb_pixel_total : 8270 time to create 1 rle with old method : 0.009052515029907227 time for calcul the mask position with numpy : 0.02425074577331543 nb_pixel_total : 17890 time to create 1 rle with old method : 0.019939661026000977 time for calcul the mask position with numpy : 0.024951457977294922 nb_pixel_total : 14914 time to create 1 rle with old method : 0.01697993278503418 time for calcul the mask position with numpy : 0.024953126907348633 nb_pixel_total : 49996 time to create 1 rle with old method : 0.056378841400146484 time for calcul the mask position with numpy : 0.025336742401123047 nb_pixel_total : 18185 time to create 1 rle with old method : 0.020298004150390625 time for calcul the mask position with numpy : 0.02445507049560547 nb_pixel_total : 34853 time to create 1 rle with old method : 0.03791046142578125 time for calcul the mask position with numpy : 0.024298429489135742 nb_pixel_total : 9709 time to create 1 rle with old method : 0.01050710678100586 time for calcul the mask position with numpy : 0.025763750076293945 nb_pixel_total : 132382 time to create 1 rle with old method : 0.14642024040222168 time for calcul the mask position with numpy : 0.027868986129760742 nb_pixel_total : 19055 time to create 1 rle with old method : 0.021524667739868164 time for calcul the mask position with numpy : 0.025050878524780273 nb_pixel_total : 43590 time to create 1 rle with old method : 0.048964500427246094 time for calcul the mask position with numpy : 0.025561809539794922 nb_pixel_total : 4308 time to create 1 rle with old method : 0.0050601959228515625 time for calcul the mask position with numpy : 0.027663469314575195 nb_pixel_total : 144849 time to create 1 rle with old method : 0.1629185676574707 time for calcul the mask position with numpy : 0.024680614471435547 nb_pixel_total : 74721 time to create 1 rle with old method : 0.08746337890625 time for calcul the mask position with numpy : 0.02574753761291504 nb_pixel_total : 7359 time to create 1 rle with old method : 0.008313179016113281 time for calcul the mask position with numpy : 0.02622246742248535 nb_pixel_total : 22537 time to create 1 rle with old method : 0.02520155906677246 time for calcul the mask position with numpy : 0.026259183883666992 nb_pixel_total : 12570 time to create 1 rle with old method : 0.01639842987060547 time for calcul the mask position with numpy : 0.025008201599121094 nb_pixel_total : 15038 time to create 1 rle with old method : 0.01750779151916504 time for calcul the mask position with numpy : 0.027903079986572266 nb_pixel_total : 26445 time to create 1 rle with old method : 0.030069828033447266 create new chi : 4.191439151763916 time to delete rle : 0.00177764892578125 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 12754 TO DO : save crop sub photo not yet done ! save time : 0.8619215488433838 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 22.901642322540283 time for calcul the mask position with numpy : 1.12404203414917 nb_pixel_total : 7186376 time to create 1 rle with new method : 1.5606846809387207 time for calcul the mask position with numpy : 0.029226303100585938 nb_pixel_total : 61219 time to create 1 rle with old method : 0.06914782524108887 time for calcul the mask position with numpy : 0.025263547897338867 nb_pixel_total : 58294 time to create 1 rle with old method : 0.06661701202392578 time for calcul the mask position with numpy : 0.02553105354309082 nb_pixel_total : 60205 time to create 1 rle with old method : 0.06981778144836426 time for calcul the mask position with numpy : 0.026044845581054688 nb_pixel_total : 39357 time to create 1 rle with old method : 0.04460549354553223 time for calcul the mask position with numpy : 0.02503490447998047 nb_pixel_total : 54960 time to create 1 rle with old method : 0.07545328140258789 time for calcul the mask position with numpy : 0.02946925163269043 nb_pixel_total : 5502 time to create 1 rle with old method : 0.009198188781738281 time for calcul the mask position with numpy : 0.029775619506835938 nb_pixel_total : 404799 time to create 1 rle with new method : 1.908160924911499 time for calcul the mask position with numpy : 0.025086402893066406 nb_pixel_total : 6389 time to create 1 rle with old method : 0.007315397262573242 time for calcul the mask position with numpy : 0.025501251220703125 nb_pixel_total : 46777 time to create 1 rle with old method : 0.05368399620056152 time for calcul the mask position with numpy : 0.026371479034423828 nb_pixel_total : 34567 time to create 1 rle with old method : 0.039366722106933594 time for calcul the mask position with numpy : 0.024790525436401367 nb_pixel_total : 12727 time to create 1 rle with old method : 0.014879465103149414 time for calcul the mask position with numpy : 0.02511286735534668 nb_pixel_total : 9812 time to create 1 rle with old method : 0.011136770248413086 time for calcul the mask position with numpy : 0.02612924575805664 nb_pixel_total : 8930 time to create 1 rle with old method : 0.010314464569091797 time for calcul the mask position with numpy : 0.02678084373474121 nb_pixel_total : 19457 time to create 1 rle with old method : 0.023294925689697266 time for calcul the mask position with numpy : 0.02926349639892578 nb_pixel_total : 187617 time to create 1 rle with new method : 0.9952387809753418 time for calcul the mask position with numpy : 0.025140762329101562 nb_pixel_total : 11243 time to create 1 rle with old method : 0.0128173828125 time for calcul the mask position with numpy : 0.024970531463623047 nb_pixel_total : 24800 time to create 1 rle with old method : 0.028091907501220703 time for calcul the mask position with numpy : 0.0256807804107666 nb_pixel_total : 61369 time to create 1 rle with old method : 0.07291865348815918 create new chi : 6.772002220153809 time to delete rle : 0.0017633438110351562 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 11756 TO DO : save crop sub photo not yet done ! save time : 0.7696597576141357 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 22.067100524902344 time for calcul the mask position with numpy : 1.3867571353912354 nb_pixel_total : 7574019 time to create 1 rle with new method : 0.9640903472900391 time for calcul the mask position with numpy : 0.041262149810791016 nb_pixel_total : 7481 time to create 1 rle with old method : 0.008590936660766602 time for calcul the mask position with numpy : 0.041915178298950195 nb_pixel_total : 3844 time to create 1 rle with old method : 0.0044803619384765625 time for calcul the mask position with numpy : 0.04105043411254883 nb_pixel_total : 67736 time to create 1 rle with old method : 0.07864212989807129 time for calcul the mask position with numpy : 0.04327678680419922 nb_pixel_total : 87928 time to create 1 rle with old method : 0.09973359107971191 time for calcul the mask position with numpy : 0.04096555709838867 nb_pixel_total : 62882 time to create 1 rle with old method : 0.07625699043273926 time for calcul the mask position with numpy : 0.04414534568786621 nb_pixel_total : 34853 time to create 1 rle with old method : 0.04348611831665039 time for calcul the mask position with numpy : 0.04775214195251465 nb_pixel_total : 3110 time to create 1 rle with old method : 0.0052034854888916016 time for calcul the mask position with numpy : 0.04785442352294922 nb_pixel_total : 6413 time to create 1 rle with old method : 0.007236480712890625 time for calcul the mask position with numpy : 0.03903317451477051 nb_pixel_total : 25349 time to create 1 rle with old method : 0.028523683547973633 time for calcul the mask position with numpy : 0.040128231048583984 nb_pixel_total : 6257 time to create 1 rle with old method : 0.00685572624206543 time for calcul the mask position with numpy : 0.03979802131652832 nb_pixel_total : 7368 time to create 1 rle with old method : 0.008385181427001953 time for calcul the mask position with numpy : 0.03960371017456055 nb_pixel_total : 6043 time to create 1 rle with old method : 0.0068988800048828125 time for calcul the mask position with numpy : 0.03993535041809082 nb_pixel_total : 14510 time to create 1 rle with old method : 0.01627516746520996 time for calcul the mask position with numpy : 0.03982234001159668 nb_pixel_total : 78125 time to create 1 rle with old method : 0.08786392211914062 time for calcul the mask position with numpy : 0.03866100311279297 nb_pixel_total : 38053 time to create 1 rle with old method : 0.042771339416503906 time for calcul the mask position with numpy : 0.03681135177612305 nb_pixel_total : 29348 time to create 1 rle with old method : 0.033309221267700195 time for calcul the mask position with numpy : 0.038651466369628906 nb_pixel_total : 16153 time to create 1 rle with old method : 0.018321752548217773 time for calcul the mask position with numpy : 0.03853869438171387 nb_pixel_total : 19728 time to create 1 rle with old method : 0.022130966186523438 time for calcul the mask position with numpy : 0.03812527656555176 nb_pixel_total : 17772 time to create 1 rle with old method : 0.019685745239257812 time for calcul the mask position with numpy : 0.029513120651245117 nb_pixel_total : 20294 time to create 1 rle with old method : 0.026178359985351562 time for calcul the mask position with numpy : 0.04044032096862793 nb_pixel_total : 125141 time to create 1 rle with old method : 0.13813233375549316 time for calcul the mask position with numpy : 0.040943145751953125 nb_pixel_total : 20420 time to create 1 rle with old method : 0.02268075942993164 time for calcul the mask position with numpy : 0.04062771797180176 nb_pixel_total : 21573 time to create 1 rle with old method : 0.024391651153564453 create new chi : 4.155526876449585 time to delete rle : 0.001664876937866211 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 11052 TO DO : save crop sub photo not yet done ! save time : 0.7256412506103516 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 24.812904596328735 time for calcul the mask position with numpy : 0.937450647354126 nb_pixel_total : 7212923 time to create 1 rle with new method : 1.1553068161010742 time for calcul the mask position with numpy : 0.042156219482421875 nb_pixel_total : 10718 time to create 1 rle with old method : 0.012281656265258789 time for calcul the mask position with numpy : 0.04096651077270508 nb_pixel_total : 33469 time to create 1 rle with old method : 0.0381932258605957 time for calcul the mask position with numpy : 0.04191398620605469 nb_pixel_total : 11071 time to create 1 rle with old method : 0.01259756088256836 time for calcul the mask position with numpy : 0.04316258430480957 nb_pixel_total : 62623 time to create 1 rle with old method : 0.07170295715332031 time for calcul the mask position with numpy : 0.04073476791381836 nb_pixel_total : 26778 time to create 1 rle with old method : 0.030205965042114258 time for calcul the mask position with numpy : 0.04098367691040039 nb_pixel_total : 108805 time to create 1 rle with old method : 0.12205123901367188 time for calcul the mask position with numpy : 0.04040193557739258 nb_pixel_total : 124838 time to create 1 rle with old method : 0.13740873336791992 time for calcul the mask position with numpy : 0.04008030891418457 nb_pixel_total : 35218 time to create 1 rle with old method : 0.039981842041015625 time for calcul the mask position with numpy : 0.04070305824279785 nb_pixel_total : 27166 time to create 1 rle with old method : 0.030517101287841797 time for calcul the mask position with numpy : 0.04038739204406738 nb_pixel_total : 72947 time to create 1 rle with old method : 0.08197927474975586 time for calcul the mask position with numpy : 0.04221343994140625 nb_pixel_total : 52145 time to create 1 rle with old method : 0.07630205154418945 time for calcul the mask position with numpy : 0.040555477142333984 nb_pixel_total : 22314 time to create 1 rle with old method : 0.025058984756469727 time for calcul the mask position with numpy : 0.043953657150268555 nb_pixel_total : 182229 time to create 1 rle with new method : 0.9402744770050049 time for calcul the mask position with numpy : 0.04232978820800781 nb_pixel_total : 12709 time to create 1 rle with old method : 0.014159440994262695 time for calcul the mask position with numpy : 0.039197683334350586 nb_pixel_total : 15007 time to create 1 rle with old method : 0.016688823699951172 time for calcul the mask position with numpy : 0.025511503219604492 nb_pixel_total : 67226 time to create 1 rle with old method : 0.07475638389587402 time for calcul the mask position with numpy : 0.02696537971496582 nb_pixel_total : 90720 time to create 1 rle with old method : 0.1074979305267334 time for calcul the mask position with numpy : 0.031079769134521484 nb_pixel_total : 19392 time to create 1 rle with old method : 0.021821022033691406 time for calcul the mask position with numpy : 0.024878740310668945 nb_pixel_total : 27833 time to create 1 rle with old method : 0.030875682830810547 time for calcul the mask position with numpy : 0.02545762062072754 nb_pixel_total : 19415 time to create 1 rle with old method : 0.021891355514526367 time for calcul the mask position with numpy : 0.025807619094848633 nb_pixel_total : 21488 time to create 1 rle with old method : 0.024138689041137695 time for calcul the mask position with numpy : 0.025660037994384766 nb_pixel_total : 37366 time to create 1 rle with old method : 0.04220080375671387 create new chi : 4.947021484375 time to delete rle : 0.002044200897216797 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 15182 TO DO : save crop sub photo not yet done ! save time : 0.9811882972717285 nb_obj : 13 nb_hashtags : 1 time to prepare the origin masks : 14.86231017112732 time for calcul the mask position with numpy : 1.1576118469238281 nb_pixel_total : 7686016 time to create 1 rle with new method : 1.2224950790405273 time for calcul the mask position with numpy : 0.024692535400390625 nb_pixel_total : 56711 time to create 1 rle with old method : 0.06761908531188965 time for calcul the mask position with numpy : 0.02590322494506836 nb_pixel_total : 22245 time to create 1 rle with old method : 0.0320439338684082 time for calcul the mask position with numpy : 0.024868011474609375 nb_pixel_total : 17506 time to create 1 rle with old method : 0.01988363265991211 time for calcul the mask position with numpy : 0.02447199821472168 nb_pixel_total : 13011 time to create 1 rle with old method : 0.014856100082397461 time for calcul the mask position with numpy : 0.02540898323059082 nb_pixel_total : 116954 time to create 1 rle with old method : 0.13128972053527832 time for calcul the mask position with numpy : 0.029057979583740234 nb_pixel_total : 151825 time to create 1 rle with new method : 2.168755054473877 time for calcul the mask position with numpy : 0.04251813888549805 nb_pixel_total : 48615 time to create 1 rle with old method : 0.05541181564331055 time for calcul the mask position with numpy : 0.04464983940124512 nb_pixel_total : 30269 time to create 1 rle with old method : 0.03426313400268555 time for calcul the mask position with numpy : 0.04311370849609375 nb_pixel_total : 42598 time to create 1 rle with old method : 0.04946708679199219 time for calcul the mask position with numpy : 0.040825605392456055 nb_pixel_total : 48161 time to create 1 rle with old method : 0.055527687072753906 time for calcul the mask position with numpy : 0.043564558029174805 nb_pixel_total : 10358 time to create 1 rle with old method : 0.011903524398803711 time for calcul the mask position with numpy : 0.042192697525024414 nb_pixel_total : 16116 time to create 1 rle with old method : 0.01838397979736328 time for calcul the mask position with numpy : 0.0350651741027832 nb_pixel_total : 34015 time to create 1 rle with old method : 0.03829336166381836 create new chi : 5.598613977432251 time to delete rle : 0.002066373825073242 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9992 TO DO : save crop sub photo not yet done ! save time : 0.7373983860015869 map_output_result : {1358563015: (0.0, 'Should be the crop_list due to order', 0), 1358563012: (0.0, 'Should be the crop_list due to order', 0), 1358563010: (0.0, 'Should be the crop_list due to order', 0), 1358563002: (0.0, 'Should be the crop_list due to order', 0), 1358562869: (0.0, 'Should be the crop_list due to order', 0), 1358562822: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358563015, 1358563012, 1358563010, 1358563002, 1358562869, 1358562822] Looping around the photos to save general results len do output : 6 /1358563015.Didn't retrieve data . /1358563012.Didn't retrieve data . /1358563010.Didn't retrieve data . /1358563002.Didn't retrieve data . /1358562869.Didn't retrieve data . /1358562822.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563015', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563012', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563010', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563002', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562869', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562822', None, None, None, None, None, '2864930') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.017441749572753906 save_final save missing photos in datou_result : time spend for datou_step_exec : 161.2389681339264 time spend to save output : 0.017928600311279297 total time spend for step 3 : 161.25689673423767 step4:ventilate_hashtags_in_portfolio Thu May 15 18:15:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23018467 get user id for portfolio 23018467 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23018467 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','background','carton','autre','pet_clair','environnement','papier','mal_croppe','pehd','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23018467 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','background','carton','autre','pet_clair','environnement','papier','mal_croppe','pehd','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23018467 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','background','carton','autre','pet_clair','environnement','papier','mal_croppe','pehd','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23018782,23018783,23018784,23018785,23018786,23018787,23018788,23018789,23018790,23018791,23018792?tags=pet_fonce,flou,background,carton,autre,pet_clair,environnement,papier,mal_croppe,pehd,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358563015, 1358563012, 1358563010, 1358563002, 1358562869, 1358562822] Looping around the photos to save general results len do output : 1 /23018467. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563015', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563012', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563010', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563002', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562869', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562822', None, None, None, None, None, '2864930') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.01871466636657715 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7437217235565186 time spend to save output : 0.018982648849487305 total time spend for step 4 : 1.7627043724060059 step5:final Thu May 15 18:15:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358563015: ('0.10456412358539097',), 1358563012: ('0.10456412358539097',), 1358563010: ('0.10456412358539097',), 1358563002: ('0.10456412358539097',), 1358562869: ('0.10456412358539097',), 1358562822: ('0.10456412358539097',)} new output for save of step final : {1358563015: ('0.10456412358539097',), 1358563012: ('0.10456412358539097',), 1358563010: ('0.10456412358539097',), 1358563002: ('0.10456412358539097',), 1358562869: ('0.10456412358539097',), 1358562822: ('0.10456412358539097',)} [1358563015, 1358563012, 1358563010, 1358563002, 1358562869, 1358562822] Looping around the photos to save general results len do output : 6 /1358563015.Didn't retrieve data . /1358563012.Didn't retrieve data . /1358563010.Didn't retrieve data . /1358563002.Didn't retrieve data . /1358562869.Didn't retrieve data . /1358562822.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563015', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563012', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563010', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563002', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562869', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562822', None, None, None, None, None, '2864930') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.018169641494750977 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1074988842010498 time spend to save output : 0.018516063690185547 total time spend for step 5 : 0.12601494789123535 step6:blur_detection Thu May 15 18:15:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c.jpg resize: (2160, 3840) 1358563015 -6.491339555999543 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a.jpg resize: (2160, 3840) 1358563012 -6.243411408210596 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd.jpg resize: (2160, 3840) 1358563010 -6.142229377335872 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2.jpg resize: (2160, 3840) 1358563002 -6.594239193385051 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671.jpg resize: (2160, 3840) 1358562869 -6.206099612610889 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0.jpg resize: (2160, 3840) 1358562822 -5.969147873737814 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411205_0.png resize: (244, 133) 1358582338 -2.304952604293746 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411198_0.png resize: (171, 187) 1358582340 -4.110648184414899 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411192_0.png resize: (331, 346) 1358582341 -1.9625863056019506 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411190_0.png resize: (227, 170) 1358582343 -3.131424502702298 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411195_0.png resize: (338, 259) 1358582345 -0.19733395382004643 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411203_0.png resize: (399, 350) 1358582346 -1.081133455520714 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411186_0.png resize: (304, 250) 1358582347 -3.1073063808929064 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411194_0.png resize: (163, 116) 1358582349 -2.895975627900826 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411201_0.png resize: (351, 535) 1358582351 -0.9287703710153384 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411187_0.png resize: (259, 394) 1358582352 -1.675359749507497 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411191_0.png resize: (361, 248) 1358582354 -3.2843099498670107 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411196_0.png resize: (123, 99) 1358582356 2.7685415323832285 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411189_0.png resize: (170, 209) 1358582357 0.043018605692696645 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411197_0.png resize: (103, 106) 1358582359 -3.010065772762477 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411202_0.png resize: (126, 133) 1358582361 -4.2824763744600824 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411223_0.png resize: (175, 98) 1358582362 -1.8232221443895555 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411222_0.png resize: (166, 181) 1358582363 -0.5143519254490749 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411210_0.png resize: (107, 115) 1358582365 -3.857073732557704 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411206_0.png resize: (156, 285) 1358582367 -1.6457158199847897 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411214_0.png resize: (214, 340) 1358582368 -1.8823853643385307 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411221_0.png resize: (170, 134) 1358582370 -4.21984241509059 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411215_0.png resize: (250, 119) 1358582372 -3.205429087520196 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411213_0.png resize: (87, 70) 1358582373 -2.946433518635595 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411208_0.png resize: (125, 134) 1358582374 -0.8019059933886521 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411217_0.png resize: (124, 105) 1358582377 -3.2391514857126213 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411220_0.png resize: (233, 404) 1358582378 -3.9932318363783796 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411219_0.png resize: (238, 201) 1358582379 -2.404092341895894 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411211_0.png resize: (512, 202) 1358582381 -2.345669710616911 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411227_0.png resize: (109, 101) 1358582383 -1.08405156236237 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411207_0.png resize: (135, 166) 1358582384 -3.8752049083463613 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411209_0.png resize: (147, 182) 1358582386 -2.151706110317928 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411243_0.png resize: (685, 188) 1358582388 -2.0792865549399453 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411237_0.png resize: (254, 233) 1358582389 -1.4788484244599682 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411231_0.png resize: (498, 602) 1358582390 -2.6135290154378996 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411228_0.png resize: (304, 335) 1358582393 -0.7333404572811261 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411234_0.png resize: (142, 117) 1358582394 -0.8538278665984078 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411229_0.png resize: (215, 218) 1358582395 -2.366544425960873 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411240_0.png resize: (79, 85) 1358582398 -0.7945017652989476 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411233_0.png resize: (124, 141) 1358582399 -1.0538936285143874 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411239_0.png resize: (660, 878) 1358582400 -0.6741832833211555 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411230_0.png resize: (125, 171) 1358582403 -0.9271250187197846 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411242_0.png resize: (180, 307) 1358582404 -4.7866240563091145 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411235_0.png resize: (97, 177) 1358582405 -2.301783688170246 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411238_0.png resize: (79, 125) 1358582408 -2.4591148132143514 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411232_0.png resize: (105, 219) 1358582409 -3.704463121806956 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411256_0.png resize: (164, 124) 1358582410 -3.3004015471937254 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411253_0.png resize: (181, 203) 1358582412 -1.1362722916635222 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411259_0.png resize: (97, 87) 1358582414 -2.344994237259756 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411263_0.png resize: (414, 109) 1358582415 -4.079100668117539 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411247_0.png resize: (150, 167) 1358582416 -3.5019082557701138 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411265_0.png resize: (406, 544) 1358582420 -2.2367644460819998 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411255_0.png resize: (314, 376) 1358582421 -0.363882299858654 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411250_0.png resize: (144, 189) 1358582422 -1.8651180950601853 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411262_0.png resize: (143, 150) 1358582425 -0.8519909362837422 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411260_0.png resize: (172, 172) 1358582426 1.8024082400177042 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411246_0.png resize: (147, 195) 1358582427 -0.9481456738332372 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411249_0.png resize: (157, 152) 1358582429 -1.4899493876852388 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411267_0.png resize: (59, 96) 1358582431 -3.65268750880178 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411251_0.png resize: (144, 164) 1358582432 0.4967709942850094 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411268_0.png resize: (182, 112) 1358582433 -3.397305655166801 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411261_0.png resize: (97, 98) 1358582436 -2.6842275678928367 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411257_0.png resize: (104, 96) 1358582438 -3.51027315533883 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411274_0.png resize: (383, 423) 1358582439 -2.8996289563253494 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411281_0.png resize: (431, 200) 1358582441 -3.0750574415864187 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411277_0.png resize: (107, 165) 1358582443 -2.823527688219649 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411280_0.png resize: (431, 162) 1358582444 -3.9123914060335654 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411276_0.png resize: (93, 228) 1358582446 -3.0455270794030853 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411270_0.png resize: (233, 126) 1358582448 -2.225318452708799 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411272_0.png resize: (178, 192) 1358582449 -1.8654510274143055 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411289_0.png resize: (169, 278) 1358582451 -3.3798102409372315 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411286_0.png resize: (117, 321) 1358582453 -1.5782923969800546 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411283_0.png resize: (240, 247) 1358582454 -2.9515609598590964 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411287_0.png resize: (308, 342) 1358582455 -3.7375501484350018 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411273_0.png resize: (140, 156) 1358582457 -1.2722130891794314 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411275_0.png resize: (386, 221) 1358582460 -2.9418536988743536 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411271_0.png resize: (134, 240) 1358582461 -1.2560240091499817 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411288_0.png resize: (126, 126) 1358582463 -3.851776961436824 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411290_0.png resize: (175, 172) 1358582466 -3.76474025541358 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411279_0.png resize: (234, 160) 1358582467 -2.5912442920907677 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411294_0.png resize: (261, 276) 1358582469 -1.8149664144813191 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411296_0.png resize: (295, 134) 1358582471 -0.661445001449397 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411295_0.png resize: (283, 194) 1358582472 -2.5164328645717484 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411292_0.png resize: (183, 204) 1358582473 -2.3168600787809663 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411298_0.png resize: (502, 421) 1358582475 -2.878488607706934 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411301_0.png resize: (179, 142) 1358582477 -1.9300732353219034 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411300_0.png resize: (123, 165) 1358582478 -3.07208540020265 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411303_0.png resize: (377, 188) 1358582480 -2.2548123858825764 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411291_0.png resize: (133, 336) 1358582482 -2.1918384161455795 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411299_0.png resize: (552, 455) 1358582483 -1.3813381945219163 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411293_0.png resize: (91, 149) 1358582486 -3.5993262856970807 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411302_0.png resize: (183, 140) 1358582488 0.9995716129393907 treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411297_0.png resize: (429, 234) 1358582489 -2.538246987248615 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411200_0.png resize: (118, 139) 1358582580 -4.080702173991038 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411193_0.png resize: (362, 275) 1358582583 -4.564925041981436 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411254_0.png resize: (337, 194) 1358582584 -3.645567304533353 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411258_0.png resize: (76, 146) 1358582585 -3.403952381232786 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411266_0.png resize: (277, 314) 1358582587 -3.8864776801420775 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411252_0.png resize: (151, 203) 1358582589 -2.77962683306045 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411264_0.png resize: (270, 348) 1358582590 -4.111726225086624 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411278_0.png resize: (474, 503) 1358582592 -1.3063625314681782 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411269_0.png resize: (256, 203) 1358582594 -2.442236777023702 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411204_0.png resize: (278, 220) 1358582721 -4.30657657928066 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411188_0.png resize: (196, 296) 1358582723 -3.7817918480356574 treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411199_0.png resize: (317, 360) 1358582724 -4.37049136103657 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411212_0.png resize: (514, 435) 1358582726 -4.037597986063701 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411226_0.png resize: (264, 238) 1358582728 -3.4581037615964396 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411225_0.png resize: (545, 237) 1358582729 -3.94202524529543 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411236_0.png resize: (202, 279) 1358582731 -3.0872193014544105 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411245_0.png resize: (177, 418) 1358582732 -3.0222863253887313 treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411248_0.png resize: (382, 388) 1358582734 -4.549560042753305 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411282_0.png resize: (140, 258) 1358582735 -2.400586031653931 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411285_0.png resize: (590, 211) 1358582738 -4.615942713092741 treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411284_0.png resize: (515, 295) 1358582740 -4.742810703491376 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411241_0.png resize: (216, 318) 1358582774 -2.647808566853997 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411224_0.png resize: (205, 130) 1358582823 -2.133405556261399 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411218_0.png resize: (213, 204) 1358582825 -4.36963065123024 treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411216_0.png resize: (344, 501) 1358582827 -4.64636755384929 treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411244_0.png resize: (298, 411) 1358582828 -3.3769731755708086 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 124 time used for this insertion : 0.01907062530517578 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 124 time used for this insertion : 0.030999422073364258 save missing photos in datou_result : time spend for datou_step_exec : 32.52850866317749 time spend to save output : 0.05570626258850098 total time spend for step 6 : 32.58421492576599 step7:brightness Thu May 15 18:16:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c.jpg treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a.jpg treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd.jpg treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2.jpg treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671.jpg treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0.jpg treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411205_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411198_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411192_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411190_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411195_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411203_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411186_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411194_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411201_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411187_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411191_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411196_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411189_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411197_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411202_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411223_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411222_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411210_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411206_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411214_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411221_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411215_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411213_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411208_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411217_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411220_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411219_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411211_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411227_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411207_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411209_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411243_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411237_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411231_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411228_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411234_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411229_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411240_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411233_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411239_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411230_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411242_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411235_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411238_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411232_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411256_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411253_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411259_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411263_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411247_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411265_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411255_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411250_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411262_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411260_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411246_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411249_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411267_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411251_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411268_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411261_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411257_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411274_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411281_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411277_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411280_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411276_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411270_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411272_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411289_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411286_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411283_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411287_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411273_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411275_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411271_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411288_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411290_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411279_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411294_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411296_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411295_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411292_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411298_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411301_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411300_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411303_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411291_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411299_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411293_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411302_0.png treat image : temp/1747325428_314713_1358562822_3f3ea7d1c594c68510d0edb8fa5b5ba0_rle_crop_3799411297_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411200_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411193_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411254_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411258_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411266_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411252_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411264_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411278_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411269_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411204_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411188_0.png treat image : temp/1747325428_314713_1358563015_1490b247ed7ce169ccddeb6c761b4f2c_rle_crop_3799411199_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411212_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411226_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411225_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411236_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411245_0.png treat image : temp/1747325428_314713_1358563002_01888dfc4800132ee06e84ac1da134d2_rle_crop_3799411248_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411282_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411285_0.png treat image : temp/1747325428_314713_1358562869_c6612edb567c6487780fde402d2cb671_rle_crop_3799411284_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411241_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411224_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411218_0.png treat image : temp/1747325428_314713_1358563012_e3a9040d23dbcef299bbd71512f8163a_rle_crop_3799411216_0.png treat image : temp/1747325428_314713_1358563010_3e75e80bef20e080f4301a155757b0fd_rle_crop_3799411244_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 124 time used for this insertion : 0.019583463668823242 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 124 time used for this insertion : 0.03568625450134277 save missing photos in datou_result : time spend for datou_step_exec : 7.784286737442017 time spend to save output : 0.060704946517944336 total time spend for step 7 : 7.844991683959961 step8:velours_tree Thu May 15 18:16:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09913945198059082 time spend to save output : 3.814697265625e-05 total time spend for step 8 : 0.09917759895324707 step9:send_mail_cod Thu May 15 18:16:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23018467_15-05-2025_18_16_11.pdf 23018782 change filename to text .change filename to text .change filename to text .change filename to text .imagette230187821747325771 23018783 imagette230187831747325771 23018784 imagette230187841747325771 23018785 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230187851747325771 23018786 change filename to text .imagette230187861747325772 23018787 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230187871747325772 23018789 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230187891747325773 23018790 imagette230187901747325775 23018791 imagette230187911747325775 23018792 imagette230187921747325775 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23018467 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23018782,23018783,23018784,23018785,23018786,23018787,23018788,23018789,23018790,23018791,23018792?tags=pet_fonce,flou,background,carton,autre,pet_clair,environnement,papier,mal_croppe,pehd,metal args[1358563015] : ((1358563015, -6.491339555999543, 492609224), (1358563015, 0.7856112775942508, 2107752395), '0.10456412358539097') We are sending mail with results at report@fotonower.com args[1358563012] : ((1358563012, -6.243411408210596, 492609224), (1358563012, 0.825017688419551, 2107752395), '0.10456412358539097') We are sending mail with results at report@fotonower.com args[1358563010] : ((1358563010, -6.142229377335872, 492609224), (1358563010, 0.8485051549269621, 2107752395), '0.10456412358539097') We are sending mail with results at report@fotonower.com args[1358563002] : ((1358563002, -6.594239193385051, 492609224), (1358563002, 0.9100618113420799, 2107752395), '0.10456412358539097') We are sending mail with results at report@fotonower.com args[1358562869] : ((1358562869, -6.206099612610889, 492609224), (1358562869, 0.9605093645481049, 2107752395), '0.10456412358539097') We are sending mail with results at report@fotonower.com args[1358562822] : ((1358562822, -5.969147873737814, 492609224), (1358562822, 0.9365300602976386, 2107752395), '0.10456412358539097') We are sending mail with results at report@fotonower.com refus_total : 0.10456412358539097 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23018467 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23018467_15-05-2025_18_16_11.pdf results_Auto_P23018467_15-05-2025_18_16_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23018467_15-05-2025_18_16_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23018467','results_Auto_P23018467_15-05-2025_18_16_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23018467_15-05-2025_18_16_11.pdf','pdf','','0.52','0.10456412358539097') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23018467

https://www.fotonower.com/image?json=false&list_photos_id=1358563015
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358563012
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358563010
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358563002
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358562869
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358562822
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.46%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23018782?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23018785?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23018786?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23018787?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23018789?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23018467_15-05-2025_18_16_11.pdf.

Lien vers velours :https://www.fotonower.com/velours/23018782,23018783,23018784,23018785,23018786,23018787,23018788,23018789,23018790,23018791,23018792?tags=pet_fonce,flou,background,carton,autre,pet_clair,environnement,papier,mal_croppe,pehd,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 15 May 2025 16:16:17 GMT Content-Length: 0 Connection: close X-Message-Id: _-JjVmNhSYCpdKsrexM70A Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358563015, 1358563012, 1358563010, 1358563002, 1358562869, 1358562822] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563015', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563012', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563010', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563002', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562869', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562822', None, None, None, None, None, '2864930') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01561427116394043 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.063575029373169 time spend to save output : 0.015809297561645508 total time spend for step 9 : 6.0793843269348145 step10:split_time_score Thu May 15 18:16:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 15052025 23018467 Nombre de photos uploadées : 6 / 23040 (0%) 15052025 23018467 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 15052025 23018467 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 8.58306884765625e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.00042748451232910156 elapsed_time : insert_dashboard_record_day_entry 0.024814605712890625 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23003826 order by id desc limit 1 Qualite : 0.15962703751929014 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23003831_15-05-2025_13_04_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23003831 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23003831 AND mptpi.`type`=3594 To do Qualite : 0.14424263760288064 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23003838_15-05-2025_11_52_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23003838 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23003838 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23012442 order by id desc limit 1 Qualite : 0.12670043072815143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23012451_15-05-2025_16_33_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23012451 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23012451 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23010986 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23010995 order by id desc limit 1 Qualite : 0.16292133849344131 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23015442_15-05-2025_17_18_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23015442 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23015442 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23018462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23018464 order by id desc limit 1 Qualite : 0.10456412358539097 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23018467_15-05-2025_18_16_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23018467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23018467 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'15052025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358563015, 1358563012, 1358563010, 1358563002, 1358562869, 1358562822] Looping around the photos to save general results len do output : 1 /23018467Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563015', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563012', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563010', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358563002', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562869', None, None, None, None, None, '2864930') ('3318', None, None, None, None, None, None, None, '2864930') ('3318', '23018467', '1358562822', None, None, None, None, None, '2864930') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.014120340347290039 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.759145498275757 time spend to save output : 0.014301061630249023 total time spend for step 10 : 5.773446559906006 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 109.07user 201.27system 5:58.95elapsed 86%CPU (0avgtext+0avgdata 4699516maxresident)k 1123232inputs+82096outputs (3066major+12725028minor)pagefaults 0swaps