python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2144729 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2969176'] with mtr_portfolio_ids : ['23391048'] and first list_photo_ids : [] new path : /proc/2144729/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.2122719287872314 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 27 21:00:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7218 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-27 21:00:33.320427: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-27 21:00:33.347059: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-27 21:00:33.349377: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa9dc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-27 21:00:33.349442: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-27 21:00:33.353958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-27 21:00:33.576845: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x33183d30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-27 21:00:33.576919: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-27 21:00:33.578256: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 21:00:33.578687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 21:00:33.581747: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 21:00:33.584677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 21:00:33.585154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 21:00:33.588174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 21:00:33.589247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 21:00:33.593708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 21:00:33.594978: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 21:00:33.595054: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 21:00:33.595740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 21:00:33.595756: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 21:00:33.595766: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 21:00:33.596910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6642 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-27 21:00:33.854209: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 21:00:33.854342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 21:00:33.854371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 21:00:33.854397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 21:00:33.854421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 21:00:33.854446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 21:00:33.854470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 21:00:33.854495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 21:00:33.856106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 21:00:33.857081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 21:00:33.857110: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 21:00:33.857124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 21:00:33.857138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 21:00:33.857150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 21:00:33.857163: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 21:00:33.857176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 21:00:33.857189: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 21:00:33.858143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 21:00:33.858175: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 21:00:33.858183: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 21:00:33.858190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 21:00:33.859200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6642 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-27 21:00:42.809407: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 21:00:43.010520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 2145521 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10776 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0011515617370605469 nb_pixel_total : 22739 time to create 1 rle with old method : 0.03401970863342285 length of segment : 205 time for calcul the mask position with numpy : 0.00040030479431152344 nb_pixel_total : 16202 time to create 1 rle with old method : 0.02583765983581543 length of segment : 212 time for calcul the mask position with numpy : 0.005590915679931641 nb_pixel_total : 158459 time to create 1 rle with new method : 0.012154579162597656 length of segment : 289 time for calcul the mask position with numpy : 0.000675201416015625 nb_pixel_total : 29135 time to create 1 rle with old method : 0.03344249725341797 length of segment : 260 time for calcul the mask position with numpy : 0.001115560531616211 nb_pixel_total : 63194 time to create 1 rle with old method : 0.07417821884155273 length of segment : 250 time for calcul the mask position with numpy : 0.0007722377777099609 nb_pixel_total : 34361 time to create 1 rle with old method : 0.039380550384521484 length of segment : 183 time for calcul the mask position with numpy : 0.001245737075805664 nb_pixel_total : 54698 time to create 1 rle with old method : 0.062288761138916016 length of segment : 338 time for calcul the mask position with numpy : 0.001043558120727539 nb_pixel_total : 42006 time to create 1 rle with old method : 0.048780202865600586 length of segment : 510 time for calcul the mask position with numpy : 0.00027680397033691406 nb_pixel_total : 8974 time to create 1 rle with old method : 0.010526418685913086 length of segment : 133 time for calcul the mask position with numpy : 0.0006959438323974609 nb_pixel_total : 38280 time to create 1 rle with old method : 0.04361414909362793 length of segment : 220 time for calcul the mask position with numpy : 0.0004525184631347656 nb_pixel_total : 9442 time to create 1 rle with old method : 0.011308908462524414 length of segment : 155 time for calcul the mask position with numpy : 0.00047135353088378906 nb_pixel_total : 21410 time to create 1 rle with old method : 0.024499177932739258 length of segment : 168 time for calcul the mask position with numpy : 0.00033092498779296875 nb_pixel_total : 13385 time to create 1 rle with old method : 0.016025781631469727 length of segment : 150 time for calcul the mask position with numpy : 0.00054168701171875 nb_pixel_total : 19644 time to create 1 rle with old method : 0.022968292236328125 length of segment : 232 time for calcul the mask position with numpy : 0.0005922317504882812 nb_pixel_total : 22498 time to create 1 rle with old method : 0.02607583999633789 length of segment : 242 time for calcul the mask position with numpy : 0.0008368492126464844 nb_pixel_total : 37385 time to create 1 rle with old method : 0.04254651069641113 length of segment : 196 time for calcul the mask position with numpy : 0.00043082237243652344 nb_pixel_total : 18990 time to create 1 rle with old method : 0.02213764190673828 length of segment : 132 time for calcul the mask position with numpy : 0.0005977153778076172 nb_pixel_total : 34095 time to create 1 rle with old method : 0.03955268859863281 length of segment : 177 time for calcul the mask position with numpy : 0.00057220458984375 nb_pixel_total : 28445 time to create 1 rle with old method : 0.03439903259277344 length of segment : 232 time for calcul the mask position with numpy : 0.0004787445068359375 nb_pixel_total : 20141 time to create 1 rle with old method : 0.023299217224121094 length of segment : 260 time for calcul the mask position with numpy : 0.00048422813415527344 nb_pixel_total : 14836 time to create 1 rle with old method : 0.018004179000854492 length of segment : 170 time for calcul the mask position with numpy : 0.000560760498046875 nb_pixel_total : 18552 time to create 1 rle with old method : 0.02160048484802246 length of segment : 222 time for calcul the mask position with numpy : 0.0004863739013671875 nb_pixel_total : 19317 time to create 1 rle with old method : 0.02265167236328125 length of segment : 156 time for calcul the mask position with numpy : 0.0006508827209472656 nb_pixel_total : 34377 time to create 1 rle with old method : 0.03964567184448242 length of segment : 202 time for calcul the mask position with numpy : 0.0030171871185302734 nb_pixel_total : 119688 time to create 1 rle with old method : 0.1344006061553955 length of segment : 829 time for calcul the mask position with numpy : 0.0011827945709228516 nb_pixel_total : 59897 time to create 1 rle with old method : 0.06828022003173828 length of segment : 305 time for calcul the mask position with numpy : 0.0005738735198974609 nb_pixel_total : 22726 time to create 1 rle with old method : 0.03062891960144043 length of segment : 270 time for calcul the mask position with numpy : 0.0012478828430175781 nb_pixel_total : 45598 time to create 1 rle with old method : 0.06413388252258301 length of segment : 274 time for calcul the mask position with numpy : 0.00033354759216308594 nb_pixel_total : 8325 time to create 1 rle with old method : 0.013993263244628906 length of segment : 133 time for calcul the mask position with numpy : 0.0008482933044433594 nb_pixel_total : 15405 time to create 1 rle with old method : 0.026035547256469727 length of segment : 205 time for calcul the mask position with numpy : 0.0010707378387451172 nb_pixel_total : 49538 time to create 1 rle with old method : 0.05801200866699219 length of segment : 284 time for calcul the mask position with numpy : 0.00026297569274902344 nb_pixel_total : 10490 time to create 1 rle with old method : 0.012474775314331055 length of segment : 142 time for calcul the mask position with numpy : 0.00024628639221191406 nb_pixel_total : 12499 time to create 1 rle with old method : 0.014776468276977539 length of segment : 115 time for calcul the mask position with numpy : 0.0009129047393798828 nb_pixel_total : 39449 time to create 1 rle with old method : 0.04559659957885742 length of segment : 257 time for calcul the mask position with numpy : 0.0006611347198486328 nb_pixel_total : 34177 time to create 1 rle with old method : 0.03847646713256836 length of segment : 277 time for calcul the mask position with numpy : 0.0010447502136230469 nb_pixel_total : 54314 time to create 1 rle with old method : 0.06166243553161621 length of segment : 319 time for calcul the mask position with numpy : 0.0003752708435058594 nb_pixel_total : 12401 time to create 1 rle with old method : 0.014394521713256836 length of segment : 167 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 22236 time to create 1 rle with old method : 0.025496959686279297 length of segment : 237 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 7150 time to create 1 rle with old method : 0.009680747985839844 length of segment : 127 time for calcul the mask position with numpy : 0.0008628368377685547 nb_pixel_total : 39171 time to create 1 rle with old method : 0.06390905380249023 length of segment : 210 time for calcul the mask position with numpy : 0.0007448196411132812 nb_pixel_total : 41026 time to create 1 rle with old method : 0.04704594612121582 length of segment : 298 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 7115 time to create 1 rle with old method : 0.008437633514404297 length of segment : 129 time for calcul the mask position with numpy : 0.0006515979766845703 nb_pixel_total : 17471 time to create 1 rle with old method : 0.021184921264648438 length of segment : 286 time for calcul the mask position with numpy : 0.0005657672882080078 nb_pixel_total : 19005 time to create 1 rle with old method : 0.03121209144592285 length of segment : 217 time for calcul the mask position with numpy : 0.0005824565887451172 nb_pixel_total : 25350 time to create 1 rle with old method : 0.04266715049743652 length of segment : 252 time for calcul the mask position with numpy : 0.00042748451232910156 nb_pixel_total : 15860 time to create 1 rle with old method : 0.018038511276245117 length of segment : 198 time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 24607 time to create 1 rle with old method : 0.029262542724609375 length of segment : 218 time for calcul the mask position with numpy : 0.0007369518280029297 nb_pixel_total : 34486 time to create 1 rle with old method : 0.042707204818725586 length of segment : 297 time for calcul the mask position with numpy : 0.0033555030822753906 nb_pixel_total : 100587 time to create 1 rle with old method : 0.12093544006347656 length of segment : 540 time for calcul the mask position with numpy : 0.015283346176147461 nb_pixel_total : 320338 time to create 1 rle with new method : 0.05446052551269531 length of segment : 738 time for calcul the mask position with numpy : 0.0025281906127929688 nb_pixel_total : 88888 time to create 1 rle with old method : 0.10334038734436035 length of segment : 444 time for calcul the mask position with numpy : 0.0018172264099121094 nb_pixel_total : 72022 time to create 1 rle with old method : 0.08936929702758789 length of segment : 550 time for calcul the mask position with numpy : 0.00395655632019043 nb_pixel_total : 210687 time to create 1 rle with new method : 0.015202522277832031 length of segment : 556 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 13473 time to create 1 rle with old method : 0.015775442123413086 length of segment : 218 time for calcul the mask position with numpy : 0.0005300045013427734 nb_pixel_total : 26299 time to create 1 rle with old method : 0.03334760665893555 length of segment : 169 time for calcul the mask position with numpy : 0.0007333755493164062 nb_pixel_total : 36127 time to create 1 rle with old method : 0.04222249984741211 length of segment : 264 time for calcul the mask position with numpy : 0.003833293914794922 nb_pixel_total : 155797 time to create 1 rle with new method : 0.014667034149169922 length of segment : 673 time for calcul the mask position with numpy : 0.003057241439819336 nb_pixel_total : 140268 time to create 1 rle with old method : 0.16070318222045898 length of segment : 399 time for calcul the mask position with numpy : 0.00035119056701660156 nb_pixel_total : 15968 time to create 1 rle with old method : 0.018708467483520508 length of segment : 102 time for calcul the mask position with numpy : 0.0003650188446044922 nb_pixel_total : 17710 time to create 1 rle with old method : 0.021154403686523438 length of segment : 138 time for calcul the mask position with numpy : 0.0009140968322753906 nb_pixel_total : 28591 time to create 1 rle with old method : 0.03308367729187012 length of segment : 312 time for calcul the mask position with numpy : 0.0009961128234863281 nb_pixel_total : 43458 time to create 1 rle with old method : 0.050978660583496094 length of segment : 130 time for calcul the mask position with numpy : 0.001180410385131836 nb_pixel_total : 49920 time to create 1 rle with old method : 0.060736656188964844 length of segment : 345 time for calcul the mask position with numpy : 0.002245187759399414 nb_pixel_total : 106664 time to create 1 rle with old method : 0.12105345726013184 length of segment : 282 time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 10321 time to create 1 rle with old method : 0.012117385864257812 length of segment : 159 time for calcul the mask position with numpy : 0.0013124942779541016 nb_pixel_total : 26753 time to create 1 rle with old method : 0.031603336334228516 length of segment : 345 time for calcul the mask position with numpy : 0.023992300033569336 nb_pixel_total : 473876 time to create 1 rle with new method : 0.048569679260253906 length of segment : 824 time for calcul the mask position with numpy : 0.0003764629364013672 nb_pixel_total : 8445 time to create 1 rle with old method : 0.009562492370605469 length of segment : 201 time for calcul the mask position with numpy : 0.00032019615173339844 nb_pixel_total : 16312 time to create 1 rle with old method : 0.019253253936767578 length of segment : 85 time for calcul the mask position with numpy : 0.0009889602661132812 nb_pixel_total : 44130 time to create 1 rle with old method : 0.05015134811401367 length of segment : 350 time for calcul the mask position with numpy : 0.004590511322021484 nb_pixel_total : 234985 time to create 1 rle with new method : 0.014907360076904297 length of segment : 466 time for calcul the mask position with numpy : 0.0014901161193847656 nb_pixel_total : 54953 time to create 1 rle with old method : 0.06526041030883789 length of segment : 446 time for calcul the mask position with numpy : 0.0032405853271484375 nb_pixel_total : 168409 time to create 1 rle with new method : 0.011521100997924805 length of segment : 532 time for calcul the mask position with numpy : 0.0013096332550048828 nb_pixel_total : 56861 time to create 1 rle with old method : 0.06542754173278809 length of segment : 260 time for calcul the mask position with numpy : 0.0011258125305175781 nb_pixel_total : 64270 time to create 1 rle with old method : 0.07363009452819824 length of segment : 296 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 11292 time to create 1 rle with old method : 0.013251304626464844 length of segment : 110 time for calcul the mask position with numpy : 0.0037717819213867188 nb_pixel_total : 184137 time to create 1 rle with new method : 0.011821508407592773 length of segment : 577 time for calcul the mask position with numpy : 0.0003254413604736328 nb_pixel_total : 9887 time to create 1 rle with old method : 0.01198720932006836 length of segment : 109 time for calcul the mask position with numpy : 0.00051116943359375 nb_pixel_total : 17626 time to create 1 rle with old method : 0.02335047721862793 length of segment : 167 time for calcul the mask position with numpy : 0.00042700767517089844 nb_pixel_total : 22195 time to create 1 rle with old method : 0.02625250816345215 length of segment : 189 time for calcul the mask position with numpy : 0.0008842945098876953 nb_pixel_total : 41216 time to create 1 rle with old method : 0.06197762489318848 length of segment : 198 time for calcul the mask position with numpy : 0.004140138626098633 nb_pixel_total : 34419 time to create 1 rle with old method : 0.04055643081665039 length of segment : 376 time for calcul the mask position with numpy : 0.0009195804595947266 nb_pixel_total : 15727 time to create 1 rle with old method : 0.019611835479736328 length of segment : 156 time for calcul the mask position with numpy : 0.0009558200836181641 nb_pixel_total : 38844 time to create 1 rle with old method : 0.04762601852416992 length of segment : 247 time for calcul the mask position with numpy : 0.0006709098815917969 nb_pixel_total : 24195 time to create 1 rle with old method : 0.02923727035522461 length of segment : 374 time for calcul the mask position with numpy : 0.0003688335418701172 nb_pixel_total : 13317 time to create 1 rle with old method : 0.017044782638549805 length of segment : 91 time for calcul the mask position with numpy : 0.0005636215209960938 nb_pixel_total : 23906 time to create 1 rle with old method : 0.028645992279052734 length of segment : 207 time for calcul the mask position with numpy : 0.0006570816040039062 nb_pixel_total : 26155 time to create 1 rle with old method : 0.043005943298339844 length of segment : 214 time for calcul the mask position with numpy : 0.0008559226989746094 nb_pixel_total : 34499 time to create 1 rle with old method : 0.045537710189819336 length of segment : 208 time for calcul the mask position with numpy : 0.00039958953857421875 nb_pixel_total : 13010 time to create 1 rle with old method : 0.015358209609985352 length of segment : 143 time for calcul the mask position with numpy : 0.0012731552124023438 nb_pixel_total : 35923 time to create 1 rle with old method : 0.04212498664855957 length of segment : 288 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 4959 time to create 1 rle with old method : 0.005938291549682617 length of segment : 79 time for calcul the mask position with numpy : 0.004533052444458008 nb_pixel_total : 234342 time to create 1 rle with new method : 0.01214456558227539 length of segment : 484 time for calcul the mask position with numpy : 0.003257274627685547 nb_pixel_total : 72200 time to create 1 rle with old method : 0.10577797889709473 length of segment : 482 time for calcul the mask position with numpy : 0.0003914833068847656 nb_pixel_total : 12650 time to create 1 rle with old method : 0.014605045318603516 length of segment : 139 time for calcul the mask position with numpy : 0.0017697811126708984 nb_pixel_total : 88493 time to create 1 rle with old method : 0.10106706619262695 length of segment : 452 time for calcul the mask position with numpy : 0.0005946159362792969 nb_pixel_total : 11303 time to create 1 rle with old method : 0.013678789138793945 length of segment : 119 time for calcul the mask position with numpy : 0.00020885467529296875 nb_pixel_total : 8608 time to create 1 rle with old method : 0.01050257682800293 length of segment : 106 time for calcul the mask position with numpy : 0.0004930496215820312 nb_pixel_total : 18105 time to create 1 rle with old method : 0.02115607261657715 length of segment : 173 time for calcul the mask position with numpy : 0.00034046173095703125 nb_pixel_total : 14228 time to create 1 rle with old method : 0.01926708221435547 length of segment : 164 time for calcul the mask position with numpy : 0.0024061203002929688 nb_pixel_total : 111650 time to create 1 rle with old method : 0.12922954559326172 length of segment : 455 time for calcul the mask position with numpy : 0.001008749008178711 nb_pixel_total : 35803 time to create 1 rle with old method : 0.04073762893676758 length of segment : 190 time for calcul the mask position with numpy : 0.0006494522094726562 nb_pixel_total : 37653 time to create 1 rle with old method : 0.04286694526672363 length of segment : 220 time for calcul the mask position with numpy : 0.00026416778564453125 nb_pixel_total : 7175 time to create 1 rle with old method : 0.008523941040039062 length of segment : 101 time for calcul the mask position with numpy : 0.0006251335144042969 nb_pixel_total : 20485 time to create 1 rle with old method : 0.02396416664123535 length of segment : 201 time for calcul the mask position with numpy : 0.0005681514739990234 nb_pixel_total : 29032 time to create 1 rle with old method : 0.03355884552001953 length of segment : 152 time for calcul the mask position with numpy : 0.0010492801666259766 nb_pixel_total : 53123 time to create 1 rle with old method : 0.0616459846496582 length of segment : 193 time for calcul the mask position with numpy : 0.0011630058288574219 nb_pixel_total : 43359 time to create 1 rle with old method : 0.04988908767700195 length of segment : 281 time for calcul the mask position with numpy : 0.0006175041198730469 nb_pixel_total : 30685 time to create 1 rle with old method : 0.03594613075256348 length of segment : 201 time for calcul the mask position with numpy : 0.0032978057861328125 nb_pixel_total : 93409 time to create 1 rle with old method : 0.10681772232055664 length of segment : 606 time for calcul the mask position with numpy : 0.0008099079132080078 nb_pixel_total : 47332 time to create 1 rle with old method : 0.05365157127380371 length of segment : 327 time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 25767 time to create 1 rle with old method : 0.029483795166015625 length of segment : 289 time for calcul the mask position with numpy : 0.004636049270629883 nb_pixel_total : 238895 time to create 1 rle with new method : 0.01162862777709961 length of segment : 708 time for calcul the mask position with numpy : 0.0003769397735595703 nb_pixel_total : 16795 time to create 1 rle with old method : 0.019243240356445312 length of segment : 193 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 9008 time to create 1 rle with old method : 0.010850191116333008 length of segment : 84 time for calcul the mask position with numpy : 0.00026702880859375 nb_pixel_total : 14828 time to create 1 rle with old method : 0.019501686096191406 length of segment : 161 time for calcul the mask position with numpy : 0.0016002655029296875 nb_pixel_total : 20182 time to create 1 rle with old method : 0.026271820068359375 length of segment : 185 time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 27315 time to create 1 rle with old method : 0.032610416412353516 length of segment : 142 time for calcul the mask position with numpy : 0.0068280696868896484 nb_pixel_total : 277755 time to create 1 rle with new method : 0.0354609489440918 length of segment : 820 time for calcul the mask position with numpy : 0.0017316341400146484 nb_pixel_total : 99490 time to create 1 rle with old method : 0.11452484130859375 length of segment : 518 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 21866 time to create 1 rle with old method : 0.024500608444213867 length of segment : 161 time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 24984 time to create 1 rle with old method : 0.028977155685424805 length of segment : 349 time for calcul the mask position with numpy : 0.0003781318664550781 nb_pixel_total : 27399 time to create 1 rle with old method : 0.03177618980407715 length of segment : 195 time for calcul the mask position with numpy : 0.0013213157653808594 nb_pixel_total : 112181 time to create 1 rle with old method : 0.12766075134277344 length of segment : 317 time for calcul the mask position with numpy : 0.002795696258544922 nb_pixel_total : 205145 time to create 1 rle with new method : 0.009310007095336914 length of segment : 754 time for calcul the mask position with numpy : 0.0006086826324462891 nb_pixel_total : 38254 time to create 1 rle with old method : 0.0436856746673584 length of segment : 232 time for calcul the mask position with numpy : 0.001405954360961914 nb_pixel_total : 75630 time to create 1 rle with old method : 0.10151386260986328 length of segment : 417 time for calcul the mask position with numpy : 0.0020110607147216797 nb_pixel_total : 121014 time to create 1 rle with old method : 0.13606905937194824 length of segment : 487 time spent for convertir_results : 10.830033540725708 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 128 chid ids of type : 3594 Number RLEs to save : 35955 save missing photos in datou_result : time spend for datou_step_exec : 66.4179015159607 time spend to save output : 2.0753321647644043 total time spend for step 1 : 68.4932336807251 step2:crop_condition Tue May 27 21:01:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 128 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 88 About to insert : list_path_to_insert length 88 new photo from crops ! About to upload 88 photos upload in portfolio : 3736932 init cache_photo without model_param we have 88 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748372522_2144729 we have uploaded 88 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.71163249015808 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748372552_2144729 we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.944831371307373 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748372563_2144729 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.221266508102417 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748372572_2144729 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7671022415161133 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748372574_2144729 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6375503540039062 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748372576_2144729 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1598467826843262 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361377198, 1361377160, 1361377148, 1361377146, 1361377143, 1361377140, 1361377137, 1361377132] Looping around the photos to save general results len do output : 128 /1361383324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361383473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377198', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377160', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377148', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377146', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377143', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377140', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377137', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377132', None, None, None, None, None, '2969176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 392 time used for this insertion : 0.0327143669128418 save_final save missing photos in datou_result : time spend for datou_step_exec : 77.96529746055603 time spend to save output : 0.03781414031982422 total time spend for step 2 : 78.00311160087585 step3:rle_unique_nms_with_priority Tue May 27 21:02:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 128 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 8.331445217132568 time for calcul the mask position with numpy : 0.7611892223358154 nb_pixel_total : 6439438 time to create 1 rle with new method : 0.42731499671936035 time for calcul the mask position with numpy : 0.02193164825439453 nb_pixel_total : 18990 time to create 1 rle with old method : 0.023357391357421875 time for calcul the mask position with numpy : 0.02405834197998047 nb_pixel_total : 37385 time to create 1 rle with old method : 0.04410982131958008 time for calcul the mask position with numpy : 0.02102208137512207 nb_pixel_total : 22498 time to create 1 rle with old method : 0.02538895606994629 time for calcul the mask position with numpy : 0.02217698097229004 nb_pixel_total : 19644 time to create 1 rle with old method : 0.022118568420410156 time for calcul the mask position with numpy : 0.022045373916625977 nb_pixel_total : 13385 time to create 1 rle with old method : 0.01504969596862793 time for calcul the mask position with numpy : 0.022730350494384766 nb_pixel_total : 21410 time to create 1 rle with old method : 0.0243680477142334 time for calcul the mask position with numpy : 0.021431446075439453 nb_pixel_total : 9442 time to create 1 rle with old method : 0.010886669158935547 time for calcul the mask position with numpy : 0.02351236343383789 nb_pixel_total : 38280 time to create 1 rle with old method : 0.047202110290527344 time for calcul the mask position with numpy : 0.026935100555419922 nb_pixel_total : 8974 time to create 1 rle with old method : 0.01130819320678711 time for calcul the mask position with numpy : 0.024364948272705078 nb_pixel_total : 42006 time to create 1 rle with old method : 0.05983328819274902 time for calcul the mask position with numpy : 0.027907133102416992 nb_pixel_total : 54698 time to create 1 rle with old method : 0.06572651863098145 time for calcul the mask position with numpy : 0.025043249130249023 nb_pixel_total : 34361 time to create 1 rle with old method : 0.0383758544921875 time for calcul the mask position with numpy : 0.022295475006103516 nb_pixel_total : 63194 time to create 1 rle with old method : 0.0699911117553711 time for calcul the mask position with numpy : 0.023308277130126953 nb_pixel_total : 29135 time to create 1 rle with old method : 0.03241562843322754 time for calcul the mask position with numpy : 0.024723291397094727 nb_pixel_total : 158459 time to create 1 rle with new method : 0.41574811935424805 time for calcul the mask position with numpy : 0.03540611267089844 nb_pixel_total : 16202 time to create 1 rle with old method : 0.018276453018188477 time for calcul the mask position with numpy : 0.032598257064819336 nb_pixel_total : 22739 time to create 1 rle with old method : 0.029961109161376953 create new chi : 2.6203293800354004 time to delete rle : 0.019101619720458984 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 9910 TO DO : save crop sub photo not yet done ! save time : 0.779287576675415 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 7.91602897644043 time for calcul the mask position with numpy : 0.5506265163421631 nb_pixel_total : 6464370 time to create 1 rle with new method : 0.6837301254272461 time for calcul the mask position with numpy : 0.03672146797180176 nb_pixel_total : 34177 time to create 1 rle with old method : 0.0382843017578125 time for calcul the mask position with numpy : 0.03613615036010742 nb_pixel_total : 39449 time to create 1 rle with old method : 0.04438924789428711 time for calcul the mask position with numpy : 0.0351107120513916 nb_pixel_total : 12499 time to create 1 rle with old method : 0.013965845108032227 time for calcul the mask position with numpy : 0.03491711616516113 nb_pixel_total : 8805 time to create 1 rle with old method : 0.011181116104125977 time for calcul the mask position with numpy : 0.03429746627807617 nb_pixel_total : 49538 time to create 1 rle with old method : 0.05537152290344238 time for calcul the mask position with numpy : 0.0278017520904541 nb_pixel_total : 15405 time to create 1 rle with old method : 0.0175173282623291 time for calcul the mask position with numpy : 0.020920276641845703 nb_pixel_total : 8325 time to create 1 rle with old method : 0.009107589721679688 time for calcul the mask position with numpy : 0.021187543869018555 nb_pixel_total : 45598 time to create 1 rle with old method : 0.05086874961853027 time for calcul the mask position with numpy : 0.02344512939453125 nb_pixel_total : 22726 time to create 1 rle with old method : 0.02577662467956543 time for calcul the mask position with numpy : 0.022258281707763672 nb_pixel_total : 59897 time to create 1 rle with old method : 0.06578564643859863 time for calcul the mask position with numpy : 0.02718973159790039 nb_pixel_total : 119688 time to create 1 rle with old method : 0.16082310676574707 time for calcul the mask position with numpy : 0.024337053298950195 nb_pixel_total : 34377 time to create 1 rle with old method : 0.03874969482421875 time for calcul the mask position with numpy : 0.021952152252197266 nb_pixel_total : 19317 time to create 1 rle with old method : 0.021358489990234375 time for calcul the mask position with numpy : 0.03388094902038574 nb_pixel_total : 18552 time to create 1 rle with old method : 0.021083593368530273 time for calcul the mask position with numpy : 0.03526926040649414 nb_pixel_total : 14836 time to create 1 rle with old method : 0.018187761306762695 time for calcul the mask position with numpy : 0.03485751152038574 nb_pixel_total : 20141 time to create 1 rle with old method : 0.022422313690185547 time for calcul the mask position with numpy : 0.035399675369262695 nb_pixel_total : 28445 time to create 1 rle with old method : 0.0311739444732666 time for calcul the mask position with numpy : 0.03166818618774414 nb_pixel_total : 34095 time to create 1 rle with old method : 0.03706812858581543 create new chi : 2.49265193939209 time to delete rle : 0.0017714500427246094 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 11073 TO DO : save crop sub photo not yet done ! save time : 0.6799330711364746 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.7281975746154785 time for calcul the mask position with numpy : 0.6268043518066406 nb_pixel_total : 6764534 time to create 1 rle with new method : 0.38588976860046387 time for calcul the mask position with numpy : 0.021703481674194336 nb_pixel_total : 24607 time to create 1 rle with old method : 0.027637958526611328 time for calcul the mask position with numpy : 0.0237886905670166 nb_pixel_total : 15860 time to create 1 rle with old method : 0.01773834228515625 time for calcul the mask position with numpy : 0.021921873092651367 nb_pixel_total : 25350 time to create 1 rle with old method : 0.028307199478149414 time for calcul the mask position with numpy : 0.02251744270324707 nb_pixel_total : 19005 time to create 1 rle with old method : 0.026969432830810547 time for calcul the mask position with numpy : 0.024852514266967773 nb_pixel_total : 17471 time to create 1 rle with old method : 0.029108524322509766 time for calcul the mask position with numpy : 0.021466970443725586 nb_pixel_total : 7115 time to create 1 rle with old method : 0.008077383041381836 time for calcul the mask position with numpy : 0.021964550018310547 nb_pixel_total : 41026 time to create 1 rle with old method : 0.04640388488769531 time for calcul the mask position with numpy : 0.02403569221496582 nb_pixel_total : 39171 time to create 1 rle with old method : 0.04597187042236328 time for calcul the mask position with numpy : 0.023502349853515625 nb_pixel_total : 7150 time to create 1 rle with old method : 0.008057832717895508 time for calcul the mask position with numpy : 0.02205514907836914 nb_pixel_total : 22236 time to create 1 rle with old method : 0.024835824966430664 time for calcul the mask position with numpy : 0.02186298370361328 nb_pixel_total : 12401 time to create 1 rle with old method : 0.013884544372558594 time for calcul the mask position with numpy : 0.035581111907958984 nb_pixel_total : 54314 time to create 1 rle with old method : 0.06518220901489258 create new chi : 1.6781983375549316 time to delete rle : 0.0014371871948242188 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 7476 TO DO : save crop sub photo not yet done ! save time : 0.5120100975036621 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 5.995524883270264 time for calcul the mask position with numpy : 0.515693187713623 nb_pixel_total : 5591462 time to create 1 rle with new method : 1.8659110069274902 time for calcul the mask position with numpy : 0.034417152404785156 nb_pixel_total : 106664 time to create 1 rle with old method : 0.11803865432739258 time for calcul the mask position with numpy : 0.025554180145263672 nb_pixel_total : 49920 time to create 1 rle with old method : 0.05415487289428711 time for calcul the mask position with numpy : 0.02506852149963379 nb_pixel_total : 43458 time to create 1 rle with old method : 0.047493934631347656 time for calcul the mask position with numpy : 0.02535104751586914 nb_pixel_total : 26276 time to create 1 rle with old method : 0.028848648071289062 time for calcul the mask position with numpy : 0.021660327911376953 nb_pixel_total : 17710 time to create 1 rle with old method : 0.019241809844970703 time for calcul the mask position with numpy : 0.02125072479248047 nb_pixel_total : 15968 time to create 1 rle with old method : 0.017652511596679688 time for calcul the mask position with numpy : 0.022687673568725586 nb_pixel_total : 140078 time to create 1 rle with old method : 0.1783435344696045 time for calcul the mask position with numpy : 0.021967411041259766 nb_pixel_total : 155797 time to create 1 rle with new method : 0.6183278560638428 time for calcul the mask position with numpy : 0.02120351791381836 nb_pixel_total : 36127 time to create 1 rle with old method : 0.03955507278442383 time for calcul the mask position with numpy : 0.021824121475219727 nb_pixel_total : 26299 time to create 1 rle with old method : 0.029200315475463867 time for calcul the mask position with numpy : 0.022074222564697266 nb_pixel_total : 13473 time to create 1 rle with old method : 0.016576766967773438 time for calcul the mask position with numpy : 0.023395776748657227 nb_pixel_total : 210687 time to create 1 rle with new method : 0.6578524112701416 time for calcul the mask position with numpy : 0.021912336349487305 nb_pixel_total : 72022 time to create 1 rle with old method : 0.07832908630371094 time for calcul the mask position with numpy : 0.022727251052856445 nb_pixel_total : 88888 time to create 1 rle with old method : 0.09670639038085938 time for calcul the mask position with numpy : 0.023505210876464844 nb_pixel_total : 320338 time to create 1 rle with new method : 0.6653275489807129 time for calcul the mask position with numpy : 0.033814430236816406 nb_pixel_total : 100587 time to create 1 rle with old method : 0.11715030670166016 time for calcul the mask position with numpy : 0.03441667556762695 nb_pixel_total : 34486 time to create 1 rle with old method : 0.0382387638092041 create new chi : 5.735613584518433 time to delete rle : 0.0021581649780273438 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14368 TO DO : save crop sub photo not yet done ! save time : 0.8366248607635498 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 7.765442371368408 time for calcul the mask position with numpy : 0.5588054656982422 nb_pixel_total : 5560726 time to create 1 rle with new method : 0.7973554134368896 time for calcul the mask position with numpy : 0.020499229431152344 nb_pixel_total : 242 time to create 1 rle with old method : 0.00034236907958984375 time for calcul the mask position with numpy : 0.021239519119262695 nb_pixel_total : 13317 time to create 1 rle with old method : 0.015200376510620117 time for calcul the mask position with numpy : 0.02130436897277832 nb_pixel_total : 1126 time to create 1 rle with old method : 0.001415252685546875 time for calcul the mask position with numpy : 0.024175167083740234 nb_pixel_total : 38844 time to create 1 rle with old method : 0.043486595153808594 time for calcul the mask position with numpy : 0.021777629852294922 nb_pixel_total : 15727 time to create 1 rle with old method : 0.0171658992767334 time for calcul the mask position with numpy : 0.020554304122924805 nb_pixel_total : 34419 time to create 1 rle with old method : 0.03747153282165527 time for calcul the mask position with numpy : 0.019974231719970703 nb_pixel_total : 41216 time to create 1 rle with old method : 0.045540571212768555 time for calcul the mask position with numpy : 0.02247476577758789 nb_pixel_total : 22195 time to create 1 rle with old method : 0.024417638778686523 time for calcul the mask position with numpy : 0.020784854888916016 nb_pixel_total : 17626 time to create 1 rle with old method : 0.019518613815307617 time for calcul the mask position with numpy : 0.020786285400390625 nb_pixel_total : 9887 time to create 1 rle with old method : 0.010905265808105469 time for calcul the mask position with numpy : 0.025088071823120117 nb_pixel_total : 128214 time to create 1 rle with old method : 0.13870954513549805 time for calcul the mask position with numpy : 0.021827220916748047 nb_pixel_total : 11292 time to create 1 rle with old method : 0.012377500534057617 time for calcul the mask position with numpy : 0.021625041961669922 nb_pixel_total : 64270 time to create 1 rle with old method : 0.06900191307067871 time for calcul the mask position with numpy : 0.02068781852722168 nb_pixel_total : 56861 time to create 1 rle with old method : 0.06082487106323242 time for calcul the mask position with numpy : 0.021676063537597656 nb_pixel_total : 168409 time to create 1 rle with new method : 0.6629893779754639 time for calcul the mask position with numpy : 0.020280838012695312 nb_pixel_total : 54953 time to create 1 rle with old method : 0.05810046195983887 time for calcul the mask position with numpy : 0.02104353904724121 nb_pixel_total : 234985 time to create 1 rle with new method : 0.5395667552947998 time for calcul the mask position with numpy : 0.020219802856445312 nb_pixel_total : 44130 time to create 1 rle with old method : 0.046509504318237305 time for calcul the mask position with numpy : 0.0209658145904541 nb_pixel_total : 16312 time to create 1 rle with old method : 0.017511367797851562 time for calcul the mask position with numpy : 0.019588232040405273 nb_pixel_total : 4539 time to create 1 rle with old method : 0.004755735397338867 time for calcul the mask position with numpy : 0.023411035537719727 nb_pixel_total : 473876 time to create 1 rle with new method : 0.58902907371521 time for calcul the mask position with numpy : 0.020626306533813477 nb_pixel_total : 26753 time to create 1 rle with old method : 0.02866506576538086 time for calcul the mask position with numpy : 0.020545244216918945 nb_pixel_total : 10321 time to create 1 rle with old method : 0.011180639266967773 create new chi : 4.4032814502716064 time to delete rle : 0.001973867416381836 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 14521 TO DO : save crop sub photo not yet done ! save time : 0.8880214691162109 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 7.888854503631592 time for calcul the mask position with numpy : 0.5763635635375977 nb_pixel_total : 6013968 time to create 1 rle with new method : 0.8733325004577637 time for calcul the mask position with numpy : 0.040236473083496094 nb_pixel_total : 92832 time to create 1 rle with old method : 0.10045480728149414 time for calcul the mask position with numpy : 0.03252053260803223 nb_pixel_total : 30685 time to create 1 rle with old method : 0.0315699577331543 time for calcul the mask position with numpy : 0.03417205810546875 nb_pixel_total : 43359 time to create 1 rle with old method : 0.049278974533081055 time for calcul the mask position with numpy : 0.03936457633972168 nb_pixel_total : 53123 time to create 1 rle with old method : 0.07037639617919922 time for calcul the mask position with numpy : 0.035246849060058594 nb_pixel_total : 29032 time to create 1 rle with old method : 0.03308391571044922 time for calcul the mask position with numpy : 0.02080559730529785 nb_pixel_total : 20485 time to create 1 rle with old method : 0.026433944702148438 time for calcul the mask position with numpy : 0.02306842803955078 nb_pixel_total : 7175 time to create 1 rle with old method : 0.008216142654418945 time for calcul the mask position with numpy : 0.021203041076660156 nb_pixel_total : 37653 time to create 1 rle with old method : 0.04155135154724121 time for calcul the mask position with numpy : 0.021175146102905273 nb_pixel_total : 35803 time to create 1 rle with old method : 0.04039621353149414 time for calcul the mask position with numpy : 0.022540807723999023 nb_pixel_total : 111650 time to create 1 rle with old method : 0.12775421142578125 time for calcul the mask position with numpy : 0.021514177322387695 nb_pixel_total : 14228 time to create 1 rle with old method : 0.016231060028076172 time for calcul the mask position with numpy : 0.02112102508544922 nb_pixel_total : 18105 time to create 1 rle with old method : 0.020145416259765625 time for calcul the mask position with numpy : 0.020747661590576172 nb_pixel_total : 8608 time to create 1 rle with old method : 0.009868621826171875 time for calcul the mask position with numpy : 0.0205533504486084 nb_pixel_total : 11303 time to create 1 rle with old method : 0.012696027755737305 time for calcul the mask position with numpy : 0.033930063247680664 nb_pixel_total : 88493 time to create 1 rle with old method : 0.10927629470825195 time for calcul the mask position with numpy : 0.0339512825012207 nb_pixel_total : 12650 time to create 1 rle with old method : 0.014333248138427734 time for calcul the mask position with numpy : 0.03425264358520508 nb_pixel_total : 72200 time to create 1 rle with old method : 0.07979440689086914 time for calcul the mask position with numpy : 0.036310672760009766 nb_pixel_total : 234342 time to create 1 rle with new method : 0.5044691562652588 time for calcul the mask position with numpy : 0.03275036811828613 nb_pixel_total : 4959 time to create 1 rle with old method : 0.00537562370300293 time for calcul the mask position with numpy : 0.03318214416503906 nb_pixel_total : 35923 time to create 1 rle with old method : 0.03948688507080078 time for calcul the mask position with numpy : 0.033155202865600586 nb_pixel_total : 13010 time to create 1 rle with old method : 0.014203548431396484 time for calcul the mask position with numpy : 0.032039642333984375 nb_pixel_total : 34499 time to create 1 rle with old method : 0.03785586357116699 time for calcul the mask position with numpy : 0.03161001205444336 nb_pixel_total : 26155 time to create 1 rle with old method : 0.029389142990112305 create new chi : 3.613039970397949 time to delete rle : 0.0028159618377685547 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 13280 TO DO : save crop sub photo not yet done ! save time : 0.8201704025268555 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 4.654564142227173 time for calcul the mask position with numpy : 0.39156198501586914 nb_pixel_total : 6267538 time to create 1 rle with new method : 1.024097204208374 time for calcul the mask position with numpy : 0.03853869438171387 nb_pixel_total : 21866 time to create 1 rle with old method : 0.02478194236755371 time for calcul the mask position with numpy : 0.035875797271728516 nb_pixel_total : 99490 time to create 1 rle with old method : 0.11101174354553223 time for calcul the mask position with numpy : 0.03556060791015625 nb_pixel_total : 277755 time to create 1 rle with new method : 0.6979007720947266 time for calcul the mask position with numpy : 0.03521323204040527 nb_pixel_total : 27315 time to create 1 rle with old method : 0.029466629028320312 time for calcul the mask position with numpy : 0.02240276336669922 nb_pixel_total : 3651 time to create 1 rle with old method : 0.004158973693847656 time for calcul the mask position with numpy : 0.023083925247192383 nb_pixel_total : 14828 time to create 1 rle with old method : 0.016732454299926758 time for calcul the mask position with numpy : 0.023260831832885742 nb_pixel_total : 9008 time to create 1 rle with old method : 0.010151386260986328 time for calcul the mask position with numpy : 0.021944522857666016 nb_pixel_total : 16795 time to create 1 rle with old method : 0.01924443244934082 time for calcul the mask position with numpy : 0.02685546875 nb_pixel_total : 238895 time to create 1 rle with new method : 0.6288301944732666 time for calcul the mask position with numpy : 0.02255725860595703 nb_pixel_total : 25767 time to create 1 rle with old method : 0.0325925350189209 time for calcul the mask position with numpy : 0.03256487846374512 nb_pixel_total : 47332 time to create 1 rle with old method : 0.05556607246398926 create new chi : 3.451624870300293 time to delete rle : 0.002074718475341797 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9067 TO DO : save crop sub photo not yet done ! save time : 0.560295820236206 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.07869553565979 time for calcul the mask position with numpy : 0.49114084243774414 nb_pixel_total : 6445633 time to create 1 rle with new method : 0.7985997200012207 time for calcul the mask position with numpy : 0.03629875183105469 nb_pixel_total : 121014 time to create 1 rle with old method : 0.14003968238830566 time for calcul the mask position with numpy : 0.03455710411071777 nb_pixel_total : 75630 time to create 1 rle with old method : 0.0828104019165039 time for calcul the mask position with numpy : 0.021440744400024414 nb_pixel_total : 38254 time to create 1 rle with old method : 0.0428462028503418 time for calcul the mask position with numpy : 0.02267003059387207 nb_pixel_total : 205145 time to create 1 rle with new method : 0.5866236686706543 time for calcul the mask position with numpy : 0.021216154098510742 nb_pixel_total : 112181 time to create 1 rle with old method : 0.12387466430664062 time for calcul the mask position with numpy : 0.020907878875732422 nb_pixel_total : 27399 time to create 1 rle with old method : 0.030124425888061523 time for calcul the mask position with numpy : 0.020790815353393555 nb_pixel_total : 24984 time to create 1 rle with old method : 0.027453899383544922 create new chi : 2.5624451637268066 time to delete rle : 0.0017409324645996094 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7662 TO DO : save crop sub photo not yet done ! save time : 0.481187105178833 map_output_result : {1361377198: (0.0, 'Should be the crop_list due to order', 0), 1361377160: (0.0, 'Should be the crop_list due to order', 0), 1361377148: (0.0, 'Should be the crop_list due to order', 0), 1361377146: (0.0, 'Should be the crop_list due to order', 0), 1361377143: (0.0, 'Should be the crop_list due to order', 0), 1361377140: (0.0, 'Should be the crop_list due to order', 0), 1361377137: (0.0, 'Should be the crop_list due to order', 0), 1361377132: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361377198, 1361377160, 1361377148, 1361377146, 1361377143, 1361377140, 1361377137, 1361377132] Looping around the photos to save general results len do output : 8 /1361377198.Didn't retrieve data . /1361377160.Didn't retrieve data . /1361377148.Didn't retrieve data . /1361377146.Didn't retrieve data . /1361377143.Didn't retrieve data . /1361377140.Didn't retrieve data . /1361377137.Didn't retrieve data . /1361377132.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377198', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377160', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377148', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377146', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377143', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377140', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377137', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377132', None, None, None, None, None, '2969176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.014313459396362305 save_final save missing photos in datou_result : time spend for datou_step_exec : 83.50121426582336 time spend to save output : 0.014747858047485352 total time spend for step 3 : 83.51596212387085 step4:ventilate_hashtags_in_portfolio Tue May 27 21:04:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23391048 get user id for portfolio 23391048 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23391048 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','mal_croppe','background','carton','papier','metal','pehd','pet_fonce','autre','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23391048 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','mal_croppe','background','carton','papier','metal','pehd','pet_fonce','autre','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23391048 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','mal_croppe','background','carton','papier','metal','pehd','pet_fonce','autre','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23391410,23391411,23391412,23391413,23391414,23391415,23391416,23391417,23391418,23391419,23391420?tags=flou,pet_clair,mal_croppe,background,carton,papier,metal,pehd,pet_fonce,autre,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361377198, 1361377160, 1361377148, 1361377146, 1361377143, 1361377140, 1361377137, 1361377132] Looping around the photos to save general results len do output : 1 /23391048. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377198', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377160', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377148', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377146', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377143', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377140', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377137', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377132', None, None, None, None, None, '2969176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013688087463378906 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5640485286712646 time spend to save output : 0.013933897018432617 total time spend for step 4 : 1.5779824256896973 step5:final Tue May 27 21:04:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361377198: ('0.1215251360237382',), 1361377160: ('0.1215251360237382',), 1361377148: ('0.1215251360237382',), 1361377146: ('0.1215251360237382',), 1361377143: ('0.1215251360237382',), 1361377140: ('0.1215251360237382',), 1361377137: ('0.1215251360237382',), 1361377132: ('0.1215251360237382',)} new output for save of step final : {1361377198: ('0.1215251360237382',), 1361377160: ('0.1215251360237382',), 1361377148: ('0.1215251360237382',), 1361377146: ('0.1215251360237382',), 1361377143: ('0.1215251360237382',), 1361377140: ('0.1215251360237382',), 1361377137: ('0.1215251360237382',), 1361377132: ('0.1215251360237382',)} [1361377198, 1361377160, 1361377148, 1361377146, 1361377143, 1361377140, 1361377137, 1361377132] Looping around the photos to save general results len do output : 8 /1361377198.Didn't retrieve data . /1361377160.Didn't retrieve data . /1361377148.Didn't retrieve data . /1361377146.Didn't retrieve data . /1361377143.Didn't retrieve data . /1361377140.Didn't retrieve data . /1361377137.Didn't retrieve data . /1361377132.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377198', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377160', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377148', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377146', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377143', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377140', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377137', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377132', None, None, None, None, None, '2969176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012555599212646484 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11188316345214844 time spend to save output : 0.013003826141357422 total time spend for step 5 : 0.12488698959350586 step6:blur_detection Tue May 27 21:04:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92.jpg resize: (2160, 3264) 1361377198 0.5046899442744839 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08.jpg resize: (2160, 3264) 1361377160 -2.1754938292095853 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1.jpg resize: (2160, 3264) 1361377148 -3.1914406808884492 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4.jpg resize: (2160, 3264) 1361377146 -3.430937316149116 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23.jpg resize: (2160, 3264) 1361377143 -0.8821255517431328 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723.jpg resize: (2160, 3264) 1361377140 -1.6136325236581348 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497.jpg resize: (2160, 3264) 1361377137 0.9054162927407533 treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038.jpg resize: (2160, 3264) 1361377132 -2.0700479959699893 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442032_0.png resize: (205, 176) 1361383324 -0.8960752556947601 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442033_0.png resize: (212, 120) 1361383325 -1.1649794829247084 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442034_0.png resize: (269, 734) 1361383326 -0.2036089986093664 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442035_0.png resize: (185, 217) 1361383327 -1.0074920704862085 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442036_0.png resize: (214, 335) 1361383328 1.9861093949962247 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442037_0.png resize: (177, 252) 1361383329 -0.0568605056494396 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442038_0.png resize: (336, 209) 1361383330 -1.1685406627036508 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442039_0.png resize: (324, 252) 1361383331 -2.559250469859057 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442040_0.png resize: (133, 85) 1361383332 2.9956283875899827 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442042_0.png resize: (137, 183) 1361383333 -1.5804821034531342 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442043_0.png resize: (167, 180) 1361383334 0.41349476455455336 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442045_0.png resize: (222, 178) 1361383335 -1.0916726263354648 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442046_0.png resize: (209, 201) 1361383336 -0.5673165584508469 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442049_0.png resize: (175, 230) 1361383337 4.570969409406592 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442050_0.png resize: (232, 183) 1361383338 -1.342248740063447 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442051_0.png resize: (260, 117) 1361383339 -1.0744624059186965 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442052_0.png resize: (170, 170) 1361383340 -2.8549661323181477 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442053_0.png resize: (222, 134) 1361383341 -1.466497310550027 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442054_0.png resize: (156, 199) 1361383342 -2.927185029912485 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442056_0.png resize: (515, 522) 1361383343 -2.365385773732126 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442057_0.png resize: (298, 293) 1361383344 -0.8037028662647936 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442058_0.png resize: (227, 140) 1361383345 -0.1274523872468357 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442061_0.png resize: (194, 248) 1361383346 -1.4862598586415907 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442063_0.png resize: (138, 103) 1361383347 -0.6441477224077983 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442064_0.png resize: (115, 135) 1361383348 -0.2918862427876878 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442069_0.png resize: (219, 192) 1361383349 -1.7294895990045978 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442070_0.png resize: (125, 69) 1361383350 -0.7614045719875976 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442071_0.png resize: (210, 278) 1361383352 -1.0868179765092474 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442073_0.png resize: (127, 79) 1361383353 -0.9275691540135513 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442074_0.png resize: (169, 245) 1361383354 -3.1650840034508647 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442075_0.png resize: (225, 175) 1361383355 -2.0405609770377624 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442077_0.png resize: (150, 165) 1361383356 -1.7235264544958837 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442078_0.png resize: (188, 209) 1361383357 -1.7186727281047869 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442079_0.png resize: (296, 157) 1361383358 -0.3255162674622382 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442080_0.png resize: (530, 278) 1361383359 -1.3877584260261753 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442081_0.png resize: (611, 1069) 1361383360 -2.440783989970311 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442082_0.png resize: (435, 300) 1361383361 -0.7119652830795604 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442083_0.png resize: (479, 294) 1361383362 -1.8656501058862327 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442085_0.png resize: (214, 103) 1361383363 -1.4436199325958967 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442087_0.png resize: (263, 183) 1361383364 -2.169415039549729 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442092_0.png resize: (302, 220) 1361383365 -1.1314660540069372 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442094_0.png resize: (299, 253) 1361383366 -2.0756478635756372 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442096_0.png resize: (148, 113) 1361383367 -0.9115082711463014 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442097_0.png resize: (324, 192) 1361383368 -1.8270754242599774 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442099_0.png resize: (199, 57) 1361383369 -0.618534537508654 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442100_0.png resize: (83, 268) 1361383370 0.2697840814117043 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442101_0.png resize: (235, 275) 1361383371 -0.15032736677970004 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442103_0.png resize: (407, 200) 1361383372 -1.4921762035534605 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442104_0.png resize: (480, 540) 1361383374 -0.5635061266331103 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442105_0.png resize: (260, 313) 1361383375 -1.3038836157112927 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442107_0.png resize: (109, 138) 1361383376 -0.06825282223763589 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442108_0.png resize: (500, 664) 1361383377 -1.4702017857243233 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442109_0.png resize: (108, 124) 1361383378 -0.24164031148884724 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442110_0.png resize: (166, 174) 1361383379 -0.24006604090136235 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442114_0.png resize: (156, 292) 1361383380 -0.8543500077737477 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442115_0.png resize: (247, 282) 1361383381 -0.14898213561178658 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442117_0.png resize: (91, 236) 1361383382 -1.0208378792037711 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442118_0.png resize: (164, 215) 1361383383 -2.12995444880498 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442119_0.png resize: (212, 183) 1361383384 -0.8119472885823807 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442120_0.png resize: (208, 272) 1361383385 0.17324376958578963 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442121_0.png resize: (143, 142) 1361383386 -0.09116064108615604 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442123_0.png resize: (78, 85) 1361383387 -0.2524168099917141 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442124_0.png resize: (481, 559) 1361383388 0.31030825789248473 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442125_0.png resize: (455, 251) 1361383389 -0.34088092466696196 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442126_0.png resize: (132, 130) 1361383390 -0.5619983257679174 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442127_0.png resize: (435, 333) 1361383392 0.8544162379101222 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442128_0.png resize: (119, 166) 1361383393 -1.7770288648802495 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442129_0.png resize: (106, 112) 1361383395 -0.8411975054651567 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442130_0.png resize: (173, 145) 1361383396 -1.4303046581103165 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442133_0.png resize: (188, 266) 1361383397 -0.7864107101970632 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442135_0.png resize: (100, 107) 1361383398 -2.271160130393911 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442136_0.png resize: (154, 184) 1361383399 -1.5726676107771052 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442140_0.png resize: (201, 247) 1361383400 -0.9992367441592105 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442141_0.png resize: (606, 443) 1361383401 -0.7355656200639259 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442142_0.png resize: (324, 215) 1361383402 -1.1002315313803608 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442143_0.png resize: (248, 253) 1361383403 -1.1900462892968786 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442144_0.png resize: (704, 505) 1361383404 -0.4092807346252954 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442145_0.png resize: (163, 176) 1361383405 -2.198743349557462 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442146_0.png resize: (83, 139) 1361383406 1.0516336254434817 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442147_0.png resize: (161, 113) 1361383407 3.2948109064155315 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442148_0.png resize: (128, 359) 1361383408 -2.36886941280155 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442149_0.png resize: (142, 232) 1361383409 -0.017341965429151066 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442150_0.png resize: (763, 601) 1361383410 0.033028086103424795 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442151_0.png resize: (518, 321) 1361383411 0.3515037620289905 treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442153_0.png resize: (254, 184) 1361383412 -1.2932525329216884 treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442156_0.png resize: (637, 465) 1361383413 -0.3413752804164194 treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442157_0.png resize: (221, 219) 1361383414 -0.932175207591836 treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442159_0.png resize: (444, 453) 1361383415 -0.11291397418155756 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442041_0.png resize: (219, 222) 1361383424 0.25624048874551036 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442044_0.png resize: (150, 144) 1361383425 -0.701335580856373 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442060_0.png resize: (133, 93) 1361383426 -0.6027699408375434 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442062_0.png resize: (226, 383) 1361383427 -1.1839945479631673 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442068_0.png resize: (163, 108) 1361383428 -1.2776441251902133 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442090_0.png resize: (101, 226) 1361383429 -1.6938960575134163 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442095_0.png resize: (261, 647) 1361383430 -0.6899719165478436 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442098_0.png resize: (824, 648) 1361383431 -0.8905567013651111 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442113_0.png resize: (376, 626) 1361383432 -0.5744666913081933 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442116_0.png resize: (374, 131) 1361383433 -0.8838396343849759 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442131_0.png resize: (163, 129) 1361383434 -1.0816462175968504 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442137_0.png resize: (146, 280) 1361383435 -0.6047435695813579 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442047_0.png resize: (195, 233) 1361383442 -0.5888494814182165 treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442048_0.png resize: (132, 190) 1361383443 -1.5181413652478817 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442055_0.png resize: (202, 231) 1361383444 -2.570391649957669 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442065_0.png resize: (257, 255) 1361383445 -2.008711589217576 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442067_0.png resize: (231, 351) 1361383446 -1.7321111433595746 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442072_0.png resize: (243, 255) 1361383447 -3.454857412905306 treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442076_0.png resize: (187, 197) 1361383448 -1.0137362649180497 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442084_0.png resize: (548, 594) 1361383449 -3.810264925850514 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442086_0.png resize: (169, 207) 1361383450 -2.804375595455566 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442088_0.png resize: (380, 708) 1361383451 -4.099673503424104 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442089_0.png resize: (399, 648) 1361383452 -2.414770791456337 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442091_0.png resize: (138, 194) 1361383453 -3.101096211707518 treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442093_0.png resize: (125, 475) 1361383455 -1.4617640097526465 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442102_0.png resize: (435, 726) 1361383456 -0.7545342885048224 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442106_0.png resize: (219, 381) 1361383457 -0.6359507724167363 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442112_0.png resize: (183, 366) 1361383458 -1.8426555800409292 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442122_0.png resize: (286, 161) 1361383459 -1.6506022541048468 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442132_0.png resize: (455, 329) 1361383460 -0.6088653926774374 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442138_0.png resize: (187, 406) 1361383461 0.8090269690550841 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442139_0.png resize: (276, 202) 1361383462 -1.4053647074960105 treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442152_0.png resize: (161, 178) 1361383463 -0.6328069095185421 treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442154_0.png resize: (188, 182) 1361383464 -0.840157777146135 treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442134_0.png resize: (220, 207) 1361383467 0.14873601527371094 treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442155_0.png resize: (263, 575) 1361383468 0.3152516613312101 treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442158_0.png resize: (414, 281) 1361383469 -1.2208603269435805 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442059_0.png resize: (270, 222) 1361383471 -2.0073298293227215 treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442066_0.png resize: (270, 175) 1361383472 -1.2624946799359367 treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442111_0.png resize: (189, 149) 1361383473 -0.32651909075844215 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 136 time used for this insertion : 0.018962860107421875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 136 time used for this insertion : 0.03060293197631836 save missing photos in datou_result : time spend for datou_step_exec : 31.45933246612549 time spend to save output : 0.05807304382324219 total time spend for step 6 : 31.51740550994873 step7:brightness Tue May 27 21:04:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92.jpg treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08.jpg treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1.jpg treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4.jpg treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23.jpg treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723.jpg treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497.jpg treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038.jpg treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442032_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442033_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442034_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442035_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442036_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442037_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442038_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442039_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442040_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442042_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442043_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442045_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442046_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442049_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442050_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442051_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442052_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442053_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442054_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442056_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442057_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442058_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442061_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442063_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442064_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442069_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442070_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442071_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442073_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442074_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442075_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442077_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442078_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442079_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442080_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442081_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442082_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442083_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442085_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442087_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442092_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442094_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442096_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442097_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442099_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442100_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442101_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442103_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442104_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442105_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442107_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442108_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442109_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442110_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442114_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442115_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442117_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442118_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442119_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442120_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442121_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442123_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442124_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442125_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442126_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442127_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442128_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442129_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442130_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442133_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442135_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442136_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442140_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442141_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442142_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442143_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442144_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442145_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442146_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442147_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442148_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442149_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442150_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442151_0.png treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442153_0.png treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442156_0.png treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442157_0.png treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442159_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442041_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442044_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442060_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442062_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442068_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442090_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442095_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442098_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442113_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442116_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442131_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442137_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442047_0.png treat image : temp/1748372429_2144729_1361377198_5e79bb02be861127008e0878f22cba92_rle_crop_3814442048_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442055_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442065_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442067_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442072_0.png treat image : temp/1748372429_2144729_1361377148_38eb8fb29bae907131bb691d32672da1_rle_crop_3814442076_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442084_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442086_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442088_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442089_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442091_0.png treat image : temp/1748372429_2144729_1361377146_fdd15dda786914008faf66442c65e9b4_rle_crop_3814442093_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442102_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442106_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442112_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442122_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442132_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442138_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442139_0.png treat image : temp/1748372429_2144729_1361377137_d57334e43ac980385e90b5dc75e25497_rle_crop_3814442152_0.png treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442154_0.png treat image : temp/1748372429_2144729_1361377140_ab55db591c7430bd4ce7856030c43723_rle_crop_3814442134_0.png treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442155_0.png treat image : temp/1748372429_2144729_1361377132_a4beaa5ec632bc959af8d84864a27038_rle_crop_3814442158_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442059_0.png treat image : temp/1748372429_2144729_1361377160_b8496d82dfcbe4d205606bbfdc5d9e08_rle_crop_3814442066_0.png treat image : temp/1748372429_2144729_1361377143_c4c5b1503e900efb7be8a2692de92b23_rle_crop_3814442111_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 136 time used for this insertion : 0.017755508422851562 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 136 time used for this insertion : 0.027252912521362305 save missing photos in datou_result : time spend for datou_step_exec : 7.248822450637817 time spend to save output : 0.05016326904296875 total time spend for step 7 : 7.298985719680786 step8:velours_tree Tue May 27 21:05:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.19961047172546387 time spend to save output : 4.863739013671875e-05 total time spend for step 8 : 0.19965910911560059 step9:send_mail_cod Tue May 27 21:05:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23391048_27-05-2025_21_05_01.pdf 23391410 imagette233914101748372701 23391411 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233914111748372701 23391412 imagette233914121748372702 23391413 imagette233914131748372702 23391414 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233914141748372702 23391415 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233914151748372703 23391416 imagette233914161748372705 23391417 change filename to text .imagette233914171748372705 23391418 change filename to text .change filename to text .change filename to text .imagette233914181748372705 23391419 change filename to text .change filename to text .imagette233914191748372705 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23391048 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23391410,23391411,23391412,23391413,23391414,23391415,23391416,23391417,23391418,23391419,23391420?tags=flou,pet_clair,mal_croppe,background,carton,papier,metal,pehd,pet_fonce,autre,environnement args[1361377198] : ((1361377198, 0.5046899442744839, 492688767), (1361377198, 0.4945079159608938, 2107752395), '0.1215251360237382') We are sending mail with results at report@fotonower.com args[1361377160] : ((1361377160, -2.1754938292095853, 492609224), (1361377160, 0.29479775931598523, 2107752395), '0.1215251360237382') We are sending mail with results at report@fotonower.com args[1361377148] : ((1361377148, -3.1914406808884492, 492609224), (1361377148, 0.21571681473647641, 2107752395), '0.1215251360237382') We are sending mail with results at report@fotonower.com args[1361377146] : ((1361377146, -3.430937316149116, 492609224), (1361377146, 0.17818970786633784, 2107752395), '0.1215251360237382') We are sending mail with results at report@fotonower.com args[1361377143] : ((1361377143, -0.8821255517431328, 492688767), (1361377143, 0.043759777037679824, 2107752395), '0.1215251360237382') We are sending mail with results at report@fotonower.com args[1361377140] : ((1361377140, -1.6136325236581348, 492688767), (1361377140, 0.21952150490972977, 2107752395), '0.1215251360237382') We are sending mail with results at report@fotonower.com args[1361377137] : ((1361377137, 0.9054162927407533, 492688767), (1361377137, -0.3015857731457104, 496442774), '0.1215251360237382') We are sending mail with results at report@fotonower.com args[1361377132] : ((1361377132, -2.0700479959699893, 492609224), (1361377132, 0.7677828742029081, 2107752395), '0.1215251360237382') We are sending mail with results at report@fotonower.com refus_total : 0.1215251360237382 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23391048 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391048_27-05-2025_21_05_01.pdf results_Auto_P23391048_27-05-2025_21_05_01.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391048_27-05-2025_21_05_01.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23391048','results_Auto_P23391048_27-05-2025_21_05_01.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391048_27-05-2025_21_05_01.pdf','pdf','','0.63','0.1215251360237382') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23391048

https://www.fotonower.com/image?json=false&list_photos_id=1361377198
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377160
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377148
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377146
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377143
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377140
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377137
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361377132
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.15%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/23391411?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23391414?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23391415?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/23391417?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23391418?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23391419?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391048_27-05-2025_21_05_01.pdf.

Lien vers velours :https://www.fotonower.com/velours/23391410,23391411,23391412,23391413,23391414,23391415,23391416,23391417,23391418,23391419,23391420?tags=flou,pet_clair,mal_croppe,background,carton,papier,metal,pehd,pet_fonce,autre,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 27 May 2025 19:05:08 GMT Content-Length: 0 Connection: close X-Message-Id: 65H3w3evSE-8aP9Sf7xzBg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361377198, 1361377160, 1361377148, 1361377146, 1361377143, 1361377140, 1361377137, 1361377132] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377198', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377160', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377148', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377146', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377143', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377140', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377137', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377132', None, None, None, None, None, '2969176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013844728469848633 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.1671154499053955 time spend to save output : 0.014024734497070312 total time spend for step 9 : 7.181140184402466 step10:split_time_score Tue May 27 21:05:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27052025 23391048 Nombre de photos uploadées : 8 / 23040 (0%) 27052025 23391048 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 27052025 23391048 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0005152225494384766 elapsed_time : insert_dashboard_record_day_entry 0.023140907287597656 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07886007284858386 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375190_27-05-2025_12_07_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375190 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375190 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23376491 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23376512 order by id desc limit 1 Qualite : 0.05637747470621246 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23376513_27-05-2025_12_54_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23376513 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23376513 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23381745 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23381759 order by id desc limit 1 Qualite : 0.1314158414780521 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23384390_27-05-2025_17_25_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23384390 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23384390 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23388035 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23388044 order by id desc limit 1 Qualite : 0.07042170432023119 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23388048_27-05-2025_19_25_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23388048 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23388048 AND mptpi.`type`=3594 To do Qualite : 0.1215251360237382 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23391048_27-05-2025_21_05_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23391048 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23391048 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361377198, 1361377160, 1361377148, 1361377146, 1361377143, 1361377140, 1361377137, 1361377132] Looping around the photos to save general results len do output : 1 /23391048Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377198', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377160', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377148', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377146', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377143', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377140', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377137', None, None, None, None, None, '2969176') ('3318', None, None, None, None, None, None, None, '2969176') ('3318', '23391048', '1361377132', None, None, None, None, None, '2969176') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013721466064453125 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.888963222503662 time spend to save output : 0.013942480087280273 total time spend for step 10 : 5.902905702590942 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 121.13user 114.95system 4:48.61elapsed 81%CPU (0avgtext+0avgdata 5231540maxresident)k 572456inputs+73960outputs (6515major+11956981minor)pagefaults 0swaps