python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2623772 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3727823'] with mtr_portfolio_ids : ['26890528'] and first list_photo_ids : [] new path : /proc/2623772/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 28 ; length of list_pids : 28 ; length of list_args : 28 time to download the photos : 3.743326425552368 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Sep 16 12:40:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10589 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-16 12:40:34.755347: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-16 12:40:34.784485: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-16 12:40:34.790138: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd0f0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-16 12:40:34.790198: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-16 12:40:34.793504: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-16 12:40:34.945988: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x201b9b60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-16 12:40:34.946059: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-16 12:40:34.947642: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 12:40:34.948128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 12:40:34.951590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 12:40:34.954849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 12:40:34.955474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 12:40:34.959043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 12:40:34.960566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 12:40:34.966387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 12:40:34.968386: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 12:40:34.968524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 12:40:34.969526: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-16 12:40:34.969544: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-16 12:40:34.969555: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-16 12:40:34.971302: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9808 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-16 12:40:35.237947: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 12:40:35.238047: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 12:40:35.238076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 12:40:35.238101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 12:40:35.238125: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 12:40:35.238149: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 12:40:35.238174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 12:40:35.238198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 12:40:35.240290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 12:40:35.242086: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-16 12:40:35.242144: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-16 12:40:35.242174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 12:40:35.242202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-16 12:40:35.242229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-16 12:40:35.242255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-16 12:40:35.242282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-16 12:40:35.242309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-16 12:40:35.244420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-16 12:40:35.244466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-16 12:40:35.244480: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-16 12:40:35.244493: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-16 12:40:35.246030: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9808 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-16 12:40:42.499647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-16 12:40:42.655630: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 28 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 50.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 53.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 53.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 2624508 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 416 tf kernel not reseted sub process len(results) : 28 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 28 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5705 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0002186298370361328 nb_pixel_total : 4017 time to create 1 rle with old method : 0.0046002864837646484 length of segment : 105 time for calcul the mask position with numpy : 0.0005507469177246094 nb_pixel_total : 25375 time to create 1 rle with old method : 0.028885602951049805 length of segment : 196 time for calcul the mask position with numpy : 0.002136707305908203 nb_pixel_total : 120348 time to create 1 rle with old method : 0.13295435905456543 length of segment : 538 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1855 time to create 1 rle with old method : 0.0021173954010009766 length of segment : 54 time for calcul the mask position with numpy : 0.0006349086761474609 nb_pixel_total : 20948 time to create 1 rle with old method : 0.024399518966674805 length of segment : 300 time for calcul the mask position with numpy : 0.0003230571746826172 nb_pixel_total : 13070 time to create 1 rle with old method : 0.018740177154541016 length of segment : 186 time for calcul the mask position with numpy : 0.0004703998565673828 nb_pixel_total : 23559 time to create 1 rle with old method : 0.028069257736206055 length of segment : 295 time for calcul the mask position with numpy : 0.0024726390838623047 nb_pixel_total : 103336 time to create 1 rle with old method : 0.11978888511657715 length of segment : 574 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 3640 time to create 1 rle with old method : 0.0043277740478515625 length of segment : 80 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 2346 time to create 1 rle with old method : 0.0030183792114257812 length of segment : 49 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 3818 time to create 1 rle with old method : 0.0048389434814453125 length of segment : 37 time for calcul the mask position with numpy : 0.0013356208801269531 nb_pixel_total : 100348 time to create 1 rle with old method : 0.11829662322998047 length of segment : 602 time for calcul the mask position with numpy : 0.001634359359741211 nb_pixel_total : 105561 time to create 1 rle with old method : 0.12012529373168945 length of segment : 528 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 11054 time to create 1 rle with old method : 0.013478755950927734 length of segment : 116 time for calcul the mask position with numpy : 0.0004851818084716797 nb_pixel_total : 26410 time to create 1 rle with old method : 0.030662059783935547 length of segment : 197 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 6686 time to create 1 rle with old method : 0.007860660552978516 length of segment : 92 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 5550 time to create 1 rle with old method : 0.006834983825683594 length of segment : 60 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 5574 time to create 1 rle with old method : 0.006704568862915039 length of segment : 47 time for calcul the mask position with numpy : 0.0004200935363769531 nb_pixel_total : 21305 time to create 1 rle with old method : 0.025594711303710938 length of segment : 241 time for calcul the mask position with numpy : 0.0004153251647949219 nb_pixel_total : 29797 time to create 1 rle with old method : 0.03466629981994629 length of segment : 192 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 4430 time to create 1 rle with old method : 0.005501270294189453 length of segment : 72 time for calcul the mask position with numpy : 0.0001475811004638672 nb_pixel_total : 7726 time to create 1 rle with old method : 0.00949406623840332 length of segment : 157 time for calcul the mask position with numpy : 0.0002148151397705078 nb_pixel_total : 7294 time to create 1 rle with old method : 0.008937835693359375 length of segment : 171 time for calcul the mask position with numpy : 0.0018444061279296875 nb_pixel_total : 112988 time to create 1 rle with old method : 0.12825250625610352 length of segment : 583 time for calcul the mask position with numpy : 0.00017380714416503906 nb_pixel_total : 9215 time to create 1 rle with old method : 0.011188983917236328 length of segment : 271 time for calcul the mask position with numpy : 0.0013706684112548828 nb_pixel_total : 112425 time to create 1 rle with old method : 0.12889385223388672 length of segment : 284 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 2272 time to create 1 rle with old method : 0.002696514129638672 length of segment : 55 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 4072 time to create 1 rle with old method : 0.005289316177368164 length of segment : 44 time for calcul the mask position with numpy : 0.00022602081298828125 nb_pixel_total : 8448 time to create 1 rle with old method : 0.010360002517700195 length of segment : 180 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 22151 time to create 1 rle with old method : 0.026642799377441406 length of segment : 155 time for calcul the mask position with numpy : 0.0319826602935791 nb_pixel_total : 1303903 time to create 1 rle with new method : 0.07437515258789062 length of segment : 1167 time for calcul the mask position with numpy : 0.0004982948303222656 nb_pixel_total : 17717 time to create 1 rle with old method : 0.020732641220092773 length of segment : 174 time for calcul the mask position with numpy : 0.011201143264770508 nb_pixel_total : 598606 time to create 1 rle with new method : 0.17306995391845703 length of segment : 1160 time for calcul the mask position with numpy : 0.00035071372985839844 nb_pixel_total : 20318 time to create 1 rle with old method : 0.024075031280517578 length of segment : 182 time for calcul the mask position with numpy : 0.0009109973907470703 nb_pixel_total : 39804 time to create 1 rle with old method : 0.05021262168884277 length of segment : 179 time for calcul the mask position with numpy : 0.0021200180053710938 nb_pixel_total : 113614 time to create 1 rle with old method : 0.13403773307800293 length of segment : 490 time for calcul the mask position with numpy : 0.0005273818969726562 nb_pixel_total : 7388 time to create 1 rle with old method : 0.008956432342529297 length of segment : 184 time for calcul the mask position with numpy : 0.0005748271942138672 nb_pixel_total : 15622 time to create 1 rle with old method : 0.018229961395263672 length of segment : 326 time for calcul the mask position with numpy : 0.0005307197570800781 nb_pixel_total : 24323 time to create 1 rle with old method : 0.028522491455078125 length of segment : 260 time for calcul the mask position with numpy : 0.00025725364685058594 nb_pixel_total : 13030 time to create 1 rle with old method : 0.015650272369384766 length of segment : 109 time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 9184 time to create 1 rle with old method : 0.01105499267578125 length of segment : 113 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 6873 time to create 1 rle with old method : 0.008383035659790039 length of segment : 69 time for calcul the mask position with numpy : 0.0006098747253417969 nb_pixel_total : 14612 time to create 1 rle with old method : 0.016878843307495117 length of segment : 213 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 5052 time to create 1 rle with old method : 0.0061283111572265625 length of segment : 71 time for calcul the mask position with numpy : 0.0004868507385253906 nb_pixel_total : 11225 time to create 1 rle with old method : 0.013068675994873047 length of segment : 173 time for calcul the mask position with numpy : 0.0005481243133544922 nb_pixel_total : 13470 time to create 1 rle with old method : 0.015736818313598633 length of segment : 149 time for calcul the mask position with numpy : 0.00012183189392089844 nb_pixel_total : 3596 time to create 1 rle with old method : 0.004453420639038086 length of segment : 80 time for calcul the mask position with numpy : 0.0002579689025878906 nb_pixel_total : 7621 time to create 1 rle with old method : 0.009482383728027344 length of segment : 125 time for calcul the mask position with numpy : 0.00037598609924316406 nb_pixel_total : 14751 time to create 1 rle with old method : 0.018152952194213867 length of segment : 173 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 7163 time to create 1 rle with old method : 0.00851583480834961 length of segment : 168 time for calcul the mask position with numpy : 0.0008101463317871094 nb_pixel_total : 41975 time to create 1 rle with old method : 0.0483396053314209 length of segment : 200 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 23793 time to create 1 rle with old method : 0.03795766830444336 length of segment : 186 time for calcul the mask position with numpy : 0.0003490447998046875 nb_pixel_total : 12869 time to create 1 rle with old method : 0.019992351531982422 length of segment : 130 time for calcul the mask position with numpy : 0.0003604888916015625 nb_pixel_total : 12036 time to create 1 rle with old method : 0.014547586441040039 length of segment : 119 time for calcul the mask position with numpy : 0.00032830238342285156 nb_pixel_total : 5960 time to create 1 rle with old method : 0.007337093353271484 length of segment : 129 time for calcul the mask position with numpy : 0.0020685195922851562 nb_pixel_total : 102445 time to create 1 rle with old method : 0.11691141128540039 length of segment : 494 time for calcul the mask position with numpy : 0.0005280971527099609 nb_pixel_total : 20097 time to create 1 rle with old method : 0.023827314376831055 length of segment : 193 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 5342 time to create 1 rle with old method : 0.006570100784301758 length of segment : 108 time for calcul the mask position with numpy : 0.0002148151397705078 nb_pixel_total : 9884 time to create 1 rle with old method : 0.012319803237915039 length of segment : 59 time for calcul the mask position with numpy : 0.0002796649932861328 nb_pixel_total : 3254 time to create 1 rle with old method : 0.004538536071777344 length of segment : 150 time for calcul the mask position with numpy : 0.0004222393035888672 nb_pixel_total : 16604 time to create 1 rle with old method : 0.01991558074951172 length of segment : 143 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 5555 time to create 1 rle with old method : 0.006539583206176758 length of segment : 170 time for calcul the mask position with numpy : 0.0010273456573486328 nb_pixel_total : 47578 time to create 1 rle with old method : 0.05682516098022461 length of segment : 159 time for calcul the mask position with numpy : 0.0010142326354980469 nb_pixel_total : 33606 time to create 1 rle with old method : 0.038884639739990234 length of segment : 322 time for calcul the mask position with numpy : 0.002458810806274414 nb_pixel_total : 110855 time to create 1 rle with old method : 0.1289982795715332 length of segment : 540 time for calcul the mask position with numpy : 0.0007450580596923828 nb_pixel_total : 31222 time to create 1 rle with old method : 0.0361170768737793 length of segment : 146 time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 10774 time to create 1 rle with old method : 0.01289677619934082 length of segment : 187 time for calcul the mask position with numpy : 0.0005109310150146484 nb_pixel_total : 10200 time to create 1 rle with old method : 0.012331008911132812 length of segment : 187 time for calcul the mask position with numpy : 0.0026960372924804688 nb_pixel_total : 124390 time to create 1 rle with old method : 0.14322924613952637 length of segment : 539 time for calcul the mask position with numpy : 0.0001659393310546875 nb_pixel_total : 3537 time to create 1 rle with old method : 0.004407405853271484 length of segment : 55 time for calcul the mask position with numpy : 0.00042176246643066406 nb_pixel_total : 11308 time to create 1 rle with old method : 0.014818906784057617 length of segment : 169 time for calcul the mask position with numpy : 0.0002636909484863281 nb_pixel_total : 4744 time to create 1 rle with old method : 0.008177518844604492 length of segment : 105 time for calcul the mask position with numpy : 0.0026102066040039062 nb_pixel_total : 111949 time to create 1 rle with old method : 0.1301586627960205 length of segment : 520 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 9864 time to create 1 rle with old method : 0.01181173324584961 length of segment : 105 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 2611 time to create 1 rle with old method : 0.0032563209533691406 length of segment : 113 time spent for convertir_results : 5.439147710800171 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 75 chid ids of type : 3594 Number RLEs to save : 17254 save missing photos in datou_result : time spend for datou_step_exec : 33.42049217224121 time spend to save output : 1.3667194843292236 total time spend for step 1 : 34.787211656570435 step2:crop_condition Tue Sep 16 12:41:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 28 ! batch 1 Loaded 75 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758019269_2623772 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.102012872695923 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758019281_2623772 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.4403271675109863 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758019297_2623772 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.008974552154541 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758019306_2623772 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8459136486053467 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1383886009, 1383885983, 1383885961, 1383885959, 1383885957, 1383885956, 1383885831, 1383885807, 1383885792, 1383885790, 1383885785, 1383885781, 1383885723, 1383885719, 1383885711, 1383885707, 1383885636, 1383885609, 1383885563, 1383885520, 1383885495, 1383885470, 1383885414, 1383885400, 1383885376, 1383885343, 1383885317, 1383885285] Looping around the photos to save general results len do output : 75 /1383889868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383889946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383890076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383886009', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885983', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885961', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885959', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885957', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885956', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885831', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885807', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885792', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885790', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885785', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885781', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885723', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885719', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885711', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885707', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885636', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885609', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885563', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885520', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885495', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885470', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885414', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885400', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885376', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885343', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885317', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885285', None, None, None, None, None, '3727823') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 253 time used for this insertion : 0.04105210304260254 save_final save missing photos in datou_result : time spend for datou_step_exec : 41.167444705963135 time spend to save output : 0.04418325424194336 total time spend for step 2 : 41.21162796020508 step3:rle_unique_nms_with_priority Tue Sep 16 12:41:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 75 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.10543394088745117 time for calcul the mask position with numpy : 0.15678000450134277 nb_pixel_total : 2069583 time to create 1 rle with new method : 0.07515096664428711 time for calcul the mask position with numpy : 0.005986928939819336 nb_pixel_total : 4017 time to create 1 rle with old method : 0.004294872283935547 create new chi : 0.25325584411621094 time to delete rle : 0.02569270133972168 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1290 TO DO : save crop sub photo not yet done ! save time : 0.12618303298950195 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.34623289108276367 time for calcul the mask position with numpy : 0.20326709747314453 nb_pixel_total : 1905341 time to create 1 rle with new method : 0.0826117992401123 time for calcul the mask position with numpy : 0.006216287612915039 nb_pixel_total : 20948 time to create 1 rle with old method : 0.023601531982421875 time for calcul the mask position with numpy : 0.006698131561279297 nb_pixel_total : 1855 time to create 1 rle with old method : 0.0020706653594970703 time for calcul the mask position with numpy : 0.006520271301269531 nb_pixel_total : 120081 time to create 1 rle with old method : 0.13660550117492676 time for calcul the mask position with numpy : 0.006360769271850586 nb_pixel_total : 25375 time to create 1 rle with old method : 0.028871536254882812 create new chi : 0.5130503177642822 time to delete rle : 0.0004391670227050781 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3185 TO DO : save crop sub photo not yet done ! save time : 0.24376463890075684 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03872108459472656 time for calcul the mask position with numpy : 0.023379802703857422 nb_pixel_total : 2060530 time to create 1 rle with new method : 0.13460898399353027 time for calcul the mask position with numpy : 0.0059583187103271484 nb_pixel_total : 13070 time to create 1 rle with old method : 0.014204025268554688 create new chi : 0.17838430404663086 time to delete rle : 0.00025773048400878906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1452 TO DO : save crop sub photo not yet done ! save time : 0.1373612880706787 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06875944137573242 time for calcul the mask position with numpy : 0.1287987232208252 nb_pixel_total : 1946705 time to create 1 rle with new method : 0.0794382095336914 time for calcul the mask position with numpy : 0.006329059600830078 nb_pixel_total : 103336 time to create 1 rle with old method : 0.1157536506652832 time for calcul the mask position with numpy : 0.005972862243652344 nb_pixel_total : 23559 time to create 1 rle with old method : 0.026125669479370117 create new chi : 0.3727147579193115 time to delete rle : 0.0002663135528564453 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2818 TO DO : save crop sub photo not yet done ! save time : 0.22263836860656738 No data in photo_id : 1383885957 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.1471259593963623 time for calcul the mask position with numpy : 0.05573272705078125 nb_pixel_total : 1963448 time to create 1 rle with new method : 0.19308257102966309 time for calcul the mask position with numpy : 0.0062258243560791016 nb_pixel_total : 100348 time to create 1 rle with old method : 0.1099088191986084 time for calcul the mask position with numpy : 0.0061609745025634766 nb_pixel_total : 3818 time to create 1 rle with old method : 0.0041961669921875 time for calcul the mask position with numpy : 0.006246328353881836 nb_pixel_total : 2346 time to create 1 rle with old method : 0.0026044845581054688 time for calcul the mask position with numpy : 0.006252765655517578 nb_pixel_total : 3640 time to create 1 rle with old method : 0.004079341888427734 create new chi : 0.4044346809387207 time to delete rle : 0.0004405975341796875 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2616 TO DO : save crop sub photo not yet done ! save time : 0.28668761253356934 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.2440805435180664 time for calcul the mask position with numpy : 0.16644883155822754 nb_pixel_total : 1862148 time to create 1 rle with new method : 0.20509886741638184 time for calcul the mask position with numpy : 0.006050825119018555 nb_pixel_total : 29797 time to create 1 rle with old method : 0.03312397003173828 time for calcul the mask position with numpy : 0.006153583526611328 nb_pixel_total : 20829 time to create 1 rle with old method : 0.02303171157836914 time for calcul the mask position with numpy : 0.005804777145385742 nb_pixel_total : 5565 time to create 1 rle with old method : 0.006562471389770508 time for calcul the mask position with numpy : 0.006117582321166992 nb_pixel_total : 5550 time to create 1 rle with old method : 0.006539344787597656 time for calcul the mask position with numpy : 0.006368875503540039 nb_pixel_total : 6686 time to create 1 rle with old method : 0.007806062698364258 time for calcul the mask position with numpy : 0.006319522857666016 nb_pixel_total : 26410 time to create 1 rle with old method : 0.029212236404418945 time for calcul the mask position with numpy : 0.0061571598052978516 nb_pixel_total : 11054 time to create 1 rle with old method : 0.012303590774536133 time for calcul the mask position with numpy : 0.006610870361328125 nb_pixel_total : 105561 time to create 1 rle with old method : 0.12124776840209961 create new chi : 0.6710071563720703 time to delete rle : 0.0006690025329589844 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 3900 TO DO : save crop sub photo not yet done ! save time : 0.28720903396606445 No data in photo_id : 1383885807 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.061376094818115234 time for calcul the mask position with numpy : 0.027745723724365234 nb_pixel_total : 2069170 time to create 1 rle with new method : 0.03152346611022949 time for calcul the mask position with numpy : 0.00598907470703125 nb_pixel_total : 4430 time to create 1 rle with old method : 0.004888296127319336 create new chi : 0.07625889778137207 time to delete rle : 0.00025391578674316406 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1224 TO DO : save crop sub photo not yet done ! save time : 0.12596988677978516 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06747174263000488 time for calcul the mask position with numpy : 0.05485963821411133 nb_pixel_total : 1936377 time to create 1 rle with new method : 0.15619897842407227 time for calcul the mask position with numpy : 0.006744861602783203 nb_pixel_total : 9215 time to create 1 rle with old method : 0.01319742202758789 time for calcul the mask position with numpy : 0.006563663482666016 nb_pixel_total : 112988 time to create 1 rle with old method : 0.12428116798400879 time for calcul the mask position with numpy : 0.005838871002197266 nb_pixel_total : 7294 time to create 1 rle with old method : 0.00804448127746582 time for calcul the mask position with numpy : 0.005690574645996094 nb_pixel_total : 7726 time to create 1 rle with old method : 0.008551597595214844 create new chi : 0.4002549648284912 time to delete rle : 0.00047898292541503906 batch 1 Loaded 9 chid ids of type : 3594 ++++++++++++Number RLEs to save : 3444 TO DO : save crop sub photo not yet done ! save time : 0.2745330333709717 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.23250126838684082 time for calcul the mask position with numpy : 0.023627042770385742 nb_pixel_total : 718336 time to create 1 rle with new method : 0.08495712280273438 time for calcul the mask position with numpy : 0.04737567901611328 nb_pixel_total : 1205896 time to create 1 rle with new method : 0.09626388549804688 time for calcul the mask position with numpy : 0.00639796257019043 nb_pixel_total : 22151 time to create 1 rle with old method : 0.02509140968322754 time for calcul the mask position with numpy : 0.0059947967529296875 nb_pixel_total : 8448 time to create 1 rle with old method : 0.009876012802124023 time for calcul the mask position with numpy : 0.005978107452392578 nb_pixel_total : 4072 time to create 1 rle with old method : 0.004706144332885742 time for calcul the mask position with numpy : 0.006007671356201172 nb_pixel_total : 2272 time to create 1 rle with old method : 0.0026504993438720703 time for calcul the mask position with numpy : 0.0065381526947021484 nb_pixel_total : 112425 time to create 1 rle with old method : 0.12788677215576172 create new chi : 0.46979737281799316 time to delete rle : 0.0007250308990478516 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4588 TO DO : save crop sub photo not yet done ! save time : 0.35326385498046875 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05413007736206055 time for calcul the mask position with numpy : 0.016899585723876953 nb_pixel_total : 1436959 time to create 1 rle with new method : 0.029792070388793945 time for calcul the mask position with numpy : 0.0060389041900634766 nb_pixel_total : 20318 time to create 1 rle with old method : 0.023272037506103516 time for calcul the mask position with numpy : 0.012062788009643555 nb_pixel_total : 598606 time to create 1 rle with new method : 0.02814769744873047 time for calcul the mask position with numpy : 0.006932973861694336 nb_pixel_total : 17717 time to create 1 rle with old method : 0.020214319229125977 create new chi : 0.14397478103637695 time to delete rle : 0.0006029605865478516 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4112 TO DO : save crop sub photo not yet done ! save time : 0.40019965171813965 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04780411720275879 time for calcul the mask position with numpy : 0.1664295196533203 nb_pixel_total : 1920182 time to create 1 rle with new method : 0.07645630836486816 time for calcul the mask position with numpy : 0.00630497932434082 nb_pixel_total : 113614 time to create 1 rle with old method : 0.12557101249694824 time for calcul the mask position with numpy : 0.00596308708190918 nb_pixel_total : 39804 time to create 1 rle with old method : 0.04401683807373047 create new chi : 0.43517184257507324 time to delete rle : 0.0003826618194580078 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2418 TO DO : save crop sub photo not yet done ! save time : 0.20730161666870117 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.22543120384216309 time for calcul the mask position with numpy : 0.11432695388793945 nb_pixel_total : 1997180 time to create 1 rle with new method : 0.19282984733581543 time for calcul the mask position with numpy : 0.006200313568115234 nb_pixel_total : 6873 time to create 1 rle with old method : 0.007927179336547852 time for calcul the mask position with numpy : 0.0059435367584228516 nb_pixel_total : 9184 time to create 1 rle with old method : 0.010546207427978516 time for calcul the mask position with numpy : 0.006003141403198242 nb_pixel_total : 13030 time to create 1 rle with old method : 0.014673471450805664 time for calcul the mask position with numpy : 0.006492137908935547 nb_pixel_total : 24323 time to create 1 rle with old method : 0.027442455291748047 time for calcul the mask position with numpy : 0.00619196891784668 nb_pixel_total : 15622 time to create 1 rle with old method : 0.018152236938476562 time for calcul the mask position with numpy : 0.006238460540771484 nb_pixel_total : 7388 time to create 1 rle with old method : 0.00845789909362793 create new chi : 0.4412879943847656 time to delete rle : 0.0005331039428710938 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3202 TO DO : save crop sub photo not yet done ! save time : 0.2854297161102295 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.07058167457580566 time for calcul the mask position with numpy : 0.06534171104431152 nb_pixel_total : 2025645 time to create 1 rle with new method : 0.24615097045898438 time for calcul the mask position with numpy : 0.00607609748840332 nb_pixel_total : 3596 time to create 1 rle with old method : 0.004047870635986328 time for calcul the mask position with numpy : 0.005829334259033203 nb_pixel_total : 13470 time to create 1 rle with old method : 0.015069961547851562 time for calcul the mask position with numpy : 0.005871772766113281 nb_pixel_total : 11225 time to create 1 rle with old method : 0.012563228607177734 time for calcul the mask position with numpy : 0.005818605422973633 nb_pixel_total : 5052 time to create 1 rle with old method : 0.005754947662353516 time for calcul the mask position with numpy : 0.0059282779693603516 nb_pixel_total : 14612 time to create 1 rle with old method : 0.01601099967956543 create new chi : 0.4042932987213135 time to delete rle : 0.00041222572326660156 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2452 TO DO : save crop sub photo not yet done ! save time : 0.19845938682556152 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.051247358322143555 time for calcul the mask position with numpy : 0.01862025260925293 nb_pixel_total : 2044065 time to create 1 rle with new method : 0.15570664405822754 time for calcul the mask position with numpy : 0.005961179733276367 nb_pixel_total : 7163 time to create 1 rle with old method : 0.007882833480834961 time for calcul the mask position with numpy : 0.005903482437133789 nb_pixel_total : 14751 time to create 1 rle with old method : 0.016010522842407227 time for calcul the mask position with numpy : 0.0057337284088134766 nb_pixel_total : 7621 time to create 1 rle with old method : 0.008312702178955078 create new chi : 0.22447609901428223 time to delete rle : 0.0003376007080078125 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2012 TO DO : save crop sub photo not yet done ! save time : 0.19564032554626465 No data in photo_id : 1383885636 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.09855532646179199 time for calcul the mask position with numpy : 0.1704542636871338 nb_pixel_total : 1994963 time to create 1 rle with new method : 0.09659695625305176 time for calcul the mask position with numpy : 0.006263017654418945 nb_pixel_total : 12869 time to create 1 rle with old method : 0.015043497085571289 time for calcul the mask position with numpy : 0.0061452388763427734 nb_pixel_total : 23793 time to create 1 rle with old method : 0.02638530731201172 time for calcul the mask position with numpy : 0.010096073150634766 nb_pixel_total : 41975 time to create 1 rle with old method : 0.05097150802612305 create new chi : 0.39296817779541016 time to delete rle : 0.0005381107330322266 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2112 TO DO : save crop sub photo not yet done ! save time : 0.2426590919494629 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.42366886138916016 time for calcul the mask position with numpy : 0.23380398750305176 nb_pixel_total : 1917836 time to create 1 rle with new method : 0.26496195793151855 time for calcul the mask position with numpy : 0.005970001220703125 nb_pixel_total : 9884 time to create 1 rle with old method : 0.010786771774291992 time for calcul the mask position with numpy : 0.005787372589111328 nb_pixel_total : 5342 time to create 1 rle with old method : 0.005939960479736328 time for calcul the mask position with numpy : 0.00570988655090332 nb_pixel_total : 20097 time to create 1 rle with old method : 0.02191019058227539 time for calcul the mask position with numpy : 0.006310701370239258 nb_pixel_total : 102445 time to create 1 rle with old method : 0.11200404167175293 time for calcul the mask position with numpy : 0.00600433349609375 nb_pixel_total : 5960 time to create 1 rle with old method : 0.006676912307739258 time for calcul the mask position with numpy : 0.006213188171386719 nb_pixel_total : 12036 time to create 1 rle with old method : 0.013259410858154297 create new chi : 0.7145800590515137 time to delete rle : 0.0005528926849365234 batch 1 Loaded 13 chid ids of type : 3594 +++++++++++Number RLEs to save : 3284 TO DO : save crop sub photo not yet done ! save time : 0.25173163414001465 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.040985822677612305 time for calcul the mask position with numpy : 0.018223047256469727 nb_pixel_total : 2053742 time to create 1 rle with new method : 0.027060270309448242 time for calcul the mask position with numpy : 0.005811452865600586 nb_pixel_total : 16604 time to create 1 rle with old method : 0.018113374710083008 time for calcul the mask position with numpy : 0.00558018684387207 nb_pixel_total : 3254 time to create 1 rle with old method : 0.0035316944122314453 create new chi : 0.08493423461914062 time to delete rle : 0.00027823448181152344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1666 TO DO : save crop sub photo not yet done ! save time : 0.14732646942138672 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.22094345092773438 time for calcul the mask position with numpy : 0.057320356369018555 nb_pixel_total : 2020467 time to create 1 rle with new method : 0.1896343231201172 time for calcul the mask position with numpy : 0.006253480911254883 nb_pixel_total : 47578 time to create 1 rle with old method : 0.053682565689086914 time for calcul the mask position with numpy : 0.006062507629394531 nb_pixel_total : 5555 time to create 1 rle with old method : 0.006525516510009766 create new chi : 0.33022117614746094 time to delete rle : 0.0003535747528076172 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1738 TO DO : save crop sub photo not yet done ! save time : 0.15465569496154785 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.14399194717407227 time for calcul the mask position with numpy : 0.32837343215942383 nb_pixel_total : 1897917 time to create 1 rle with new method : 0.0959327220916748 time for calcul the mask position with numpy : 0.0061452388763427734 nb_pixel_total : 31222 time to create 1 rle with old method : 0.051766395568847656 time for calcul the mask position with numpy : 0.007306814193725586 nb_pixel_total : 110855 time to create 1 rle with old method : 0.1296536922454834 time for calcul the mask position with numpy : 0.006162166595458984 nb_pixel_total : 33606 time to create 1 rle with old method : 0.03805065155029297 create new chi : 0.6739141941070557 time to delete rle : 0.0005071163177490234 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3096 TO DO : save crop sub photo not yet done ! save time : 0.231673002243042 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03664731979370117 time for calcul the mask position with numpy : 0.021077632904052734 nb_pixel_total : 2062826 time to create 1 rle with new method : 0.08737325668334961 time for calcul the mask position with numpy : 0.007425785064697266 nb_pixel_total : 10774 time to create 1 rle with old method : 0.013673543930053711 create new chi : 0.1369152069091797 time to delete rle : 0.0002970695495605469 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1454 TO DO : save crop sub photo not yet done ! save time : 0.1177067756652832 No data in photo_id : 1383885400 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04114222526550293 time for calcul the mask position with numpy : 0.09745335578918457 nb_pixel_total : 1939010 time to create 1 rle with new method : 0.08356046676635742 time for calcul the mask position with numpy : 0.0072460174560546875 nb_pixel_total : 124390 time to create 1 rle with old method : 0.14298343658447266 time for calcul the mask position with numpy : 0.006231546401977539 nb_pixel_total : 10200 time to create 1 rle with old method : 0.011729955673217773 create new chi : 0.36029815673828125 time to delete rle : 0.0004715919494628906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2532 TO DO : save crop sub photo not yet done ! save time : 0.21659588813781738 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.42040252685546875 time for calcul the mask position with numpy : 0.07715034484863281 nb_pixel_total : 2054011 time to create 1 rle with new method : 0.2820589542388916 time for calcul the mask position with numpy : 0.006453275680541992 nb_pixel_total : 4744 time to create 1 rle with old method : 0.0055086612701416016 time for calcul the mask position with numpy : 0.006762266159057617 nb_pixel_total : 11308 time to create 1 rle with old method : 0.012989044189453125 time for calcul the mask position with numpy : 0.0061376094818115234 nb_pixel_total : 3537 time to create 1 rle with old method : 0.004105806350708008 create new chi : 0.41184091567993164 time to delete rle : 0.0003800392150878906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1738 TO DO : save crop sub photo not yet done ! save time : 0.1501915454864502 No data in photo_id : 1383885317 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.060834407806396484 time for calcul the mask position with numpy : 0.24547028541564941 nb_pixel_total : 1949176 time to create 1 rle with new method : 0.09523177146911621 time for calcul the mask position with numpy : 0.006110668182373047 nb_pixel_total : 2611 time to create 1 rle with old method : 0.0030181407928466797 time for calcul the mask position with numpy : 0.006283760070800781 nb_pixel_total : 9864 time to create 1 rle with old method : 0.011178970336914062 time for calcul the mask position with numpy : 0.00647425651550293 nb_pixel_total : 111949 time to create 1 rle with old method : 0.12561798095703125 create new chi : 0.5102419853210449 time to delete rle : 0.0003910064697265625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2556 TO DO : save crop sub photo not yet done ! save time : 0.27205991744995117 map_output_result : {1383886009: (0.0, 'Should be the crop_list due to order', 0), 1383885983: (0.0, 'Should be the crop_list due to order', 0), 1383885961: (0.0, 'Should be the crop_list due to order', 0), 1383885959: (0.0, 'Should be the crop_list due to order', 0), 1383885957: (0.0, 'Should be the crop_list due to order', 0.0), 1383885956: (0.0, 'Should be the crop_list due to order', 0), 1383885831: (0.0, 'Should be the crop_list due to order', 0), 1383885807: (0.0, 'Should be the crop_list due to order', 0.0), 1383885792: (0.0, 'Should be the crop_list due to order', 0), 1383885790: (0.0, 'Should be the crop_list due to order', 0), 1383885785: (0.0, 'Should be the crop_list due to order', 0), 1383885781: (0.0, 'Should be the crop_list due to order', 0), 1383885723: (0.0, 'Should be the crop_list due to order', 0), 1383885719: (0.0, 'Should be the crop_list due to order', 0), 1383885711: (0.0, 'Should be the crop_list due to order', 0), 1383885707: (0.0, 'Should be the crop_list due to order', 0), 1383885636: (0.0, 'Should be the crop_list due to order', 0.0), 1383885609: (0.0, 'Should be the crop_list due to order', 0), 1383885563: (0.0, 'Should be the crop_list due to order', 0), 1383885520: (0.0, 'Should be the crop_list due to order', 0), 1383885495: (0.0, 'Should be the crop_list due to order', 0), 1383885470: (0.0, 'Should be the crop_list due to order', 0), 1383885414: (0.0, 'Should be the crop_list due to order', 0), 1383885400: (0.0, 'Should be the crop_list due to order', 0.0), 1383885376: (0.0, 'Should be the crop_list due to order', 0), 1383885343: (0.0, 'Should be the crop_list due to order', 0), 1383885317: (0.0, 'Should be the crop_list due to order', 0.0), 1383885285: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1383886009, 1383885983, 1383885961, 1383885959, 1383885957, 1383885956, 1383885831, 1383885807, 1383885792, 1383885790, 1383885785, 1383885781, 1383885723, 1383885719, 1383885711, 1383885707, 1383885636, 1383885609, 1383885563, 1383885520, 1383885495, 1383885470, 1383885414, 1383885400, 1383885376, 1383885343, 1383885317, 1383885285] Looping around the photos to save general results len do output : 28 /1383886009.Didn't retrieve data . /1383885983.Didn't retrieve data . /1383885961.Didn't retrieve data . /1383885959.Didn't retrieve data . /1383885957.Didn't retrieve data . /1383885956.Didn't retrieve data . /1383885831.Didn't retrieve data . /1383885807.Didn't retrieve data . /1383885792.Didn't retrieve data . /1383885790.Didn't retrieve data . /1383885785.Didn't retrieve data . /1383885781.Didn't retrieve data . /1383885723.Didn't retrieve data . /1383885719.Didn't retrieve data . /1383885711.Didn't retrieve data . /1383885707.Didn't retrieve data . /1383885636.Didn't retrieve data . /1383885609.Didn't retrieve data . /1383885563.Didn't retrieve data . /1383885520.Didn't retrieve data . /1383885495.Didn't retrieve data . /1383885470.Didn't retrieve data . /1383885414.Didn't retrieve data . /1383885400.Didn't retrieve data . /1383885376.Didn't retrieve data . /1383885343.Didn't retrieve data . /1383885317.Didn't retrieve data . /1383885285.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383886009', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885983', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885961', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885959', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885957', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885956', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885831', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885807', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885792', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885790', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885785', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885781', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885723', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885719', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885711', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885707', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885636', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885609', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885563', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885520', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885495', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885470', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885414', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885400', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885376', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885343', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885317', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885285', None, None, None, None, None, '3727823') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.01783585548400879 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.757386207580566 time spend to save output : 0.01879715919494629 total time spend for step 3 : 17.776183366775513 step4:ventilate_hashtags_in_portfolio Tue Sep 16 12:42:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26890528 get user id for portfolio 26890528 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26890528 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','papier','pet_clair','metal','background','environnement','pet_fonce','carton','mal_croppe','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26890528 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','papier','pet_clair','metal','background','environnement','pet_fonce','carton','mal_croppe','pehd')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26890528 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','papier','pet_clair','metal','background','environnement','pet_fonce','carton','mal_croppe','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26890566,26890567,26890568,26890569,26890570,26890571,26890572,26890573,26890574,26890575,26890576?tags=flou,autre,papier,pet_clair,metal,background,environnement,pet_fonce,carton,mal_croppe,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1383886009, 1383885983, 1383885961, 1383885959, 1383885957, 1383885956, 1383885831, 1383885807, 1383885792, 1383885790, 1383885785, 1383885781, 1383885723, 1383885719, 1383885711, 1383885707, 1383885636, 1383885609, 1383885563, 1383885520, 1383885495, 1383885470, 1383885414, 1383885400, 1383885376, 1383885343, 1383885317, 1383885285] Looping around the photos to save general results len do output : 1 /26890528. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383886009', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885983', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885961', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885959', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885957', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885956', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885831', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885807', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885792', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885790', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885785', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885781', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885723', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885719', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885711', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885707', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885636', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885609', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885563', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885520', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885495', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885470', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885414', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885400', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885376', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885343', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885317', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885285', None, None, None, None, None, '3727823') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.06473851203918457 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6631076335906982 time spend to save output : 0.06516671180725098 total time spend for step 4 : 0.7282743453979492 step5:final Tue Sep 16 12:42:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1383886009: ('0.06626128127755732',), 1383885983: ('0.06626128127755732',), 1383885961: ('0.06626128127755732',), 1383885959: ('0.06626128127755732',), 1383885957: ('0.06626128127755732',), 1383885956: ('0.06626128127755732',), 1383885831: ('0.06626128127755732',), 1383885807: ('0.06626128127755732',), 1383885792: ('0.06626128127755732',), 1383885790: ('0.06626128127755732',), 1383885785: ('0.06626128127755732',), 1383885781: ('0.06626128127755732',), 1383885723: ('0.06626128127755732',), 1383885719: ('0.06626128127755732',), 1383885711: ('0.06626128127755732',), 1383885707: ('0.06626128127755732',), 1383885636: ('0.06626128127755732',), 1383885609: ('0.06626128127755732',), 1383885563: ('0.06626128127755732',), 1383885520: ('0.06626128127755732',), 1383885495: ('0.06626128127755732',), 1383885470: ('0.06626128127755732',), 1383885414: ('0.06626128127755732',), 1383885400: ('0.06626128127755732',), 1383885376: ('0.06626128127755732',), 1383885343: ('0.06626128127755732',), 1383885317: ('0.06626128127755732',), 1383885285: ('0.06626128127755732',)} new output for save of step final : {1383886009: ('0.06626128127755732',), 1383885983: ('0.06626128127755732',), 1383885961: ('0.06626128127755732',), 1383885959: ('0.06626128127755732',), 1383885957: ('0.06626128127755732',), 1383885956: ('0.06626128127755732',), 1383885831: ('0.06626128127755732',), 1383885807: ('0.06626128127755732',), 1383885792: ('0.06626128127755732',), 1383885790: ('0.06626128127755732',), 1383885785: ('0.06626128127755732',), 1383885781: ('0.06626128127755732',), 1383885723: ('0.06626128127755732',), 1383885719: ('0.06626128127755732',), 1383885711: ('0.06626128127755732',), 1383885707: ('0.06626128127755732',), 1383885636: ('0.06626128127755732',), 1383885609: ('0.06626128127755732',), 1383885563: ('0.06626128127755732',), 1383885520: ('0.06626128127755732',), 1383885495: ('0.06626128127755732',), 1383885470: ('0.06626128127755732',), 1383885414: ('0.06626128127755732',), 1383885400: ('0.06626128127755732',), 1383885376: ('0.06626128127755732',), 1383885343: ('0.06626128127755732',), 1383885317: ('0.06626128127755732',), 1383885285: ('0.06626128127755732',)} [1383886009, 1383885983, 1383885961, 1383885959, 1383885957, 1383885956, 1383885831, 1383885807, 1383885792, 1383885790, 1383885785, 1383885781, 1383885723, 1383885719, 1383885711, 1383885707, 1383885636, 1383885609, 1383885563, 1383885520, 1383885495, 1383885470, 1383885414, 1383885400, 1383885376, 1383885343, 1383885317, 1383885285] Looping around the photos to save general results len do output : 28 /1383886009.Didn't retrieve data . /1383885983.Didn't retrieve data . /1383885961.Didn't retrieve data . /1383885959.Didn't retrieve data . /1383885957.Didn't retrieve data . /1383885956.Didn't retrieve data . /1383885831.Didn't retrieve data . /1383885807.Didn't retrieve data . /1383885792.Didn't retrieve data . /1383885790.Didn't retrieve data . /1383885785.Didn't retrieve data . /1383885781.Didn't retrieve data . /1383885723.Didn't retrieve data . /1383885719.Didn't retrieve data . /1383885711.Didn't retrieve data . /1383885707.Didn't retrieve data . /1383885636.Didn't retrieve data . /1383885609.Didn't retrieve data . /1383885563.Didn't retrieve data . /1383885520.Didn't retrieve data . /1383885495.Didn't retrieve data . /1383885470.Didn't retrieve data . /1383885414.Didn't retrieve data . /1383885400.Didn't retrieve data . /1383885376.Didn't retrieve data . /1383885343.Didn't retrieve data . /1383885317.Didn't retrieve data . /1383885285.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383886009', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885983', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885961', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885959', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885957', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885956', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885831', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885807', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885792', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885790', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885785', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885781', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885723', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885719', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885711', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885707', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885636', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885609', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885563', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885520', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885495', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885470', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885414', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885400', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885376', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885343', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885317', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885285', None, None, None, None, None, '3727823') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.01975560188293457 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1296987533569336 time spend to save output : 0.02096414566040039 total time spend for step 5 : 0.15066289901733398 step6:blur_detection Tue Sep 16 12:42:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758019228_2623772_1383886009_5afa8a7f7833182283f22aa220c6bfa1.jpg resize: (1080, 1920) 1383886009 -1.4658958334564185 treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490.jpg resize: (1080, 1920) 1383885983 -4.35485237089731 treat image : temp/1758019228_2623772_1383885961_215c4729f90dcd3f480c5dddba9b80bd.jpg resize: (1080, 1920) 1383885961 -1.4868921723888877 treat image : temp/1758019228_2623772_1383885959_0eb114e82ed16f1e9624076cc0402dbe.jpg resize: (1080, 1920) 1383885959 0.4668155443846434 treat image : temp/1758019228_2623772_1383885957_1f8b2aa555a9ad12e6de2ec84ce7f4b7.jpg resize: (1080, 1920) 1383885957 3.075021327339809 treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2.jpg resize: (1080, 1920) 1383885956 -0.9117086919102046 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16.jpg resize: (1080, 1920) 1383885831 -2.4568641515288796 treat image : temp/1758019228_2623772_1383885807_087074317895a3d46493d7b5e0694da8.jpg resize: (1080, 1920) 1383885807 1.1506123072799304 treat image : temp/1758019228_2623772_1383885792_4fa3a7be2fd9284545ab9844ccaa9375.jpg resize: (1080, 1920) 1383885792 1.4361988572097557 treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7.jpg resize: (1080, 1920) 1383885790 0.0068501408821914685 treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7.jpg resize: (1080, 1920) 1383885785 -0.37898859664164836 treat image : temp/1758019228_2623772_1383885781_3c6be2a9ffa815fb44c6f9d30bbb1e84.jpg resize: (1080, 1920) 1383885781 0.7364749920335752 treat image : temp/1758019228_2623772_1383885723_7917c8a3e9b44a380e00c8180d43f693.jpg resize: (1080, 1920) 1383885723 -1.0734370394074224 treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919.jpg resize: (1080, 1920) 1383885719 0.309397721080049 treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a.jpg resize: (1080, 1920) 1383885711 -0.1768001022028602 treat image : temp/1758019228_2623772_1383885707_8f1fa132c9eb6d0a8accf572e19a8dad.jpg resize: (1080, 1920) 1383885707 1.141304427200995 treat image : temp/1758019228_2623772_1383885636_792775d54984e6248da34b9b79880622.jpg resize: (1080, 1920) 1383885636 -3.7573094363299373 treat image : temp/1758019228_2623772_1383885609_958f5b8a25d9b3fd97c61a040cd47d8e.jpg resize: (1080, 1920) 1383885609 4.390309009560952 treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7.jpg resize: (1080, 1920) 1383885563 -3.3606518167216994 treat image : temp/1758019228_2623772_1383885520_7bed106505623ce86baf1d9087148407.jpg resize: (1080, 1920) 1383885520 -0.9265471274104001 treat image : temp/1758019228_2623772_1383885495_6d0d978c9b243ef4a830a3106391fc56.jpg resize: (1080, 1920) 1383885495 -1.2262109580034415 treat image : temp/1758019228_2623772_1383885470_2eb26225de1c17cfff5d56b0a6de425a.jpg resize: (1080, 1920) 1383885470 -3.3553301592369413 treat image : temp/1758019228_2623772_1383885414_6cfcd9a68226e51a1e6f8cb5a72d54ac.jpg resize: (1080, 1920) 1383885414 -0.4739556003558162 treat image : temp/1758019228_2623772_1383885400_cab454c09fd8fa5f2af9c494731fa117.jpg resize: (1080, 1920) 1383885400 0.21994950705767455 treat image : temp/1758019228_2623772_1383885376_1e1ea5693a399305c8c594d183ca389d.jpg resize: (1080, 1920) 1383885376 -0.8809348373147986 treat image : temp/1758019228_2623772_1383885343_0368bb20a862b621a41e09be0e9efa0a.jpg resize: (1080, 1920) 1383885343 -0.019739621194533662 treat image : temp/1758019228_2623772_1383885317_3606b344838a012ca9b2c233c581f8a5.jpg resize: (1080, 1920) 1383885317 0.03582028683537437 treat image : temp/1758019228_2623772_1383885285_4a33219472bc60c1e33b7819b399a270.jpg resize: (1080, 1920) 1383885285 -1.87884055586136 treat image : temp/1758019228_2623772_1383886009_5afa8a7f7833182283f22aa220c6bfa1_rle_crop_3959257155_0.png resize: (105, 47) 1383889868 0.2700237442215622 treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490_rle_crop_3959257158_0.png resize: (54, 43) 1383889869 -0.13687451876500975 treat image : temp/1758019228_2623772_1383885961_215c4729f90dcd3f480c5dddba9b80bd_rle_crop_3959257160_0.png resize: (186, 213) 1383889871 -2.0850652139124657 treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2_rle_crop_3959257164_0.png resize: (49, 62) 1383889872 0.9026977514841521 treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2_rle_crop_3959257165_0.png resize: (37, 136) 1383889873 -2.9142654727896775 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257168_0.png resize: (114, 146) 1383889875 -3.5734147278523487 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257170_0.png resize: (92, 110) 1383889876 -1.4780542924563673 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257171_0.png resize: (59, 161) 1383889877 -2.7978716158397297 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257172_0.png resize: (45, 161) 1383889879 -2.945653241793332 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257174_0.png resize: (175, 225) 1383889880 -3.54924712693977 treat image : temp/1758019228_2623772_1383885792_4fa3a7be2fd9284545ab9844ccaa9375_rle_crop_3959257175_0.png resize: (71, 85) 1383889881 0.06208153418201436 treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7_rle_crop_3959257177_0.png resize: (171, 109) 1383889883 -2.121832018221981 treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257183_0.png resize: (180, 111) 1383889884 -2.2051590014867 treat image : temp/1758019228_2623772_1383885723_7917c8a3e9b44a380e00c8180d43f693_rle_crop_3959257189_0.png resize: (179, 399) 1383889885 -0.8131867402238675 treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257191_0.png resize: (173, 100) 1383889886 -2.4283245769361077 treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257192_0.png resize: (244, 97) 1383889889 0.903661110028797 treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257193_0.png resize: (195, 189) 1383889890 -1.2632813605809359 treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257194_0.png resize: (105, 179) 1383889891 0.010847790403658021 treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257196_0.png resize: (66, 154) 1383889893 -1.560924346075219 treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257197_0.png resize: (213, 108) 1383889894 -1.299757238049631 treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257199_0.png resize: (172, 92) 1383889895 -0.8879838469274325 treat image : temp/1758019228_2623772_1383885707_8f1fa132c9eb6d0a8accf572e19a8dad_rle_crop_3959257202_0.png resize: (125, 78) 1383889897 0.43123406174369283 treat image : temp/1758019228_2623772_1383885707_8f1fa132c9eb6d0a8accf572e19a8dad_rle_crop_3959257203_0.png resize: (120, 196) 1383889898 0.20371657472827318 treat image : temp/1758019228_2623772_1383885707_8f1fa132c9eb6d0a8accf572e19a8dad_rle_crop_3959257204_0.png resize: (167, 110) 1383889899 -2.158037280019288 treat image : temp/1758019228_2623772_1383885609_958f5b8a25d9b3fd97c61a040cd47d8e_rle_crop_3959257207_0.png resize: (130, 126) 1383889901 0.9886183934195533 treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257209_0.png resize: (129, 111) 1383889902 -1.9954575858699204 treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257212_0.png resize: (108, 82) 1383889903 -1.7306566052053383 treat image : temp/1758019228_2623772_1383885520_7bed106505623ce86baf1d9087148407_rle_crop_3959257214_0.png resize: (150, 70) 1383889905 -3.2518971756293156 treat image : temp/1758019228_2623772_1383885520_7bed106505623ce86baf1d9087148407_rle_crop_3959257215_0.png resize: (106, 227) 1383889906 -1.9910217267761472 treat image : temp/1758019228_2623772_1383885495_6d0d978c9b243ef4a830a3106391fc56_rle_crop_3959257216_0.png resize: (169, 72) 1383889907 -2.4318821513908087 treat image : temp/1758019228_2623772_1383885376_1e1ea5693a399305c8c594d183ca389d_rle_crop_3959257222_0.png resize: (186, 124) 1383889909 -1.8559980283763713 treat image : temp/1758019228_2623772_1383885343_0368bb20a862b621a41e09be0e9efa0a_rle_crop_3959257224_0.png resize: (55, 97) 1383889910 -0.8070425186188308 treat image : temp/1758019228_2623772_1383885343_0368bb20a862b621a41e09be0e9efa0a_rle_crop_3959257226_0.png resize: (105, 68) 1383889911 -0.7156449691333624 treat image : temp/1758019228_2623772_1383885285_4a33219472bc60c1e33b7819b399a270_rle_crop_3959257229_0.png resize: (112, 52) 1383889912 -2.6348930014016037 treat image : temp/1758019228_2623772_1383885959_0eb114e82ed16f1e9624076cc0402dbe_rle_crop_3959257162_0.png resize: (513, 358) 1383889938 -0.6965943139834216 treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2_rle_crop_3959257163_0.png resize: (80, 76) 1383889939 -2.1019416210506146 treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2_rle_crop_3959257166_0.png resize: (507, 350) 1383889940 -0.636184469700578 treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257182_0.png resize: (43, 115) 1383889942 6.579164752696562 treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257200_0.png resize: (149, 117) 1383889943 -1.0585988763966308 treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257201_0.png resize: (80, 54) 1383889944 20.0 treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257213_0.png resize: (59, 191) 1383889946 2.0915272859747547 treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490_rle_crop_3959257156_0.png resize: (195, 189) 1383890041 -3.2624684405010744 treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490_rle_crop_3959257157_0.png resize: (534, 366) 1383890042 0.15332393465848554 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257167_0.png resize: (516, 344) 1383890043 -0.4197227534414223 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257169_0.png resize: (177, 212) 1383890044 -3.7920388851884725 treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257173_0.png resize: (241, 164) 1383890045 -2.6208132760402374 treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7_rle_crop_3959257176_0.png resize: (155, 60) 1383890046 -1.5178962664604712 treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7_rle_crop_3959257178_0.png resize: (526, 344) 1383890047 -0.2555755712632572 treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7_rle_crop_3959257179_0.png resize: (125, 112) 1383890048 -3.3846958688999824 treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257180_0.png resize: (281, 521) 1383890049 -0.7912305646546252 treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257184_0.png resize: (155, 188) 1383890050 -3.4213912231347665 treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257185_0.png resize: (1008, 1378) 1383890051 -1.4106472133131058 treat image : temp/1758019228_2623772_1383885781_3c6be2a9ffa815fb44c6f9d30bbb1e84_rle_crop_3959257186_0.png resize: (163, 143) 1383890052 -1.0496005342075978 treat image : temp/1758019228_2623772_1383885781_3c6be2a9ffa815fb44c6f9d30bbb1e84_rle_crop_3959257187_0.png resize: (974, 997) 1383890053 0.3024056738847788 treat image : temp/1758019228_2623772_1383885781_3c6be2a9ffa815fb44c6f9d30bbb1e84_rle_crop_3959257188_0.png resize: (182, 171) 1383890054 -0.164192134063183 treat image : temp/1758019228_2623772_1383885723_7917c8a3e9b44a380e00c8180d43f693_rle_crop_3959257190_0.png resize: (490, 369) 1383890055 0.35600792702133605 treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257195_0.png resize: (99, 141) 1383890056 -2.992451532400642 treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257198_0.png resize: (69, 116) 1383890057 -3.7016980201263405 treat image : temp/1758019228_2623772_1383885609_958f5b8a25d9b3fd97c61a040cd47d8e_rle_crop_3959257205_0.png resize: (199, 255) 1383890058 0.021149992369943717 treat image : temp/1758019228_2623772_1383885609_958f5b8a25d9b3fd97c61a040cd47d8e_rle_crop_3959257206_0.png resize: (185, 196) 1383890059 -0.36412171987868847 treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257210_0.png resize: (491, 338) 1383890060 0.10254264857966726 treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257211_0.png resize: (139, 223) 1383890061 -3.3363052937413293 treat image : temp/1758019228_2623772_1383885495_6d0d978c9b243ef4a830a3106391fc56_rle_crop_3959257217_0.png resize: (157, 469) 1383890062 -1.8888014742442594 treat image : temp/1758019228_2623772_1383885470_2eb26225de1c17cfff5d56b0a6de425a_rle_crop_3959257219_0.png resize: (531, 337) 1383890063 0.22412664439412447 treat image : temp/1758019228_2623772_1383885470_2eb26225de1c17cfff5d56b0a6de425a_rle_crop_3959257220_0.png resize: (143, 317) 1383890064 -2.5687283093905338 treat image : temp/1758019228_2623772_1383885414_6cfcd9a68226e51a1e6f8cb5a72d54ac_rle_crop_3959257221_0.png resize: (185, 96) 1383890065 -0.1457606728854808 treat image : temp/1758019228_2623772_1383885376_1e1ea5693a399305c8c594d183ca389d_rle_crop_3959257223_0.png resize: (534, 367) 1383890066 0.16930239021809737 treat image : temp/1758019228_2623772_1383885343_0368bb20a862b621a41e09be0e9efa0a_rle_crop_3959257225_0.png resize: (169, 109) 1383890067 -0.6778336103405022 treat image : temp/1758019228_2623772_1383885285_4a33219472bc60c1e33b7819b399a270_rle_crop_3959257227_0.png resize: (517, 355) 1383890068 0.17890324012289868 treat image : temp/1758019228_2623772_1383885285_4a33219472bc60c1e33b7819b399a270_rle_crop_3959257228_0.png resize: (104, 123) 1383890069 -2.6003057285869264 treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490_rle_crop_3959257159_0.png resize: (270, 108) 1383890071 -1.8416133487867365 treat image : temp/1758019228_2623772_1383885959_0eb114e82ed16f1e9624076cc0402dbe_rle_crop_3959257161_0.png resize: (293, 109) 1383890072 -0.3292691387128223 treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257181_0.png resize: (54, 56) 1383890074 3.133856380322201 treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257208_0.png resize: (116, 136) 1383890075 -3.0396632698886887 treat image : temp/1758019228_2623772_1383885470_2eb26225de1c17cfff5d56b0a6de425a_rle_crop_3959257218_0.png resize: (321, 151) 1383890076 -0.5882945865734232 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.016246795654296875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.03126978874206543 save missing photos in datou_result : time spend for datou_step_exec : 24.118074893951416 time spend to save output : 0.05296492576599121 total time spend for step 6 : 24.171039819717407 step7:brightness Tue Sep 16 12:42:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758019228_2623772_1383886009_5afa8a7f7833182283f22aa220c6bfa1.jpg treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490.jpg treat image : temp/1758019228_2623772_1383885961_215c4729f90dcd3f480c5dddba9b80bd.jpg treat image : temp/1758019228_2623772_1383885959_0eb114e82ed16f1e9624076cc0402dbe.jpg treat image : temp/1758019228_2623772_1383885957_1f8b2aa555a9ad12e6de2ec84ce7f4b7.jpg treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2.jpg treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16.jpg treat image : temp/1758019228_2623772_1383885807_087074317895a3d46493d7b5e0694da8.jpg treat image : temp/1758019228_2623772_1383885792_4fa3a7be2fd9284545ab9844ccaa9375.jpg treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7.jpg treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7.jpg treat image : temp/1758019228_2623772_1383885781_3c6be2a9ffa815fb44c6f9d30bbb1e84.jpg treat image : temp/1758019228_2623772_1383885723_7917c8a3e9b44a380e00c8180d43f693.jpg treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919.jpg treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a.jpg treat image : temp/1758019228_2623772_1383885707_8f1fa132c9eb6d0a8accf572e19a8dad.jpg treat image : temp/1758019228_2623772_1383885636_792775d54984e6248da34b9b79880622.jpg treat image : temp/1758019228_2623772_1383885609_958f5b8a25d9b3fd97c61a040cd47d8e.jpg treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7.jpg treat image : temp/1758019228_2623772_1383885520_7bed106505623ce86baf1d9087148407.jpg treat image : temp/1758019228_2623772_1383885495_6d0d978c9b243ef4a830a3106391fc56.jpg treat image : temp/1758019228_2623772_1383885470_2eb26225de1c17cfff5d56b0a6de425a.jpg treat image : temp/1758019228_2623772_1383885414_6cfcd9a68226e51a1e6f8cb5a72d54ac.jpg treat image : temp/1758019228_2623772_1383885400_cab454c09fd8fa5f2af9c494731fa117.jpg treat image : temp/1758019228_2623772_1383885376_1e1ea5693a399305c8c594d183ca389d.jpg treat image : temp/1758019228_2623772_1383885343_0368bb20a862b621a41e09be0e9efa0a.jpg treat image : temp/1758019228_2623772_1383885317_3606b344838a012ca9b2c233c581f8a5.jpg treat image : temp/1758019228_2623772_1383885285_4a33219472bc60c1e33b7819b399a270.jpg treat image : temp/1758019228_2623772_1383886009_5afa8a7f7833182283f22aa220c6bfa1_rle_crop_3959257155_0.png treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490_rle_crop_3959257158_0.png treat image : temp/1758019228_2623772_1383885961_215c4729f90dcd3f480c5dddba9b80bd_rle_crop_3959257160_0.png treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2_rle_crop_3959257164_0.png treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2_rle_crop_3959257165_0.png treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257168_0.png treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257170_0.png treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257171_0.png treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257172_0.png treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257174_0.png treat image : temp/1758019228_2623772_1383885792_4fa3a7be2fd9284545ab9844ccaa9375_rle_crop_3959257175_0.png treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7_rle_crop_3959257177_0.png treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257183_0.png treat image : temp/1758019228_2623772_1383885723_7917c8a3e9b44a380e00c8180d43f693_rle_crop_3959257189_0.png treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257191_0.png treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257192_0.png treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257193_0.png treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257194_0.png treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257196_0.png treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257197_0.png treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257199_0.png treat image : temp/1758019228_2623772_1383885707_8f1fa132c9eb6d0a8accf572e19a8dad_rle_crop_3959257202_0.png treat image : temp/1758019228_2623772_1383885707_8f1fa132c9eb6d0a8accf572e19a8dad_rle_crop_3959257203_0.png treat image : temp/1758019228_2623772_1383885707_8f1fa132c9eb6d0a8accf572e19a8dad_rle_crop_3959257204_0.png treat image : temp/1758019228_2623772_1383885609_958f5b8a25d9b3fd97c61a040cd47d8e_rle_crop_3959257207_0.png treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257209_0.png treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257212_0.png treat image : temp/1758019228_2623772_1383885520_7bed106505623ce86baf1d9087148407_rle_crop_3959257214_0.png treat image : temp/1758019228_2623772_1383885520_7bed106505623ce86baf1d9087148407_rle_crop_3959257215_0.png treat image : temp/1758019228_2623772_1383885495_6d0d978c9b243ef4a830a3106391fc56_rle_crop_3959257216_0.png treat image : temp/1758019228_2623772_1383885376_1e1ea5693a399305c8c594d183ca389d_rle_crop_3959257222_0.png treat image : temp/1758019228_2623772_1383885343_0368bb20a862b621a41e09be0e9efa0a_rle_crop_3959257224_0.png treat image : temp/1758019228_2623772_1383885343_0368bb20a862b621a41e09be0e9efa0a_rle_crop_3959257226_0.png treat image : temp/1758019228_2623772_1383885285_4a33219472bc60c1e33b7819b399a270_rle_crop_3959257229_0.png treat image : temp/1758019228_2623772_1383885959_0eb114e82ed16f1e9624076cc0402dbe_rle_crop_3959257162_0.png treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2_rle_crop_3959257163_0.png treat image : temp/1758019228_2623772_1383885956_604e75df58ac173817e8bef8ddbdddb2_rle_crop_3959257166_0.png treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257182_0.png treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257200_0.png treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257201_0.png treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257213_0.png treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490_rle_crop_3959257156_0.png treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490_rle_crop_3959257157_0.png treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257167_0.png treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257169_0.png treat image : temp/1758019228_2623772_1383885831_8e95d9c8d97d7b406728bfd658104a16_rle_crop_3959257173_0.png treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7_rle_crop_3959257176_0.png treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7_rle_crop_3959257178_0.png treat image : temp/1758019228_2623772_1383885790_c76d01e9e26815c384f4a79e9d2592a7_rle_crop_3959257179_0.png treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257180_0.png treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257184_0.png treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257185_0.png treat image : temp/1758019228_2623772_1383885781_3c6be2a9ffa815fb44c6f9d30bbb1e84_rle_crop_3959257186_0.png treat image : temp/1758019228_2623772_1383885781_3c6be2a9ffa815fb44c6f9d30bbb1e84_rle_crop_3959257187_0.png treat image : temp/1758019228_2623772_1383885781_3c6be2a9ffa815fb44c6f9d30bbb1e84_rle_crop_3959257188_0.png treat image : temp/1758019228_2623772_1383885723_7917c8a3e9b44a380e00c8180d43f693_rle_crop_3959257190_0.png treat image : temp/1758019228_2623772_1383885719_4acca480d92c379b58766456fe055919_rle_crop_3959257195_0.png treat image : temp/1758019228_2623772_1383885711_bd8a21318dc0772d2c6ec6ba7e84b95a_rle_crop_3959257198_0.png treat image : temp/1758019228_2623772_1383885609_958f5b8a25d9b3fd97c61a040cd47d8e_rle_crop_3959257205_0.png treat image : temp/1758019228_2623772_1383885609_958f5b8a25d9b3fd97c61a040cd47d8e_rle_crop_3959257206_0.png treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257210_0.png treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257211_0.png treat image : temp/1758019228_2623772_1383885495_6d0d978c9b243ef4a830a3106391fc56_rle_crop_3959257217_0.png treat image : temp/1758019228_2623772_1383885470_2eb26225de1c17cfff5d56b0a6de425a_rle_crop_3959257219_0.png treat image : temp/1758019228_2623772_1383885470_2eb26225de1c17cfff5d56b0a6de425a_rle_crop_3959257220_0.png treat image : temp/1758019228_2623772_1383885414_6cfcd9a68226e51a1e6f8cb5a72d54ac_rle_crop_3959257221_0.png treat image : temp/1758019228_2623772_1383885376_1e1ea5693a399305c8c594d183ca389d_rle_crop_3959257223_0.png treat image : temp/1758019228_2623772_1383885343_0368bb20a862b621a41e09be0e9efa0a_rle_crop_3959257225_0.png treat image : temp/1758019228_2623772_1383885285_4a33219472bc60c1e33b7819b399a270_rle_crop_3959257227_0.png treat image : temp/1758019228_2623772_1383885285_4a33219472bc60c1e33b7819b399a270_rle_crop_3959257228_0.png treat image : temp/1758019228_2623772_1383885983_2f7f69e185c7f7eeb55717a04dd12490_rle_crop_3959257159_0.png treat image : temp/1758019228_2623772_1383885959_0eb114e82ed16f1e9624076cc0402dbe_rle_crop_3959257161_0.png treat image : temp/1758019228_2623772_1383885785_ed8958b37d79116f2a391de31770fca7_rle_crop_3959257181_0.png treat image : temp/1758019228_2623772_1383885563_3e1533beb21bb8755be64075d5531be7_rle_crop_3959257208_0.png treat image : temp/1758019228_2623772_1383885470_2eb26225de1c17cfff5d56b0a6de425a_rle_crop_3959257218_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.016356706619262695 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.03675961494445801 save missing photos in datou_result : time spend for datou_step_exec : 6.876903057098389 time spend to save output : 0.0575714111328125 total time spend for step 7 : 6.934474468231201 step8:velours_tree Tue Sep 16 12:42:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14069795608520508 time spend to save output : 4.1961669921875e-05 total time spend for step 8 : 0.14073991775512695 step9:send_mail_cod Tue Sep 16 12:42:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26890528_16-09-2025_12_42_38.pdf 26890566 imagette268905661758019358 26890567 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268905671758019358 26890568 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268905681758019358 26890569 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268905691758019359 26890570 imagette268905701758019361 26890571 imagette268905711758019361 26890573 imagette268905731758019361 26890574 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268905741758019361 26890575 imagette268905751758019361 26890576 imagette268905761758019361 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26890528 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26890566,26890567,26890568,26890569,26890570,26890571,26890572,26890573,26890574,26890575,26890576?tags=flou,autre,papier,pet_clair,metal,background,environnement,pet_fonce,carton,mal_croppe,pehd args[1383886009] : ((1383886009, -1.4658958334564185, 492688767), (1383886009, 0.4020921561897808, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885983] : ((1383885983, -4.35485237089731, 492609224), (1383885983, 0.4423859903602336, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885961] : ((1383885961, -1.4868921723888877, 492688767), (1383885961, 0.1746544572512482, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885959] : ((1383885959, 0.4668155443846434, 492688767), (1383885959, 0.3907012246972287, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885957] : ((1383885957, 3.075021327339809, 492688767), (1383885957, 0.5314654040916347, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885956] : ((1383885956, -0.9117086919102046, 492688767), (1383885956, 0.3542946216188385, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885831] : ((1383885831, -2.4568641515288796, 492609224), (1383885831, 0.4010384948408918, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885807] : ((1383885807, 1.1506123072799304, 492688767), (1383885807, 0.7046244917054999, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885792] : ((1383885792, 1.4361988572097557, 492688767), (1383885792, 0.4955762960151546, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885790] : ((1383885790, 0.0068501408821914685, 492688767), (1383885790, 0.35278670735059303, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885785] : ((1383885785, -0.37898859664164836, 492688767), (1383885785, 0.19280873249642996, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885781] : ((1383885781, 0.7364749920335752, 492688767), (1383885781, 0.4680359907148758, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885723] : ((1383885723, -1.0734370394074224, 492688767), (1383885723, 0.7948236678766041, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885719] : ((1383885719, 0.309397721080049, 492688767), (1383885719, 0.7221966615904553, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885711] : ((1383885711, -0.1768001022028602, 492688767), (1383885711, 0.4429522317753309, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885707] : ((1383885707, 1.141304427200995, 492688767), (1383885707, 0.8191646816836526, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885636] : ((1383885636, -3.7573094363299373, 492609224), (1383885636, 0.40596668670109864, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885609] : ((1383885609, 4.390309009560952, 492688767), (1383885609, 0.47878935383430643, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885563] : ((1383885563, -3.3606518167216994, 492609224), (1383885563, 0.5481718275645253, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885520] : ((1383885520, -0.9265471274104001, 492688767), (1383885520, 0.19458121212658053, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885495] : ((1383885495, -1.2262109580034415, 492688767), (1383885495, 0.579830946746389, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885470] : ((1383885470, -3.3553301592369413, 492609224), (1383885470, 0.5960489648994396, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885414] : ((1383885414, -0.4739556003558162, 492688767), (1383885414, 0.7871112555221399, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885400] : ((1383885400, 0.21994950705767455, 492688767), (1383885400, 0.7429244483206652, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885376] : ((1383885376, -0.8809348373147986, 492688767), (1383885376, 0.5051138154748835, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885343] : ((1383885343, -0.019739621194533662, 492688767), (1383885343, 1.09724495118611, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885317] : ((1383885317, 0.03582028683537437, 492688767), (1383885317, 0.5617301409683195, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com args[1383885285] : ((1383885285, -1.87884055586136, 492688767), (1383885285, 0.5305058935378164, 2107752395), '0.06626128127755732') We are sending mail with results at report@fotonower.com refus_total : 0.06626128127755732 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26890528 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26890528_16-09-2025_12_42_38.pdf results_Auto_P26890528_16-09-2025_12_42_38.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26890528_16-09-2025_12_42_38.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26890528','results_Auto_P26890528_16-09-2025_12_42_38.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26890528_16-09-2025_12_42_38.pdf','pdf','','0.53','0.06626128127755732') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26890528

https://www.fotonower.com/image?json=false&list_photos_id=1383886009
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885983
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885961
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885959
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885957
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.075021327339809)
https://www.fotonower.com/image?json=false&list_photos_id=1383885956
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885831
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885807
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1506123072799304)
https://www.fotonower.com/image?json=false&list_photos_id=1383885792
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4361988572097557)
https://www.fotonower.com/image?json=false&list_photos_id=1383885790
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885785
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885781
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885723
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885719
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885711
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885707
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.141304427200995)
https://www.fotonower.com/image?json=false&list_photos_id=1383885636
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885609
La photo est trop floue, merci de reprendre une photo.(avec le score = 4.390309009560952)
https://www.fotonower.com/image?json=false&list_photos_id=1383885563
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885520
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885495
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885470
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885414
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885400
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885376
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885343
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885317
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383885285
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 6.63%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/26890567?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26890568?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26890569?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26890574?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26890528_16-09-2025_12_42_38.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26890566,26890567,26890568,26890569,26890570,26890571,26890572,26890573,26890574,26890575,26890576?tags=flou,autre,papier,pet_clair,metal,background,environnement,pet_fonce,carton,mal_croppe,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 16 Sep 2025 10:42:44 GMT Content-Length: 0 Connection: close X-Message-Id: QuWy9OA-TACjdB3trfbJ4g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1383886009, 1383885983, 1383885961, 1383885959, 1383885957, 1383885956, 1383885831, 1383885807, 1383885792, 1383885790, 1383885785, 1383885781, 1383885723, 1383885719, 1383885711, 1383885707, 1383885636, 1383885609, 1383885563, 1383885520, 1383885495, 1383885470, 1383885414, 1383885400, 1383885376, 1383885343, 1383885317, 1383885285] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383886009', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885983', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885961', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885959', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885957', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885956', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885831', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885807', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885792', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885790', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885785', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885781', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885723', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885719', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885711', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885707', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885636', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885609', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885563', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885520', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885495', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885470', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885414', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885400', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885376', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885343', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885317', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885285', None, None, None, None, None, '3727823') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 28 time used for this insertion : 0.03360295295715332 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.758494853973389 time spend to save output : 0.034000396728515625 total time spend for step 9 : 6.792495250701904 step10:split_time_score Tue Sep 16 12:42:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 28),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16092025 26890528 Nombre de photos uploadées : 28 / 23040 (0%) 16092025 26890528 Nombre de photos taguées (types de déchets): 0 / 28 (0%) 16092025 26890528 Nombre de photos taguées (volume) : 0 / 28 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0012581348419189453 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20203256607055664 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1122128041031227 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882766_16-09-2025_09_52_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882766 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882766 AND mptpi.`type`=3594 To do Qualite : 0.1705833654835391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882768_16-09-2025_09_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882768 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882768 AND mptpi.`type`=3594 To do Qualite : 0.05712583188657407 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882771_16-09-2025_10_31_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882771 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882771 AND mptpi.`type`=3594 To do Qualite : 0.0553948408253684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26882772_16-09-2025_10_53_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26882772 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26882772 AND mptpi.`type`=3594 To do Qualite : 0.09510918209876545 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26888808_16-09-2025_11_41_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26888808 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26888808 AND mptpi.`type`=3594 To do Qualite : 0.1363156741021324 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26890190_16-09-2025_12_31_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26890190 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26890190 AND mptpi.`type`=3594 To do Qualite : 0.06626128127755732 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26890528_16-09-2025_12_42_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26890528 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26890528 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16092025': {'nb_upload': 28, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1383886009, 1383885983, 1383885961, 1383885959, 1383885957, 1383885956, 1383885831, 1383885807, 1383885792, 1383885790, 1383885785, 1383885781, 1383885723, 1383885719, 1383885711, 1383885707, 1383885636, 1383885609, 1383885563, 1383885520, 1383885495, 1383885470, 1383885414, 1383885400, 1383885376, 1383885343, 1383885317, 1383885285] Looping around the photos to save general results len do output : 1 /26890528Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383886009', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885983', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885961', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885959', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885957', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885956', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885831', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885807', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885792', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885790', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885785', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885781', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885723', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885719', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885711', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885707', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885636', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885609', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885563', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885520', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885495', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885470', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885414', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885400', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885376', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885343', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885317', None, None, None, None, None, '3727823') ('3318', None, None, None, None, None, None, None, '3727823') ('3318', '26890528', '1383885285', None, None, None, None, None, '3727823') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.06880950927734375 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7878372669219971 time spend to save output : 0.06916928291320801 total time spend for step 10 : 0.8570065498352051 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 28 set_done_treatment 80.05user 30.58system 2:21.17elapsed 78%CPU (0avgtext+0avgdata 3196360maxresident)k 554952inputs+41016outputs (2814major+2513562minor)pagefaults 0swaps