python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1403052 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3629908'] with mtr_portfolio_ids : ['26310873'] and first list_photo_ids : [] new path : /proc/1403052/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 24 ; length of list_pids : 24 ; length of list_args : 24 time to download the photos : 4.061209440231323 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 29 03:00:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6823 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-29 03:00:38.345921: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-29 03:00:38.376629: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-29 03:00:38.378599: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8010000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-29 03:00:38.378628: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-29 03:00:38.382378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-29 03:00:38.550842: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x387d5260 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-29 03:00:38.550898: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-29 03:00:38.551780: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 03:00:38.552294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 03:00:38.559861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 03:00:38.570654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 03:00:38.572527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 03:00:38.584979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 03:00:38.588009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 03:00:38.608062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 03:00:38.609834: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 03:00:38.610140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 03:00:38.611163: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-29 03:00:38.611188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-29 03:00:38.611201: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-29 03:00:38.613571: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6271 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-29 03:00:39.013053: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 03:00:39.013178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 03:00:39.013198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 03:00:39.013215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 03:00:39.013231: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 03:00:39.013246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 03:00:39.013261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 03:00:39.013277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 03:00:39.014327: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 03:00:39.015460: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 03:00:39.015501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 03:00:39.015517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 03:00:39.015537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 03:00:39.015554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 03:00:39.015568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 03:00:39.015582: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 03:00:39.015597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 03:00:39.016663: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 03:00:39.016703: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-29 03:00:39.016712: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-29 03:00:39.016720: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-29 03:00:39.017812: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6271 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-29 03:00:48.116413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 03:00:48.407514: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 24 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1404041 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 341 tf kernel not reseted sub process len(results) : 24 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 24 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5630 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.000316619873046875 nb_pixel_total : 11475 time to create 1 rle with old method : 0.013568639755249023 length of segment : 183 time for calcul the mask position with numpy : 0.21492457389831543 nb_pixel_total : 1542683 time to create 1 rle with new method : 0.1642169952392578 length of segment : 1322 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 5937 time to create 1 rle with old method : 0.006914377212524414 length of segment : 144 time for calcul the mask position with numpy : 0.0008599758148193359 nb_pixel_total : 42471 time to create 1 rle with old method : 0.0485081672668457 length of segment : 178 time for calcul the mask position with numpy : 0.0004162788391113281 nb_pixel_total : 17688 time to create 1 rle with old method : 0.020871639251708984 length of segment : 157 time for calcul the mask position with numpy : 0.0015528202056884766 nb_pixel_total : 70407 time to create 1 rle with old method : 0.07848525047302246 length of segment : 409 time for calcul the mask position with numpy : 0.012168169021606445 nb_pixel_total : 715675 time to create 1 rle with new method : 0.02422475814819336 length of segment : 992 time for calcul the mask position with numpy : 0.0001552104949951172 nb_pixel_total : 3102 time to create 1 rle with old method : 0.003789663314819336 length of segment : 52 time for calcul the mask position with numpy : 0.00024580955505371094 nb_pixel_total : 10525 time to create 1 rle with old method : 0.012370586395263672 length of segment : 170 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 11592 time to create 1 rle with old method : 0.01384282112121582 length of segment : 140 time for calcul the mask position with numpy : 0.0016350746154785156 nb_pixel_total : 108808 time to create 1 rle with old method : 0.12214946746826172 length of segment : 532 time for calcul the mask position with numpy : 0.0037000179290771484 nb_pixel_total : 119504 time to create 1 rle with old method : 0.13454961776733398 length of segment : 612 time for calcul the mask position with numpy : 0.0008914470672607422 nb_pixel_total : 35581 time to create 1 rle with old method : 0.04155683517456055 length of segment : 143 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 2676 time to create 1 rle with old method : 0.0033249855041503906 length of segment : 44 time for calcul the mask position with numpy : 0.002779722213745117 nb_pixel_total : 119968 time to create 1 rle with old method : 0.16263079643249512 length of segment : 538 time for calcul the mask position with numpy : 0.0005831718444824219 nb_pixel_total : 11856 time to create 1 rle with old method : 0.022739648818969727 length of segment : 163 time for calcul the mask position with numpy : 0.0030133724212646484 nb_pixel_total : 93799 time to create 1 rle with old method : 0.1306464672088623 length of segment : 476 time for calcul the mask position with numpy : 0.0003972053527832031 nb_pixel_total : 12883 time to create 1 rle with old method : 0.015008926391601562 length of segment : 139 time for calcul the mask position with numpy : 0.011846542358398438 nb_pixel_total : 688202 time to create 1 rle with new method : 0.019941091537475586 length of segment : 945 time for calcul the mask position with numpy : 0.00031113624572753906 nb_pixel_total : 7446 time to create 1 rle with old method : 0.011138916015625 length of segment : 97 time for calcul the mask position with numpy : 0.00287628173828125 nb_pixel_total : 126176 time to create 1 rle with old method : 0.14664340019226074 length of segment : 546 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 2993 time to create 1 rle with old method : 0.0036230087280273438 length of segment : 69 time for calcul the mask position with numpy : 0.0004138946533203125 nb_pixel_total : 13671 time to create 1 rle with old method : 0.01570296287536621 length of segment : 118 time for calcul the mask position with numpy : 0.0004317760467529297 nb_pixel_total : 10044 time to create 1 rle with old method : 0.01136016845703125 length of segment : 170 time for calcul the mask position with numpy : 0.005829572677612305 nb_pixel_total : 100163 time to create 1 rle with old method : 0.11404538154602051 length of segment : 499 time for calcul the mask position with numpy : 0.0004470348358154297 nb_pixel_total : 12607 time to create 1 rle with old method : 0.01392817497253418 length of segment : 120 time for calcul the mask position with numpy : 0.0005228519439697266 nb_pixel_total : 7883 time to create 1 rle with old method : 0.009494781494140625 length of segment : 157 time for calcul the mask position with numpy : 0.0025954246520996094 nb_pixel_total : 113577 time to create 1 rle with old method : 0.1291334629058838 length of segment : 559 time for calcul the mask position with numpy : 0.03379631042480469 nb_pixel_total : 1379778 time to create 1 rle with new method : 0.08463239669799805 length of segment : 1513 time for calcul the mask position with numpy : 0.000804901123046875 nb_pixel_total : 14008 time to create 1 rle with old method : 0.015851974487304688 length of segment : 252 time for calcul the mask position with numpy : 0.06505966186523438 nb_pixel_total : 1232707 time to create 1 rle with new method : 0.09240031242370605 length of segment : 1569 time for calcul the mask position with numpy : 0.00037288665771484375 nb_pixel_total : 7970 time to create 1 rle with old method : 0.009516000747680664 length of segment : 113 time for calcul the mask position with numpy : 0.0021409988403320312 nb_pixel_total : 97016 time to create 1 rle with old method : 0.10994482040405273 length of segment : 530 time for calcul the mask position with numpy : 0.0004489421844482422 nb_pixel_total : 17204 time to create 1 rle with old method : 0.022269248962402344 length of segment : 67 time for calcul the mask position with numpy : 0.0006425380706787109 nb_pixel_total : 20426 time to create 1 rle with old method : 0.023726463317871094 length of segment : 230 time for calcul the mask position with numpy : 0.01706218719482422 nb_pixel_total : 1024215 time to create 1 rle with new method : 0.053198814392089844 length of segment : 1599 time for calcul the mask position with numpy : 0.0001995563507080078 nb_pixel_total : 10228 time to create 1 rle with old method : 0.011586427688598633 length of segment : 173 time for calcul the mask position with numpy : 0.0019373893737792969 nb_pixel_total : 10745 time to create 1 rle with old method : 0.012460708618164062 length of segment : 175 time for calcul the mask position with numpy : 0.0021767616271972656 nb_pixel_total : 103467 time to create 1 rle with old method : 0.12047576904296875 length of segment : 480 time for calcul the mask position with numpy : 0.002644062042236328 nb_pixel_total : 112730 time to create 1 rle with old method : 0.13169550895690918 length of segment : 546 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 6190 time to create 1 rle with old method : 0.007196187973022461 length of segment : 104 time for calcul the mask position with numpy : 0.0008134841918945312 nb_pixel_total : 37264 time to create 1 rle with old method : 0.043154239654541016 length of segment : 184 time for calcul the mask position with numpy : 0.0003132820129394531 nb_pixel_total : 9235 time to create 1 rle with old method : 0.012626409530639648 length of segment : 83 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 3081 time to create 1 rle with old method : 0.003826141357421875 length of segment : 60 time for calcul the mask position with numpy : 0.000316619873046875 nb_pixel_total : 9425 time to create 1 rle with old method : 0.011220693588256836 length of segment : 116 time for calcul the mask position with numpy : 0.0022106170654296875 nb_pixel_total : 106452 time to create 1 rle with old method : 0.12545323371887207 length of segment : 533 time for calcul the mask position with numpy : 0.0003001689910888672 nb_pixel_total : 9172 time to create 1 rle with old method : 0.010603189468383789 length of segment : 168 time for calcul the mask position with numpy : 0.0005035400390625 nb_pixel_total : 14387 time to create 1 rle with old method : 0.016989707946777344 length of segment : 146 time for calcul the mask position with numpy : 0.002825021743774414 nb_pixel_total : 105894 time to create 1 rle with old method : 0.12012290954589844 length of segment : 527 time for calcul the mask position with numpy : 0.00028204917907714844 nb_pixel_total : 8163 time to create 1 rle with old method : 0.009809732437133789 length of segment : 81 time for calcul the mask position with numpy : 0.003960609436035156 nb_pixel_total : 4069 time to create 1 rle with old method : 0.005711793899536133 length of segment : 130 time for calcul the mask position with numpy : 0.004804849624633789 nb_pixel_total : 232484 time to create 1 rle with new method : 0.013844966888427734 length of segment : 1620 time for calcul the mask position with numpy : 0.002414226531982422 nb_pixel_total : 105902 time to create 1 rle with old method : 0.11819314956665039 length of segment : 514 time for calcul the mask position with numpy : 0.0007290840148925781 nb_pixel_total : 24417 time to create 1 rle with old method : 0.02773451805114746 length of segment : 431 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 18767 time to create 1 rle with old method : 0.021276473999023438 length of segment : 183 time for calcul the mask position with numpy : 0.0002841949462890625 nb_pixel_total : 10128 time to create 1 rle with old method : 0.011883258819580078 length of segment : 165 time for calcul the mask position with numpy : 0.0005333423614501953 nb_pixel_total : 14079 time to create 1 rle with old method : 0.01654815673828125 length of segment : 366 time for calcul the mask position with numpy : 0.0025780200958251953 nb_pixel_total : 116869 time to create 1 rle with old method : 0.13216185569763184 length of segment : 538 time for calcul the mask position with numpy : 0.000408172607421875 nb_pixel_total : 13180 time to create 1 rle with old method : 0.015852689743041992 length of segment : 164 time for calcul the mask position with numpy : 0.016190528869628906 nb_pixel_total : 878494 time to create 1 rle with new method : 0.02698969841003418 length of segment : 1432 time for calcul the mask position with numpy : 0.0002894401550292969 nb_pixel_total : 10993 time to create 1 rle with old method : 0.012862682342529297 length of segment : 166 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 2235 time to create 1 rle with old method : 0.002973794937133789 length of segment : 48 time spent for convertir_results : 7.293428659439087 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 62 chid ids of type : 3594 Number RLEs to save : 24680 save missing photos in datou_result : time spend for datou_step_exec : 38.744982957839966 time spend to save output : 1.586815357208252 total time spend for step 1 : 40.33179831504822 step2:crop_condition Fri Aug 29 03:01:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 24 ! batch 1 Loaded 62 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756429276_1403052 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.704091787338257 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756429289_1403052 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6933224201202393 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756429291_1403052 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8297240734100342 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756429325_1403052 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.603349685668945 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756429334_1403052 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2329108715057373 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1377705063, 1377704981, 1377704977, 1377704972, 1377704967, 1377704962, 1377704959, 1377704875, 1377704871, 1377704868, 1377704862, 1377704858, 1377704771, 1377704767, 1377704762, 1377704758, 1377704753, 1377704748, 1377704664, 1377704661, 1377704658, 1377704655, 1377704652, 1377704648] Looping around the photos to save general results len do output : 62 /1380019108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380019216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377705063', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704981', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704977', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704972', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704967', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704962', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704959', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704875', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704871', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704868', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704862', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704858', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704771', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704767', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704762', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704758', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704753', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704748', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704664', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704661', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704658', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704655', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704652', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704648', None, None, None, None, None, '3629908') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 210 time used for this insertion : 0.025189876556396484 save_final save missing photos in datou_result : time spend for datou_step_exec : 60.57254219055176 time spend to save output : 0.02715587615966797 total time spend for step 2 : 60.599698066711426 step3:rle_unique_nms_with_priority Fri Aug 29 03:02:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 62 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.13936305046081543 time for calcul the mask position with numpy : 0.017717838287353516 nb_pixel_total : 530917 time to create 1 rle with new method : 0.4158904552459717 time for calcul the mask position with numpy : 0.048000335693359375 nb_pixel_total : 1531208 time to create 1 rle with new method : 0.24312043190002441 time for calcul the mask position with numpy : 0.006265878677368164 nb_pixel_total : 11475 time to create 1 rle with old method : 0.013010025024414062 create new chi : 0.7614138126373291 time to delete rle : 0.022057056427001953 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 4090 TO DO : save crop sub photo not yet done ! save time : 0.29639434814453125 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.32495570182800293 time for calcul the mask position with numpy : 0.07201385498046875 nb_pixel_total : 2007504 time to create 1 rle with new method : 0.2035236358642578 time for calcul the mask position with numpy : 0.006555318832397461 nb_pixel_total : 17688 time to create 1 rle with old method : 0.020065784454345703 time for calcul the mask position with numpy : 0.006543874740600586 nb_pixel_total : 42471 time to create 1 rle with old method : 0.04958701133728027 time for calcul the mask position with numpy : 0.00988459587097168 nb_pixel_total : 5937 time to create 1 rle with old method : 0.006758689880371094 create new chi : 0.3862450122833252 time to delete rle : 0.00048732757568359375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2038 TO DO : save crop sub photo not yet done ! save time : 0.17789435386657715 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.07002830505371094 time for calcul the mask position with numpy : 0.020611047744750977 nb_pixel_total : 1287518 time to create 1 rle with new method : 0.08398294448852539 time for calcul the mask position with numpy : 0.014364480972290039 nb_pixel_total : 715675 time to create 1 rle with new method : 0.2623746395111084 time for calcul the mask position with numpy : 0.008952856063842773 nb_pixel_total : 70407 time to create 1 rle with old method : 0.0817861557006836 create new chi : 0.482515811920166 time to delete rle : 0.0005736351013183594 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 3882 TO DO : save crop sub photo not yet done ! save time : 0.29232335090637207 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.27132296562194824 time for calcul the mask position with numpy : 0.057552337646484375 nb_pixel_total : 2048381 time to create 1 rle with new method : 0.4342465400695801 time for calcul the mask position with numpy : 0.006445169448852539 nb_pixel_total : 11592 time to create 1 rle with old method : 0.013004302978515625 time for calcul the mask position with numpy : 0.006694316864013672 nb_pixel_total : 10525 time to create 1 rle with old method : 0.011812925338745117 time for calcul the mask position with numpy : 0.006531953811645508 nb_pixel_total : 3102 time to create 1 rle with old method : 0.003522634506225586 create new chi : 0.5504000186920166 time to delete rle : 0.00034427642822265625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1804 TO DO : save crop sub photo not yet done ! save time : 0.16255664825439453 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.045909881591796875 time for calcul the mask position with numpy : 0.02349114418029785 nb_pixel_total : 1964792 time to create 1 rle with new method : 0.26494336128234863 time for calcul the mask position with numpy : 0.00841212272644043 nb_pixel_total : 108808 time to create 1 rle with old method : 0.12672042846679688 create new chi : 0.4323439598083496 time to delete rle : 0.0005483627319335938 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2144 TO DO : save crop sub photo not yet done ! save time : 0.2791152000427246 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.16446900367736816 time for calcul the mask position with numpy : 0.06494379043579102 nb_pixel_total : 1954096 time to create 1 rle with new method : 0.18595314025878906 time for calcul the mask position with numpy : 0.007442474365234375 nb_pixel_total : 119504 time to create 1 rle with old method : 0.1352071762084961 create new chi : 0.40430283546447754 time to delete rle : 0.00042819976806640625 batch 1 Loaded 3 chid ids of type : 3594 +++Number RLEs to save : 2304 TO DO : save crop sub photo not yet done ! save time : 0.21278071403503418 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.11063861846923828 time for calcul the mask position with numpy : 0.05989480018615723 nb_pixel_total : 1915375 time to create 1 rle with new method : 0.09001827239990234 time for calcul the mask position with numpy : 0.006985187530517578 nb_pixel_total : 119968 time to create 1 rle with old method : 0.13544988632202148 time for calcul the mask position with numpy : 0.007131338119506836 nb_pixel_total : 2676 time to create 1 rle with old method : 0.0030260086059570312 time for calcul the mask position with numpy : 0.006561994552612305 nb_pixel_total : 35581 time to create 1 rle with old method : 0.04121661186218262 create new chi : 0.36113834381103516 time to delete rle : 0.0005025863647460938 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2530 TO DO : save crop sub photo not yet done ! save time : 0.2058115005493164 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.034475088119506836 time for calcul the mask position with numpy : 0.020555973052978516 nb_pixel_total : 2061744 time to create 1 rle with new method : 0.2665259838104248 time for calcul the mask position with numpy : 0.0066547393798828125 nb_pixel_total : 11856 time to create 1 rle with old method : 0.013385772705078125 create new chi : 0.31452035903930664 time to delete rle : 0.00025773048400878906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1406 TO DO : save crop sub photo not yet done ! save time : 0.1287984848022461 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.10950183868408203 time for calcul the mask position with numpy : 0.17957687377929688 nb_pixel_total : 1271270 time to create 1 rle with new method : 0.08404302597045898 time for calcul the mask position with numpy : 0.010341167449951172 nb_pixel_total : 7446 time to create 1 rle with old method : 0.009329795837402344 time for calcul the mask position with numpy : 0.014599084854125977 nb_pixel_total : 688202 time to create 1 rle with new method : 0.3458826541900635 time for calcul the mask position with numpy : 0.010308027267456055 nb_pixel_total : 12883 time to create 1 rle with old method : 0.014436006546020508 time for calcul the mask position with numpy : 0.011692523956298828 nb_pixel_total : 93799 time to create 1 rle with old method : 0.10641789436340332 create new chi : 0.796889066696167 time to delete rle : 0.0008015632629394531 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4394 TO DO : save crop sub photo not yet done ! save time : 0.31007981300354004 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.07355403900146484 time for calcul the mask position with numpy : 0.021747827529907227 nb_pixel_total : 1920716 time to create 1 rle with new method : 0.09318876266479492 time for calcul the mask position with numpy : 0.006445169448852539 nb_pixel_total : 10044 time to create 1 rle with old method : 0.013143062591552734 time for calcul the mask position with numpy : 0.006358146667480469 nb_pixel_total : 13671 time to create 1 rle with old method : 0.015210628509521484 time for calcul the mask position with numpy : 0.006156206130981445 nb_pixel_total : 2993 time to create 1 rle with old method : 0.003368377685546875 time for calcul the mask position with numpy : 0.00708770751953125 nb_pixel_total : 126176 time to create 1 rle with old method : 0.1428823471069336 create new chi : 0.3264286518096924 time to delete rle : 0.0004928112030029297 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2886 TO DO : save crop sub photo not yet done ! save time : 0.24755549430847168 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.044068336486816406 time for calcul the mask position with numpy : 0.01988363265991211 nb_pixel_total : 1960830 time to create 1 rle with new method : 0.08626580238342285 time for calcul the mask position with numpy : 0.006317853927612305 nb_pixel_total : 12607 time to create 1 rle with old method : 0.014125347137451172 time for calcul the mask position with numpy : 0.006833314895629883 nb_pixel_total : 100163 time to create 1 rle with old method : 0.11109471321105957 create new chi : 0.2519972324371338 time to delete rle : 0.0004487037658691406 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2318 TO DO : save crop sub photo not yet done ! save time : 0.19072246551513672 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.1586620807647705 time for calcul the mask position with numpy : 0.45113635063171387 nb_pixel_total : 1952140 time to create 1 rle with new method : 0.46430110931396484 time for calcul the mask position with numpy : 0.008427619934082031 nb_pixel_total : 113577 time to create 1 rle with old method : 0.2131972312927246 time for calcul the mask position with numpy : 0.0074825286865234375 nb_pixel_total : 7883 time to create 1 rle with old method : 0.014133214950561523 create new chi : 1.172827959060669 time to delete rle : 0.0005369186401367188 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2512 TO DO : save crop sub photo not yet done ! save time : 0.250838041305542 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.041022539138793945 time for calcul the mask position with numpy : 0.011154651641845703 nb_pixel_total : 693822 time to create 1 rle with new method : 0.37620997428894043 time for calcul the mask position with numpy : 0.052658796310424805 nb_pixel_total : 1379778 time to create 1 rle with new method : 0.20338177680969238 create new chi : 0.6601812839508057 time to delete rle : 0.0005671977996826172 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 4106 TO DO : save crop sub photo not yet done ! save time : 0.36025381088256836 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.15430498123168945 time for calcul the mask position with numpy : 0.03975629806518555 nb_pixel_total : 828152 time to create 1 rle with new method : 0.16236424446105957 time for calcul the mask position with numpy : 0.12553930282592773 nb_pixel_total : 1231440 time to create 1 rle with new method : 0.12210845947265625 time for calcul the mask position with numpy : 0.007866382598876953 nb_pixel_total : 14008 time to create 1 rle with old method : 0.016054630279541016 create new chi : 0.49268388748168945 time to delete rle : 0.002244234085083008 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 4600 TO DO : save crop sub photo not yet done ! save time : 0.32810187339782715 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.2733936309814453 time for calcul the mask position with numpy : 0.03440284729003906 nb_pixel_total : 924457 time to create 1 rle with new method : 0.10107064247131348 time for calcul the mask position with numpy : 0.013551473617553711 nb_pixel_total : 1006527 time to create 1 rle with new method : 0.130401611328125 time for calcul the mask position with numpy : 0.006686210632324219 nb_pixel_total : 20426 time to create 1 rle with old method : 0.04523873329162598 time for calcul the mask position with numpy : 0.01016998291015625 nb_pixel_total : 17204 time to create 1 rle with old method : 0.03418397903442383 time for calcul the mask position with numpy : 0.011830329895019531 nb_pixel_total : 97016 time to create 1 rle with old method : 0.11567568778991699 time for calcul the mask position with numpy : 0.006666898727416992 nb_pixel_total : 7970 time to create 1 rle with old method : 0.009562015533447266 create new chi : 0.5389301776885986 time to delete rle : 0.0010786056518554688 batch 1 Loaded 12 chid ids of type : 3594 ++++++++Number RLEs to save : 5962 TO DO : save crop sub photo not yet done ! save time : 0.39696502685546875 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04813218116760254 time for calcul the mask position with numpy : 0.022119760513305664 nb_pixel_total : 1959388 time to create 1 rle with new method : 0.11486697196960449 time for calcul the mask position with numpy : 0.007333278656005859 nb_pixel_total : 103467 time to create 1 rle with old method : 0.11424493789672852 time for calcul the mask position with numpy : 0.006215095520019531 nb_pixel_total : 10745 time to create 1 rle with old method : 0.012133359909057617 create new chi : 0.2853245735168457 time to delete rle : 0.0003902912139892578 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2390 TO DO : save crop sub photo not yet done ! save time : 0.22875380516052246 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.21550369262695312 time for calcul the mask position with numpy : 0.09379434585571289 nb_pixel_total : 1917416 time to create 1 rle with new method : 0.25810813903808594 time for calcul the mask position with numpy : 0.007803916931152344 nb_pixel_total : 37264 time to create 1 rle with old method : 0.041742801666259766 time for calcul the mask position with numpy : 0.006629228591918945 nb_pixel_total : 6190 time to create 1 rle with old method : 0.006951093673706055 time for calcul the mask position with numpy : 0.0070955753326416016 nb_pixel_total : 112730 time to create 1 rle with old method : 0.12510085105895996 create new chi : 0.5590760707855225 time to delete rle : 0.00039958953857421875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2748 TO DO : save crop sub photo not yet done ! save time : 0.24132370948791504 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05569148063659668 time for calcul the mask position with numpy : 0.07330632209777832 nb_pixel_total : 2051859 time to create 1 rle with new method : 0.19715666770935059 time for calcul the mask position with numpy : 0.006503105163574219 nb_pixel_total : 9425 time to create 1 rle with old method : 0.013890981674194336 time for calcul the mask position with numpy : 0.006519317626953125 nb_pixel_total : 3081 time to create 1 rle with old method : 0.0037841796875 time for calcul the mask position with numpy : 0.006471872329711914 nb_pixel_total : 9235 time to create 1 rle with old method : 0.010782718658447266 create new chi : 0.32918357849121094 time to delete rle : 0.0003802776336669922 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1598 TO DO : save crop sub photo not yet done ! save time : 0.139434814453125 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04634237289428711 time for calcul the mask position with numpy : 0.08356142044067383 nb_pixel_total : 1957976 time to create 1 rle with new method : 0.10653519630432129 time for calcul the mask position with numpy : 0.011645078659057617 nb_pixel_total : 9172 time to create 1 rle with old method : 0.010361194610595703 time for calcul the mask position with numpy : 0.0072057247161865234 nb_pixel_total : 106452 time to create 1 rle with old method : 0.12165355682373047 create new chi : 0.3506917953491211 time to delete rle : 0.0004992485046386719 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2482 TO DO : save crop sub photo not yet done ! save time : 0.18280720710754395 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.28764867782592773 time for calcul the mask position with numpy : 0.07438898086547852 nb_pixel_total : 1953319 time to create 1 rle with new method : 0.12257933616638184 time for calcul the mask position with numpy : 0.0068204402923583984 nb_pixel_total : 105894 time to create 1 rle with old method : 0.1806502342224121 time for calcul the mask position with numpy : 0.008116006851196289 nb_pixel_total : 14387 time to create 1 rle with old method : 0.0272829532623291 create new chi : 0.4316370487213135 time to delete rle : 0.000720977783203125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2426 TO DO : save crop sub photo not yet done ! save time : 0.1811540126800537 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.16500401496887207 time for calcul the mask position with numpy : 0.13184142112731934 nb_pixel_total : 1828935 time to create 1 rle with new method : 0.11956286430358887 time for calcul the mask position with numpy : 0.010038375854492188 nb_pixel_total : 232433 time to create 1 rle with new method : 0.4248173236846924 time for calcul the mask position with numpy : 0.006679534912109375 nb_pixel_total : 4069 time to create 1 rle with old method : 0.004809141159057617 time for calcul the mask position with numpy : 0.010585546493530273 nb_pixel_total : 8163 time to create 1 rle with old method : 0.009206056594848633 create new chi : 0.7289745807647705 time to delete rle : 0.0013041496276855469 batch 1 Loaded 7 chid ids of type : 3594 +++++++++++Number RLEs to save : 4734 TO DO : save crop sub photo not yet done ! save time : 0.3395378589630127 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.08629059791564941 time for calcul the mask position with numpy : 0.019716262817382812 nb_pixel_total : 1914386 time to create 1 rle with new method : 0.07962799072265625 time for calcul the mask position with numpy : 0.006449699401855469 nb_pixel_total : 10128 time to create 1 rle with old method : 0.011361360549926758 time for calcul the mask position with numpy : 0.006916522979736328 nb_pixel_total : 18767 time to create 1 rle with old method : 0.021438121795654297 time for calcul the mask position with numpy : 0.006945133209228516 nb_pixel_total : 24417 time to create 1 rle with old method : 0.02761054039001465 time for calcul the mask position with numpy : 0.009238243103027344 nb_pixel_total : 105902 time to create 1 rle with old method : 0.12417912483215332 create new chi : 0.32506346702575684 time to delete rle : 0.0006666183471679688 batch 1 Loaded 9 chid ids of type : 3594 +++++++++++++Number RLEs to save : 3666 TO DO : save crop sub photo not yet done ! save time : 0.2653970718383789 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.041829824447631836 time for calcul the mask position with numpy : 0.026945829391479492 nb_pixel_total : 2059521 time to create 1 rle with new method : 0.30937838554382324 time for calcul the mask position with numpy : 0.00813150405883789 nb_pixel_total : 14079 time to create 1 rle with old method : 0.016278982162475586 create new chi : 0.3610959053039551 time to delete rle : 0.0003960132598876953 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1812 TO DO : save crop sub photo not yet done ! save time : 0.16032743453979492 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.18413686752319336 time for calcul the mask position with numpy : 0.041657447814941406 nb_pixel_total : 1062751 time to create 1 rle with new method : 0.3161299228668213 time for calcul the mask position with numpy : 0.00649261474609375 nb_pixel_total : 10993 time to create 1 rle with old method : 0.01668095588684082 time for calcul the mask position with numpy : 0.021463394165039062 nb_pixel_total : 869807 time to create 1 rle with new method : 0.3697030544281006 time for calcul the mask position with numpy : 0.007833480834960938 nb_pixel_total : 13180 time to create 1 rle with old method : 0.015105009078979492 time for calcul the mask position with numpy : 0.008063077926635742 nb_pixel_total : 116869 time to create 1 rle with old method : 0.17089390754699707 create new chi : 0.9848275184631348 time to delete rle : 0.0009875297546386719 batch 1 Loaded 10 chid ids of type : 3594 ++++++Number RLEs to save : 5656 TO DO : save crop sub photo not yet done ! save time : 0.36745595932006836 map_output_result : {1377705063: (0.0, 'Should be the crop_list due to order', 0), 1377704981: (0.0, 'Should be the crop_list due to order', 0), 1377704977: (0.0, 'Should be the crop_list due to order', 0), 1377704972: (0.0, 'Should be the crop_list due to order', 0), 1377704967: (0.0, 'Should be the crop_list due to order', 0), 1377704962: (0.0, 'Should be the crop_list due to order', 0), 1377704959: (0.0, 'Should be the crop_list due to order', 0), 1377704875: (0.0, 'Should be the crop_list due to order', 0), 1377704871: (0.0, 'Should be the crop_list due to order', 0), 1377704868: (0.0, 'Should be the crop_list due to order', 0), 1377704862: (0.0, 'Should be the crop_list due to order', 0), 1377704858: (0.0, 'Should be the crop_list due to order', 0), 1377704771: (0.0, 'Should be the crop_list due to order', 0), 1377704767: (0.0, 'Should be the crop_list due to order', 0), 1377704762: (0.0, 'Should be the crop_list due to order', 0), 1377704758: (0.0, 'Should be the crop_list due to order', 0), 1377704753: (0.0, 'Should be the crop_list due to order', 0), 1377704748: (0.0, 'Should be the crop_list due to order', 0), 1377704664: (0.0, 'Should be the crop_list due to order', 0), 1377704661: (0.0, 'Should be the crop_list due to order', 0), 1377704658: (0.0, 'Should be the crop_list due to order', 0), 1377704655: (0.0, 'Should be the crop_list due to order', 0), 1377704652: (0.0, 'Should be the crop_list due to order', 0), 1377704648: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1377705063, 1377704981, 1377704977, 1377704972, 1377704967, 1377704962, 1377704959, 1377704875, 1377704871, 1377704868, 1377704862, 1377704858, 1377704771, 1377704767, 1377704762, 1377704758, 1377704753, 1377704748, 1377704664, 1377704661, 1377704658, 1377704655, 1377704652, 1377704648] Looping around the photos to save general results len do output : 24 /1377705063.Didn't retrieve data . /1377704981.Didn't retrieve data . /1377704977.Didn't retrieve data . /1377704972.Didn't retrieve data . /1377704967.Didn't retrieve data . /1377704962.Didn't retrieve data . /1377704959.Didn't retrieve data . /1377704875.Didn't retrieve data . /1377704871.Didn't retrieve data . /1377704868.Didn't retrieve data . /1377704862.Didn't retrieve data . /1377704858.Didn't retrieve data . /1377704771.Didn't retrieve data . /1377704767.Didn't retrieve data . /1377704762.Didn't retrieve data . /1377704758.Didn't retrieve data . /1377704753.Didn't retrieve data . /1377704748.Didn't retrieve data . /1377704664.Didn't retrieve data . /1377704661.Didn't retrieve data . /1377704658.Didn't retrieve data . /1377704655.Didn't retrieve data . /1377704652.Didn't retrieve data . /1377704648.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377705063', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704981', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704977', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704972', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704967', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704962', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704959', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704875', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704871', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704868', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704862', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704858', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704771', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704767', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704762', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704758', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704753', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704748', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704664', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704661', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704658', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704655', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704652', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704648', None, None, None, None, None, '3629908') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.01708674430847168 save_final save missing photos in datou_result : time spend for datou_step_exec : 22.38789439201355 time spend to save output : 0.017996788024902344 total time spend for step 3 : 22.405891180038452 step4:ventilate_hashtags_in_portfolio Fri Aug 29 03:02:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26310873 get user id for portfolio 26310873 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310873 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','pet_clair','pet_fonce','carton','flou','background','mal_croppe','papier','autre','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310873 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','pet_clair','pet_fonce','carton','flou','background','mal_croppe','papier','autre','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310873 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','pet_clair','pet_fonce','carton','flou','background','mal_croppe','papier','autre','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26313869,26313870,26313871,26313872,26313873,26313874,26313875,26313876,26313877,26313878,26313879?tags=environnement,metal,pet_clair,pet_fonce,carton,flou,background,mal_croppe,papier,autre,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1377705063, 1377704981, 1377704977, 1377704972, 1377704967, 1377704962, 1377704959, 1377704875, 1377704871, 1377704868, 1377704862, 1377704858, 1377704771, 1377704767, 1377704762, 1377704758, 1377704753, 1377704748, 1377704664, 1377704661, 1377704658, 1377704655, 1377704652, 1377704648] Looping around the photos to save general results len do output : 1 /26310873. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377705063', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704981', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704977', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704972', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704967', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704962', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704959', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704875', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704871', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704868', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704862', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704858', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704771', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704767', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704762', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704758', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704753', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704748', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704664', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704661', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704658', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704655', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704652', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704648', None, None, None, None, None, '3629908') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.017168521881103516 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6809368133544922 time spend to save output : 0.017409563064575195 total time spend for step 4 : 1.6983463764190674 step5:final Fri Aug 29 03:02:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1377705063: ('0.19569699636702673',), 1377704981: ('0.19569699636702673',), 1377704977: ('0.19569699636702673',), 1377704972: ('0.19569699636702673',), 1377704967: ('0.19569699636702673',), 1377704962: ('0.19569699636702673',), 1377704959: ('0.19569699636702673',), 1377704875: ('0.19569699636702673',), 1377704871: ('0.19569699636702673',), 1377704868: ('0.19569699636702673',), 1377704862: ('0.19569699636702673',), 1377704858: ('0.19569699636702673',), 1377704771: ('0.19569699636702673',), 1377704767: ('0.19569699636702673',), 1377704762: ('0.19569699636702673',), 1377704758: ('0.19569699636702673',), 1377704753: ('0.19569699636702673',), 1377704748: ('0.19569699636702673',), 1377704664: ('0.19569699636702673',), 1377704661: ('0.19569699636702673',), 1377704658: ('0.19569699636702673',), 1377704655: ('0.19569699636702673',), 1377704652: ('0.19569699636702673',), 1377704648: ('0.19569699636702673',)} new output for save of step final : {1377705063: ('0.19569699636702673',), 1377704981: ('0.19569699636702673',), 1377704977: ('0.19569699636702673',), 1377704972: ('0.19569699636702673',), 1377704967: ('0.19569699636702673',), 1377704962: ('0.19569699636702673',), 1377704959: ('0.19569699636702673',), 1377704875: ('0.19569699636702673',), 1377704871: ('0.19569699636702673',), 1377704868: ('0.19569699636702673',), 1377704862: ('0.19569699636702673',), 1377704858: ('0.19569699636702673',), 1377704771: ('0.19569699636702673',), 1377704767: ('0.19569699636702673',), 1377704762: ('0.19569699636702673',), 1377704758: ('0.19569699636702673',), 1377704753: ('0.19569699636702673',), 1377704748: ('0.19569699636702673',), 1377704664: ('0.19569699636702673',), 1377704661: ('0.19569699636702673',), 1377704658: ('0.19569699636702673',), 1377704655: ('0.19569699636702673',), 1377704652: ('0.19569699636702673',), 1377704648: ('0.19569699636702673',)} [1377705063, 1377704981, 1377704977, 1377704972, 1377704967, 1377704962, 1377704959, 1377704875, 1377704871, 1377704868, 1377704862, 1377704858, 1377704771, 1377704767, 1377704762, 1377704758, 1377704753, 1377704748, 1377704664, 1377704661, 1377704658, 1377704655, 1377704652, 1377704648] Looping around the photos to save general results len do output : 24 /1377705063.Didn't retrieve data . /1377704981.Didn't retrieve data . /1377704977.Didn't retrieve data . /1377704972.Didn't retrieve data . /1377704967.Didn't retrieve data . /1377704962.Didn't retrieve data . /1377704959.Didn't retrieve data . /1377704875.Didn't retrieve data . /1377704871.Didn't retrieve data . /1377704868.Didn't retrieve data . /1377704862.Didn't retrieve data . /1377704858.Didn't retrieve data . /1377704771.Didn't retrieve data . /1377704767.Didn't retrieve data . /1377704762.Didn't retrieve data . /1377704758.Didn't retrieve data . /1377704753.Didn't retrieve data . /1377704748.Didn't retrieve data . /1377704664.Didn't retrieve data . /1377704661.Didn't retrieve data . /1377704658.Didn't retrieve data . /1377704655.Didn't retrieve data . /1377704652.Didn't retrieve data . /1377704648.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377705063', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704981', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704977', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704972', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704967', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704962', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704959', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704875', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704871', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704868', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704862', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704858', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704771', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704767', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704762', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704758', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704753', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704748', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704664', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704661', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704658', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704655', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704652', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704648', None, None, None, None, None, '3629908') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.014992713928222656 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12600111961364746 time spend to save output : 0.015917301177978516 total time spend for step 5 : 0.14191842079162598 step6:blur_detection Fri Aug 29 03:02:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756429230_1403052_1377705063_aa3a3905eefdae15a7f33ad4b1356169.jpg resize: (1080, 1920) 1377705063 -2.802036424540045 treat image : temp/1756429230_1403052_1377704981_f761e6b7620da94927a4a3c83a4536de.jpg resize: (1080, 1920) 1377704981 -2.375183241609379 treat image : temp/1756429230_1403052_1377704977_52086d7a016a863b3df6abe389866d12.jpg resize: (1080, 1920) 1377704977 -1.5362071318326351 treat image : temp/1756429230_1403052_1377704972_db3df7c527755f2cfcd049cdf38155b8.jpg resize: (1080, 1920) 1377704972 -2.4267332741741447 treat image : temp/1756429230_1403052_1377704967_56e23cd7b22ae0887e29c2031f4bd199.jpg resize: (1080, 1920) 1377704967 -1.4127630046890092 treat image : temp/1756429230_1403052_1377704962_0bb672926d7be9d1397aaeea5e8649bf.jpg resize: (1080, 1920) 1377704962 -2.533115323547989 treat image : temp/1756429230_1403052_1377704959_14cd54fe4af16560394057ce6439ad7c.jpg resize: (1080, 1920) 1377704959 -2.5982868229628657 treat image : temp/1756429230_1403052_1377704875_78ffe468f808661c119e7eaba43c5018.jpg resize: (1080, 1920) 1377704875 -2.173223103158519 treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde.jpg resize: (1080, 1920) 1377704871 -2.215607344538046 treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6.jpg resize: (1080, 1920) 1377704868 -4.583331441137494 treat image : temp/1756429230_1403052_1377704862_549c7857787113099c5db3eea663db24.jpg resize: (1080, 1920) 1377704862 -3.1245365820699456 treat image : temp/1756429230_1403052_1377704858_cc93a2fed7e47ba7070fe6a561f1a824.jpg resize: (1080, 1920) 1377704858 -1.7981415229092006 treat image : temp/1756429230_1403052_1377704771_714e7a8ec85df4504c309b2a14699d6f.jpg resize: (1080, 1920) 1377704771 -2.8410957414585853 treat image : temp/1756429230_1403052_1377704767_552e0324904deb0feacdbc6fa4c29303.jpg resize: (1080, 1920) 1377704767 -2.791742571942437 treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16.jpg resize: (1080, 1920) 1377704762 -3.1330048136169206 treat image : temp/1756429230_1403052_1377704758_e4f5c7a16367a25bd1d8fda74d8c5edf.jpg resize: (1080, 1920) 1377704758 -2.2673123643987134 treat image : temp/1756429230_1403052_1377704753_13f33611bb1097fcf881fc6b71c33b7f.jpg resize: (1080, 1920) 1377704753 -0.4659557262340363 treat image : temp/1756429230_1403052_1377704748_9b070f3da1a1a0dc1b226f53f2895b0f.jpg resize: (1080, 1920) 1377704748 -2.5467361836574147 treat image : temp/1756429230_1403052_1377704664_989281564f484d39d437c89029f328f4.jpg resize: (1080, 1920) 1377704664 -2.311690135905743 treat image : temp/1756429230_1403052_1377704661_5adbe03e4470c0f474b695c9fdb80ffd.jpg resize: (1080, 1920) 1377704661 -2.654113525711373 treat image : temp/1756429230_1403052_1377704658_ecef9e1f24962653102cd3bc6ede79d2.jpg resize: (1080, 1920) 1377704658 -2.698534652136582 treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358.jpg resize: (1080, 1920) 1377704655 -2.983645275687994 treat image : temp/1756429230_1403052_1377704652_e6716a57a5ce93feb0528e300bcc59f3.jpg resize: (1080, 1920) 1377704652 -2.5710698289643292 treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f.jpg resize: (1080, 1920) 1377704648 -4.698216979391919 treat image : temp/1756429230_1403052_1377705063_aa3a3905eefdae15a7f33ad4b1356169_rle_crop_3934921440_0.png resize: (183, 90) 1380019108 -1.6455973439832732 treat image : temp/1756429230_1403052_1377704981_f761e6b7620da94927a4a3c83a4536de_rle_crop_3934921442_0.png resize: (144, 69) 1380019109 -2.155235559513345 treat image : temp/1756429230_1403052_1377704972_db3df7c527755f2cfcd049cdf38155b8_rle_crop_3934921447_0.png resize: (50, 73) 1380019110 5.848539911365842 treat image : temp/1756429230_1403052_1377704972_db3df7c527755f2cfcd049cdf38155b8_rle_crop_3934921448_0.png resize: (170, 112) 1380019111 -0.5110110809933778 treat image : temp/1756429230_1403052_1377704875_78ffe468f808661c119e7eaba43c5018_rle_crop_3934921455_0.png resize: (162, 86) 1380019112 0.831488030643537 treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6_rle_crop_3934921461_0.png resize: (68, 101) 1380019113 -2.6301815687513734 treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6_rle_crop_3934921463_0.png resize: (170, 109) 1380019114 -0.6428703673732045 treat image : temp/1756429230_1403052_1377704858_cc93a2fed7e47ba7070fe6a561f1a824_rle_crop_3934921466_0.png resize: (157, 149) 1380019115 -2.109435275010484 treat image : temp/1756429230_1403052_1377704767_552e0324904deb0feacdbc6fa4c29303_rle_crop_3934921469_0.png resize: (252, 151) 1380019116 -2.129155373230724 treat image : temp/1756429230_1403052_1377704758_e4f5c7a16367a25bd1d8fda74d8c5edf_rle_crop_3934921477_0.png resize: (175, 112) 1380019117 -0.4539367338655616 treat image : temp/1756429230_1403052_1377704753_13f33611bb1097fcf881fc6b71c33b7f_rle_crop_3934921480_0.png resize: (102, 77) 1380019118 0.8167961899673333 treat image : temp/1756429230_1403052_1377704748_9b070f3da1a1a0dc1b226f53f2895b0f_rle_crop_3934921483_0.png resize: (60, 72) 1380019119 0.6180950957473716 treat image : temp/1756429230_1403052_1377704664_989281564f484d39d437c89029f328f4_rle_crop_3934921486_0.png resize: (168, 113) 1380019120 -1.5673961588308494 treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358_rle_crop_3934921495_0.png resize: (165, 109) 1380019121 -0.4897338041933768 treat image : temp/1756429230_1403052_1377704652_e6716a57a5ce93feb0528e300bcc59f3_rle_crop_3934921496_0.png resize: (215, 125) 1380019122 -2.869816998202701 treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921501_0.png resize: (48, 82) 1380019123 -2.555583641211025 treat image : temp/1756429230_1403052_1377704981_f761e6b7620da94927a4a3c83a4536de_rle_crop_3934921444_0.png resize: (111, 245) 1380019128 -2.2742833893204044 treat image : temp/1756429230_1403052_1377704977_52086d7a016a863b3df6abe389866d12_rle_crop_3934921446_0.png resize: (992, 977) 1380019129 1.5797515212396087 treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde_rle_crop_3934921457_0.png resize: (139, 131) 1380019130 -1.0789598406947278 treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde_rle_crop_3934921458_0.png resize: (943, 988) 1380019132 0.6701883377375422 treat image : temp/1756429230_1403052_1377704658_ecef9e1f24962653102cd3bc6ede79d2_rle_crop_3934921489_0.png resize: (81, 129) 1380019133 -0.9568320951185548 treat image : temp/1756429230_1403052_1377704658_ecef9e1f24962653102cd3bc6ede79d2_rle_crop_3934921491_0.png resize: (856, 658) 1380019134 -0.40237490098257195 treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921471_0.png resize: (113, 95) 1380019137 -2.3304334195779766 treat image : temp/1756429230_1403052_1377705063_aa3a3905eefdae15a7f33ad4b1356169_rle_crop_3934921441_0.png resize: (966, 1800) 1380019157 -2.935513877445868 treat image : temp/1756429230_1403052_1377704981_f761e6b7620da94927a4a3c83a4536de_rle_crop_3934921443_0.png resize: (170, 366) 1380019158 -3.6033657798980983 treat image : temp/1756429230_1403052_1377704977_52086d7a016a863b3df6abe389866d12_rle_crop_3934921445_0.png resize: (359, 388) 1380019159 -0.6397522048732409 treat image : temp/1756429230_1403052_1377704972_db3df7c527755f2cfcd049cdf38155b8_rle_crop_3934921449_0.png resize: (139, 141) 1380019160 -2.2993755288448945 treat image : temp/1756429230_1403052_1377704967_56e23cd7b22ae0887e29c2031f4bd199_rle_crop_3934921450_0.png resize: (522, 338) 1380019161 0.15783967413343158 treat image : temp/1756429230_1403052_1377704962_0bb672926d7be9d1397aaeea5e8649bf_rle_crop_3934921451_0.png resize: (528, 343) 1380019162 -0.8761796235198779 treat image : temp/1756429230_1403052_1377704959_14cd54fe4af16560394057ce6439ad7c_rle_crop_3934921452_0.png resize: (143, 287) 1380019163 -4.366682365535081 treat image : temp/1756429230_1403052_1377704959_14cd54fe4af16560394057ce6439ad7c_rle_crop_3934921453_0.png resize: (44, 70) 1380019164 -1.2844782605747633 treat image : temp/1756429230_1403052_1377704959_14cd54fe4af16560394057ce6439ad7c_rle_crop_3934921454_0.png resize: (530, 374) 1380019165 0.2649572127347527 treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde_rle_crop_3934921456_0.png resize: (473, 347) 1380019166 -0.3433515227295518 treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde_rle_crop_3934921459_0.png resize: (97, 94) 1380019167 -4.3183628877275835 treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6_rle_crop_3934921460_0.png resize: (543, 399) 1380019168 -0.4061688944834263 treat image : temp/1756429230_1403052_1377704862_549c7857787113099c5db3eea663db24_rle_crop_3934921464_0.png resize: (496, 354) 1380019169 0.22458289006244933 treat image : temp/1756429230_1403052_1377704858_cc93a2fed7e47ba7070fe6a561f1a824_rle_crop_3934921467_0.png resize: (558, 359) 1380019170 0.10103718811804059 treat image : temp/1756429230_1403052_1377704771_714e7a8ec85df4504c309b2a14699d6f_rle_crop_3934921468_0.png resize: (1000, 1654) 1380019171 -2.0764179769389113 treat image : temp/1756429230_1403052_1377704767_552e0324904deb0feacdbc6fa4c29303_rle_crop_3934921470_0.png resize: (1004, 1535) 1380019172 -1.9262573722626772 treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921472_0.png resize: (516, 331) 1380019173 -0.3896021085475342 treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921473_0.png resize: (65, 290) 1380019174 -3.276082498733478 treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921474_0.png resize: (230, 166) 1380019175 -1.679661884820744 treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921475_0.png resize: (986, 1234) 1380019176 -3.190254106372096 treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921476_0.png resize: (173, 82) 1380019177 -1.7354164935058742 treat image : temp/1756429230_1403052_1377704758_e4f5c7a16367a25bd1d8fda74d8c5edf_rle_crop_3934921478_0.png resize: (478, 342) 1380019178 0.04620695283431586 treat image : temp/1756429230_1403052_1377704753_13f33611bb1097fcf881fc6b71c33b7f_rle_crop_3934921479_0.png resize: (535, 389) 1380019179 -0.07888515719221767 treat image : temp/1756429230_1403052_1377704753_13f33611bb1097fcf881fc6b71c33b7f_rle_crop_3934921481_0.png resize: (147, 334) 1380019180 -2.7755925255372325 treat image : temp/1756429230_1403052_1377704748_9b070f3da1a1a0dc1b226f53f2895b0f_rle_crop_3934921482_0.png resize: (83, 159) 1380019181 -1.896169422477543 treat image : temp/1756429230_1403052_1377704748_9b070f3da1a1a0dc1b226f53f2895b0f_rle_crop_3934921484_0.png resize: (116, 120) 1380019182 -0.3059261104014589 treat image : temp/1756429230_1403052_1377704664_989281564f484d39d437c89029f328f4_rle_crop_3934921485_0.png resize: (527, 342) 1380019183 0.1555206892718946 treat image : temp/1756429230_1403052_1377704661_5adbe03e4470c0f474b695c9fdb80ffd_rle_crop_3934921487_0.png resize: (133, 129) 1380019184 -3.2820267088124044 treat image : temp/1756429230_1403052_1377704661_5adbe03e4470c0f474b695c9fdb80ffd_rle_crop_3934921488_0.png resize: (507, 363) 1380019186 -0.3420969452155444 treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358_rle_crop_3934921492_0.png resize: (512, 336) 1380019187 0.49626854430930756 treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358_rle_crop_3934921493_0.png resize: (191, 203) 1380019188 -4.382781493111737 treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358_rle_crop_3934921494_0.png resize: (183, 138) 1380019190 -1.1730348607580257 treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921497_0.png resize: (537, 356) 1380019191 0.20169618082492438 treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921499_0.png resize: (935, 1261) 1380019192 -3.8767560858044146 treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921500_0.png resize: (166, 110) 1380019194 -0.43031644510958406 treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6_rle_crop_3934921462_0.png resize: (112, 156) 1380019212 -3.069112380579999 treat image : temp/1756429230_1403052_1377704862_549c7857787113099c5db3eea663db24_rle_crop_3934921465_0.png resize: (112, 143) 1380019213 -2.2786634582871477 treat image : temp/1756429230_1403052_1377704658_ecef9e1f24962653102cd3bc6ede79d2_rle_crop_3934921490_0.png resize: (305, 288) 1380019215 1.3265895913468222 treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921498_0.png resize: (133, 141) 1380019216 -2.4779807170875054 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 86 time used for this insertion : 0.018625974655151367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 86 time used for this insertion : 0.025019168853759766 save missing photos in datou_result : time spend for datou_step_exec : 23.654689073562622 time spend to save output : 0.048399925231933594 total time spend for step 6 : 23.703088998794556 step7:brightness Fri Aug 29 03:03:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756429230_1403052_1377705063_aa3a3905eefdae15a7f33ad4b1356169.jpg treat image : temp/1756429230_1403052_1377704981_f761e6b7620da94927a4a3c83a4536de.jpg treat image : temp/1756429230_1403052_1377704977_52086d7a016a863b3df6abe389866d12.jpg treat image : temp/1756429230_1403052_1377704972_db3df7c527755f2cfcd049cdf38155b8.jpg treat image : temp/1756429230_1403052_1377704967_56e23cd7b22ae0887e29c2031f4bd199.jpg treat image : temp/1756429230_1403052_1377704962_0bb672926d7be9d1397aaeea5e8649bf.jpg treat image : temp/1756429230_1403052_1377704959_14cd54fe4af16560394057ce6439ad7c.jpg treat image : temp/1756429230_1403052_1377704875_78ffe468f808661c119e7eaba43c5018.jpg treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde.jpg treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6.jpg treat image : temp/1756429230_1403052_1377704862_549c7857787113099c5db3eea663db24.jpg treat image : temp/1756429230_1403052_1377704858_cc93a2fed7e47ba7070fe6a561f1a824.jpg treat image : temp/1756429230_1403052_1377704771_714e7a8ec85df4504c309b2a14699d6f.jpg treat image : temp/1756429230_1403052_1377704767_552e0324904deb0feacdbc6fa4c29303.jpg treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16.jpg treat image : temp/1756429230_1403052_1377704758_e4f5c7a16367a25bd1d8fda74d8c5edf.jpg treat image : temp/1756429230_1403052_1377704753_13f33611bb1097fcf881fc6b71c33b7f.jpg treat image : temp/1756429230_1403052_1377704748_9b070f3da1a1a0dc1b226f53f2895b0f.jpg treat image : temp/1756429230_1403052_1377704664_989281564f484d39d437c89029f328f4.jpg treat image : temp/1756429230_1403052_1377704661_5adbe03e4470c0f474b695c9fdb80ffd.jpg treat image : temp/1756429230_1403052_1377704658_ecef9e1f24962653102cd3bc6ede79d2.jpg treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358.jpg treat image : temp/1756429230_1403052_1377704652_e6716a57a5ce93feb0528e300bcc59f3.jpg treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f.jpg treat image : temp/1756429230_1403052_1377705063_aa3a3905eefdae15a7f33ad4b1356169_rle_crop_3934921440_0.png treat image : temp/1756429230_1403052_1377704981_f761e6b7620da94927a4a3c83a4536de_rle_crop_3934921442_0.png treat image : temp/1756429230_1403052_1377704972_db3df7c527755f2cfcd049cdf38155b8_rle_crop_3934921447_0.png treat image : temp/1756429230_1403052_1377704972_db3df7c527755f2cfcd049cdf38155b8_rle_crop_3934921448_0.png treat image : temp/1756429230_1403052_1377704875_78ffe468f808661c119e7eaba43c5018_rle_crop_3934921455_0.png treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6_rle_crop_3934921461_0.png treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6_rle_crop_3934921463_0.png treat image : temp/1756429230_1403052_1377704858_cc93a2fed7e47ba7070fe6a561f1a824_rle_crop_3934921466_0.png treat image : temp/1756429230_1403052_1377704767_552e0324904deb0feacdbc6fa4c29303_rle_crop_3934921469_0.png treat image : temp/1756429230_1403052_1377704758_e4f5c7a16367a25bd1d8fda74d8c5edf_rle_crop_3934921477_0.png treat image : temp/1756429230_1403052_1377704753_13f33611bb1097fcf881fc6b71c33b7f_rle_crop_3934921480_0.png treat image : temp/1756429230_1403052_1377704748_9b070f3da1a1a0dc1b226f53f2895b0f_rle_crop_3934921483_0.png treat image : temp/1756429230_1403052_1377704664_989281564f484d39d437c89029f328f4_rle_crop_3934921486_0.png treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358_rle_crop_3934921495_0.png treat image : temp/1756429230_1403052_1377704652_e6716a57a5ce93feb0528e300bcc59f3_rle_crop_3934921496_0.png treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921501_0.png treat image : temp/1756429230_1403052_1377704981_f761e6b7620da94927a4a3c83a4536de_rle_crop_3934921444_0.png treat image : temp/1756429230_1403052_1377704977_52086d7a016a863b3df6abe389866d12_rle_crop_3934921446_0.png treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde_rle_crop_3934921457_0.png treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde_rle_crop_3934921458_0.png treat image : temp/1756429230_1403052_1377704658_ecef9e1f24962653102cd3bc6ede79d2_rle_crop_3934921489_0.png treat image : temp/1756429230_1403052_1377704658_ecef9e1f24962653102cd3bc6ede79d2_rle_crop_3934921491_0.png treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921471_0.png treat image : temp/1756429230_1403052_1377705063_aa3a3905eefdae15a7f33ad4b1356169_rle_crop_3934921441_0.png treat image : temp/1756429230_1403052_1377704981_f761e6b7620da94927a4a3c83a4536de_rle_crop_3934921443_0.png treat image : temp/1756429230_1403052_1377704977_52086d7a016a863b3df6abe389866d12_rle_crop_3934921445_0.png treat image : temp/1756429230_1403052_1377704972_db3df7c527755f2cfcd049cdf38155b8_rle_crop_3934921449_0.png treat image : temp/1756429230_1403052_1377704967_56e23cd7b22ae0887e29c2031f4bd199_rle_crop_3934921450_0.png treat image : temp/1756429230_1403052_1377704962_0bb672926d7be9d1397aaeea5e8649bf_rle_crop_3934921451_0.png treat image : temp/1756429230_1403052_1377704959_14cd54fe4af16560394057ce6439ad7c_rle_crop_3934921452_0.png treat image : temp/1756429230_1403052_1377704959_14cd54fe4af16560394057ce6439ad7c_rle_crop_3934921453_0.png treat image : temp/1756429230_1403052_1377704959_14cd54fe4af16560394057ce6439ad7c_rle_crop_3934921454_0.png treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde_rle_crop_3934921456_0.png treat image : temp/1756429230_1403052_1377704871_5118ed87da0042b10abdb64b298fefde_rle_crop_3934921459_0.png treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6_rle_crop_3934921460_0.png treat image : temp/1756429230_1403052_1377704862_549c7857787113099c5db3eea663db24_rle_crop_3934921464_0.png treat image : temp/1756429230_1403052_1377704858_cc93a2fed7e47ba7070fe6a561f1a824_rle_crop_3934921467_0.png treat image : temp/1756429230_1403052_1377704771_714e7a8ec85df4504c309b2a14699d6f_rle_crop_3934921468_0.png treat image : temp/1756429230_1403052_1377704767_552e0324904deb0feacdbc6fa4c29303_rle_crop_3934921470_0.png treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921472_0.png treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921473_0.png treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921474_0.png treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921475_0.png treat image : temp/1756429230_1403052_1377704762_dac4117ae1fe4ad6d114cb492834aa16_rle_crop_3934921476_0.png treat image : temp/1756429230_1403052_1377704758_e4f5c7a16367a25bd1d8fda74d8c5edf_rle_crop_3934921478_0.png treat image : temp/1756429230_1403052_1377704753_13f33611bb1097fcf881fc6b71c33b7f_rle_crop_3934921479_0.png treat image : temp/1756429230_1403052_1377704753_13f33611bb1097fcf881fc6b71c33b7f_rle_crop_3934921481_0.png treat image : temp/1756429230_1403052_1377704748_9b070f3da1a1a0dc1b226f53f2895b0f_rle_crop_3934921482_0.png treat image : temp/1756429230_1403052_1377704748_9b070f3da1a1a0dc1b226f53f2895b0f_rle_crop_3934921484_0.png treat image : temp/1756429230_1403052_1377704664_989281564f484d39d437c89029f328f4_rle_crop_3934921485_0.png treat image : temp/1756429230_1403052_1377704661_5adbe03e4470c0f474b695c9fdb80ffd_rle_crop_3934921487_0.png treat image : temp/1756429230_1403052_1377704661_5adbe03e4470c0f474b695c9fdb80ffd_rle_crop_3934921488_0.png treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358_rle_crop_3934921492_0.png treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358_rle_crop_3934921493_0.png treat image : temp/1756429230_1403052_1377704655_ff8ad7cf0e1a321879d77b7bd7b99358_rle_crop_3934921494_0.png treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921497_0.png treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921499_0.png treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921500_0.png treat image : temp/1756429230_1403052_1377704868_aedd12ffec74d0c0fa80e98cbe8f68a6_rle_crop_3934921462_0.png treat image : temp/1756429230_1403052_1377704862_549c7857787113099c5db3eea663db24_rle_crop_3934921465_0.png treat image : temp/1756429230_1403052_1377704658_ecef9e1f24962653102cd3bc6ede79d2_rle_crop_3934921490_0.png treat image : temp/1756429230_1403052_1377704648_d08c75470f8c7279be5b0a646586c48f_rle_crop_3934921498_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 86 time used for this insertion : 0.014852046966552734 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 86 time used for this insertion : 0.019753217697143555 save missing photos in datou_result : time spend for datou_step_exec : 6.981889247894287 time spend to save output : 0.04004859924316406 total time spend for step 7 : 7.021937847137451 step8:velours_tree Fri Aug 29 03:03:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.11355257034301758 time spend to save output : 3.4809112548828125e-05 total time spend for step 8 : 0.1135873794555664 step9:send_mail_cod Fri Aug 29 03:03:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26310873_29-08-2025_03_03_10.pdf 26313870 change filename to text .imagette263138701756429390 26313871 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263138711756429390 26313872 imagette263138721756429392 26313873 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263138731756429392 26313874 imagette263138741756429392 26313875 imagette263138751756429392 26313876 imagette263138761756429392 26313877 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263138771756429392 26313878 change filename to text .change filename to text .change filename to text .change filename to text .imagette263138781756429393 26313879 imagette263138791756429393 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26310873 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26313869,26313870,26313871,26313872,26313873,26313874,26313875,26313876,26313877,26313878,26313879?tags=environnement,metal,pet_clair,pet_fonce,carton,flou,background,mal_croppe,papier,autre,pehd args[1377705063] : ((1377705063, -2.802036424540045, 492609224), (1377705063, 0.37288793044485613, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704981] : ((1377704981, -2.375183241609379, 492609224), (1377704981, 0.40890080630874753, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704977] : ((1377704977, -1.5362071318326351, 492688767), (1377704977, 0.6716855705972098, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704972] : ((1377704972, -2.4267332741741447, 492609224), (1377704972, 0.4805026965211687, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704967] : ((1377704967, -1.4127630046890092, 492688767), (1377704967, 0.6632460382773772, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704962] : ((1377704962, -2.533115323547989, 492609224), (1377704962, 0.544938001903146, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704959] : ((1377704959, -2.5982868229628657, 492609224), (1377704959, 0.5369273949657183, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704875] : ((1377704875, -2.173223103158519, 492609224), (1377704875, 0.6224720250096343, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704871] : ((1377704871, -2.215607344538046, 492609224), (1377704871, 0.5493242648226409, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704868] : ((1377704868, -4.583331441137494, 492609224), (1377704868, 0.3864385330554627, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704862] : ((1377704862, -3.1245365820699456, 492609224), (1377704862, 0.24356983280922354, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704858] : ((1377704858, -1.7981415229092006, 492688767), (1377704858, 0.7041116525301461, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704771] : ((1377704771, -2.8410957414585853, 492609224), (1377704771, 0.3191798619650021, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704767] : ((1377704767, -2.791742571942437, 492609224), (1377704767, 0.3082033070277543, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704762] : ((1377704762, -3.1330048136169206, 492609224), (1377704762, 0.5205124718522729, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704758] : ((1377704758, -2.2673123643987134, 492609224), (1377704758, 0.5716823189031399, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704753] : ((1377704753, -0.4659557262340363, 492688767), (1377704753, 0.6710376806258984, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704748] : ((1377704748, -2.5467361836574147, 492609224), (1377704748, 0.7097023989232345, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704664] : ((1377704664, -2.311690135905743, 492609224), (1377704664, 0.6167823126121518, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704661] : ((1377704661, -2.654113525711373, 492609224), (1377704661, 0.5546460139125148, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704658] : ((1377704658, -2.698534652136582, 492609224), (1377704658, 0.6515010849734257, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704655] : ((1377704655, -2.983645275687994, 492609224), (1377704655, 0.5736858838191798, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704652] : ((1377704652, -2.5710698289643292, 492609224), (1377704652, 0.5499042502858158, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com args[1377704648] : ((1377704648, -4.698216979391919, 492609224), (1377704648, 0.48414456688026053, 2107752395), '0.19569699636702673') We are sending mail with results at report@fotonower.com refus_total : 0.19569699636702673 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26310873 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310873_29-08-2025_03_03_10.pdf results_Auto_P26310873_29-08-2025_03_03_10.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310873_29-08-2025_03_03_10.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26310873','results_Auto_P26310873_29-08-2025_03_03_10.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310873_29-08-2025_03_03_10.pdf','pdf','','0.66','0.19569699636702673') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26310873

https://www.fotonower.com/image?json=false&list_photos_id=1377705063
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704981
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704977
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704972
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704967
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704962
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704959
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704875
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704871
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704868
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704862
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704858
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704771
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704767
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704762
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704758
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704753
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704748
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704664
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704661
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704658
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704655
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704652
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377704648
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 19.57%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/26313870?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26313871?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26313873?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26313877?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26313878?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310873_29-08-2025_03_03_10.pdf.

Lien vers velours :https://www.fotonower.com/velours/26313869,26313870,26313871,26313872,26313873,26313874,26313875,26313876,26313877,26313878,26313879?tags=environnement,metal,pet_clair,pet_fonce,carton,flou,background,mal_croppe,papier,autre,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 29 Aug 2025 01:03:16 GMT Content-Length: 0 Connection: close X-Message-Id: P_Ohn7VjQTinKPiEeDlSRw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1377705063, 1377704981, 1377704977, 1377704972, 1377704967, 1377704962, 1377704959, 1377704875, 1377704871, 1377704868, 1377704862, 1377704858, 1377704771, 1377704767, 1377704762, 1377704758, 1377704753, 1377704748, 1377704664, 1377704661, 1377704658, 1377704655, 1377704652, 1377704648] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377705063', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704981', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704977', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704972', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704967', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704962', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704959', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704875', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704871', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704868', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704862', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704858', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704771', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704767', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704762', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704758', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704753', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704748', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704664', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704661', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704658', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704655', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704652', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704648', None, None, None, None, None, '3629908') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01819467544555664 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.296272039413452 time spend to save output : 0.018419504165649414 total time spend for step 9 : 6.314691543579102 step10:split_time_score Fri Aug 29 03:03:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 24),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 18082025 26310873 Nombre de photos uploadées : 24 / 23040 (0%) 18082025 26310873 Nombre de photos taguées (types de déchets): 0 / 24 (0%) 18082025 26310873 Nombre de photos taguées (volume) : 0 / 24 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0011265277862548828 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2113170623779297 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310847 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310850 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310854 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310857 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310862 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310871 order by id desc limit 1 Qualite : 0.19569699636702673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310873_29-08-2025_03_03_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310873 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310873 AND mptpi.`type`=3594 To do Qualite : 0.17607260505698002 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310881_29-08-2025_02_52_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310881 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310881 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310883 order by id desc limit 1 Qualite : 0.08763685653659609 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310890_29-08-2025_02_32_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310890 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310890 AND mptpi.`type`=3594 To do Qualite : 0.08801835317460316 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310894_29-08-2025_02_22_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310894 AND mptpi.`type`=3594 To do Qualite : 0.17703582308961255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310895_29-08-2025_00_43_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310895 AND mptpi.`type`=3594 To do Qualite : 0.3151915147569445 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310908_29-08-2025_00_32_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310908 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310908 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'18082025': {'nb_upload': 24, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1377705063, 1377704981, 1377704977, 1377704972, 1377704967, 1377704962, 1377704959, 1377704875, 1377704871, 1377704868, 1377704862, 1377704858, 1377704771, 1377704767, 1377704762, 1377704758, 1377704753, 1377704748, 1377704664, 1377704661, 1377704658, 1377704655, 1377704652, 1377704648] Looping around the photos to save general results len do output : 1 /26310873Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377705063', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704981', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704977', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704972', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704967', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704962', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704959', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704875', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704871', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704868', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704862', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704858', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704771', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704767', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704762', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704758', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704753', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704748', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704664', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704661', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704658', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704655', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704652', None, None, None, None, None, '3629908') ('3318', None, None, None, None, None, None, None, '3629908') ('3318', '26310873', '1377704648', None, None, None, None, None, '3629908') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.03784060478210449 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.508374452590942 time spend to save output : 0.038168907165527344 total time spend for step 10 : 9.54654335975647 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 24 set_done_treatment 109.95user 33.25system 3:00.96elapsed 79%CPU (0avgtext+0avgdata 3090168maxresident)k 1173576inputs+69520outputs (5037major+3039413minor)pagefaults 0swaps