python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1236449 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3684489'] with mtr_portfolio_ids : ['26685910'] and first list_photo_ids : [] new path : /proc/1236449/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 15 ; length of list_pids : 15 ; length of list_args : 15 time to download the photos : 1.9644138813018799 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Sep 9 14:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1310 wait 20 seconds l 3637 free memory gpu now : 1310 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-09 14:20:52.696050: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-09 14:20:52.720743: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-09 14:20:52.722756: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc780000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-09 14:20:52.722820: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-09 14:20:52.727059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-09 14:20:52.856391: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4125ef70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-09 14:20:52.856456: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-09 14:20:52.857452: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-09 14:20:52.857953: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-09 14:20:52.861482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-09 14:20:52.864970: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-09 14:20:52.865499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-09 14:20:52.871563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-09 14:20:52.872890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-09 14:20:52.879463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-09 14:20:52.880796: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-09 14:20:52.880914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-09 14:20:52.881656: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-09 14:20:52.881682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-09 14:20:52.881711: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-09 14:20:52.882854: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 933 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-09 14:20:53.226064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-09 14:20:53.226140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-09 14:20:53.226160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-09 14:20:53.226179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-09 14:20:53.226197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-09 14:20:53.226214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-09 14:20:53.226232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-09 14:20:53.226250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-09 14:20:53.227110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-09 14:20:53.228102: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-09 14:20:53.228136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-09 14:20:53.228154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-09 14:20:53.228172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-09 14:20:53.228188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-09 14:20:53.228205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-09 14:20:53.228222: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-09 14:20:53.228239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-09 14:20:53.229151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-09 14:20:53.229232: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-09 14:20:53.229248: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-09 14:20:53.229260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-09 14:20:53.230106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 933 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-09 14:21:01.254891: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-09 14:21:01.458986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-09 14:21:02.802625: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.802696: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.809131: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.809156: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.815160: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.815186: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.845367: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.845395: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.851234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.851686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 380.53M (399015936 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.852127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 342.48M (359114496 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.852578: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 308.23M (323203072 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.853037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 277.41M (290882816 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.853482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 249.67M (261794560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.853498: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.853974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.853990: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-09 14:21:02.888983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.889447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.965903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.966404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.980194: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:02.980668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.013501: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.013989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.018021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.018519: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.037771: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.038283: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.074666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.075185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.079314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.079771: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.080421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.080915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.092082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.092587: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.093090: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.093555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.151065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.151553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.159465: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.159955: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.174198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.174707: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.175203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.175687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.179686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.180175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.181071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.181089: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-09 14:21:03.199809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.200268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.200761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.201245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.201740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-09 14:21:03.202190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 422.81M (443351040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 Detection mask done ! Trying to reset tf kernel 1237953 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 115 tf kernel not reseted sub process len(results) : 15 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 15 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1308 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0004222393035888672 nb_pixel_total : 12076 time to create 1 rle with old method : 0.01270747184753418 length of segment : 216 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 10729 time to create 1 rle with old method : 0.011484622955322266 length of segment : 146 time for calcul the mask position with numpy : 0.0002646446228027344 nb_pixel_total : 16978 time to create 1 rle with old method : 0.018117666244506836 length of segment : 231 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 3755 time to create 1 rle with old method : 0.0040454864501953125 length of segment : 115 time for calcul the mask position with numpy : 0.01845836639404297 nb_pixel_total : 776713 time to create 1 rle with new method : 0.054625749588012695 length of segment : 1390 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 8029 time to create 1 rle with old method : 0.009243011474609375 length of segment : 155 time for calcul the mask position with numpy : 0.0005786418914794922 nb_pixel_total : 16270 time to create 1 rle with old method : 0.017975330352783203 length of segment : 206 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 2525 time to create 1 rle with old method : 0.0029273033142089844 length of segment : 68 time for calcul the mask position with numpy : 0.0007190704345703125 nb_pixel_total : 47038 time to create 1 rle with old method : 0.051386356353759766 length of segment : 287 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 5741 time to create 1 rle with old method : 0.0068607330322265625 length of segment : 80 time for calcul the mask position with numpy : 0.0004830360412597656 nb_pixel_total : 33083 time to create 1 rle with old method : 0.03643369674682617 length of segment : 237 time for calcul the mask position with numpy : 0.00016689300537109375 nb_pixel_total : 8480 time to create 1 rle with old method : 0.010079622268676758 length of segment : 129 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 7008 time to create 1 rle with old method : 0.008327245712280273 length of segment : 94 time for calcul the mask position with numpy : 0.0014641284942626953 nb_pixel_total : 110459 time to create 1 rle with old method : 0.11964297294616699 length of segment : 538 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 11778 time to create 1 rle with old method : 0.012654304504394531 length of segment : 123 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 5451 time to create 1 rle with old method : 0.006368875503540039 length of segment : 84 time for calcul the mask position with numpy : 0.00021123886108398438 nb_pixel_total : 9680 time to create 1 rle with old method : 0.011549711227416992 length of segment : 92 time for calcul the mask position with numpy : 0.0020618438720703125 nb_pixel_total : 102514 time to create 1 rle with old method : 0.11072278022766113 length of segment : 508 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 7199 time to create 1 rle with old method : 0.008610725402832031 length of segment : 97 time for calcul the mask position with numpy : 0.0003910064697265625 nb_pixel_total : 13829 time to create 1 rle with old method : 0.015837430953979492 length of segment : 127 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 3251 time to create 1 rle with old method : 0.0036857128143310547 length of segment : 82 time for calcul the mask position with numpy : 0.0005466938018798828 nb_pixel_total : 18013 time to create 1 rle with old method : 0.02119755744934082 length of segment : 164 time for calcul the mask position with numpy : 0.00032210350036621094 nb_pixel_total : 9056 time to create 1 rle with old method : 0.010447263717651367 length of segment : 108 time for calcul the mask position with numpy : 0.00021600723266601562 nb_pixel_total : 4368 time to create 1 rle with old method : 0.004914999008178711 length of segment : 126 time for calcul the mask position with numpy : 0.0008864402770996094 nb_pixel_total : 46737 time to create 1 rle with old method : 0.05198836326599121 length of segment : 168 time for calcul the mask position with numpy : 0.00020170211791992188 nb_pixel_total : 8296 time to create 1 rle with old method : 0.009233951568603516 length of segment : 116 time for calcul the mask position with numpy : 0.00022268295288085938 nb_pixel_total : 7513 time to create 1 rle with old method : 0.009014368057250977 length of segment : 74 time for calcul the mask position with numpy : 0.0003790855407714844 nb_pixel_total : 12074 time to create 1 rle with old method : 0.013600587844848633 length of segment : 158 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 6581 time to create 1 rle with old method : 0.0074503421783447266 length of segment : 160 time for calcul the mask position with numpy : 0.0002281665802001953 nb_pixel_total : 5759 time to create 1 rle with old method : 0.006679534912109375 length of segment : 92 time for calcul the mask position with numpy : 0.0003387928009033203 nb_pixel_total : 11320 time to create 1 rle with old method : 0.012755155563354492 length of segment : 115 time for calcul the mask position with numpy : 0.0012359619140625 nb_pixel_total : 51286 time to create 1 rle with old method : 0.05611371994018555 length of segment : 413 time for calcul the mask position with numpy : 0.00026488304138183594 nb_pixel_total : 6565 time to create 1 rle with old method : 0.0072345733642578125 length of segment : 91 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 14369 time to create 1 rle with old method : 0.016715049743652344 length of segment : 147 time for calcul the mask position with numpy : 0.0008134841918945312 nb_pixel_total : 37425 time to create 1 rle with old method : 0.04041576385498047 length of segment : 207 time for calcul the mask position with numpy : 0.00021719932556152344 nb_pixel_total : 6972 time to create 1 rle with old method : 0.008075714111328125 length of segment : 128 time for calcul the mask position with numpy : 0.0003707408905029297 nb_pixel_total : 12323 time to create 1 rle with old method : 0.013759613037109375 length of segment : 129 time for calcul the mask position with numpy : 0.00013589859008789062 nb_pixel_total : 8698 time to create 1 rle with old method : 0.009914636611938477 length of segment : 92 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 3622 time to create 1 rle with old method : 0.004395961761474609 length of segment : 146 time for calcul the mask position with numpy : 0.0009191036224365234 nb_pixel_total : 36532 time to create 1 rle with old method : 0.04156494140625 length of segment : 399 time for calcul the mask position with numpy : 0.0002682209014892578 nb_pixel_total : 10503 time to create 1 rle with old method : 0.012018680572509766 length of segment : 128 time for calcul the mask position with numpy : 0.0005028247833251953 nb_pixel_total : 16440 time to create 1 rle with old method : 0.019116878509521484 length of segment : 283 time for calcul the mask position with numpy : 0.0001571178436279297 nb_pixel_total : 3490 time to create 1 rle with old method : 0.004015684127807617 length of segment : 70 time for calcul the mask position with numpy : 0.0003924369812011719 nb_pixel_total : 10959 time to create 1 rle with old method : 0.012613058090209961 length of segment : 186 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 3843 time to create 1 rle with old method : 0.004734039306640625 length of segment : 43 time for calcul the mask position with numpy : 0.00028967857360839844 nb_pixel_total : 8765 time to create 1 rle with old method : 0.010433435440063477 length of segment : 121 time for calcul the mask position with numpy : 0.00033283233642578125 nb_pixel_total : 7196 time to create 1 rle with old method : 0.00802755355834961 length of segment : 167 time for calcul the mask position with numpy : 0.00026226043701171875 nb_pixel_total : 8985 time to create 1 rle with old method : 0.010641098022460938 length of segment : 120 time for calcul the mask position with numpy : 0.002150297164916992 nb_pixel_total : 107695 time to create 1 rle with old method : 0.12132453918457031 length of segment : 548 time for calcul the mask position with numpy : 0.00032329559326171875 nb_pixel_total : 8232 time to create 1 rle with old method : 0.00968480110168457 length of segment : 107 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 2984 time to create 1 rle with old method : 0.0036416053771972656 length of segment : 76 time for calcul the mask position with numpy : 0.00028324127197265625 nb_pixel_total : 8296 time to create 1 rle with old method : 0.00982046127319336 length of segment : 117 time for calcul the mask position with numpy : 0.002247333526611328 nb_pixel_total : 106876 time to create 1 rle with old method : 0.11869215965270996 length of segment : 521 time for calcul the mask position with numpy : 0.0004067420959472656 nb_pixel_total : 11783 time to create 1 rle with old method : 0.013769865036010742 length of segment : 191 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 8330 time to create 1 rle with old method : 0.009452581405639648 length of segment : 82 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 21909 time to create 1 rle with old method : 0.025405168533325195 length of segment : 136 time for calcul the mask position with numpy : 0.012943506240844727 nb_pixel_total : 747012 time to create 1 rle with new method : 0.027393817901611328 length of segment : 1070 time for calcul the mask position with numpy : 0.00035834312438964844 nb_pixel_total : 7500 time to create 1 rle with old method : 0.00901341438293457 length of segment : 123 time for calcul the mask position with numpy : 0.0007538795471191406 nb_pixel_total : 33996 time to create 1 rle with old method : 0.03987836837768555 length of segment : 208 time for calcul the mask position with numpy : 0.0003440380096435547 nb_pixel_total : 10998 time to create 1 rle with old method : 0.01284027099609375 length of segment : 106 time for calcul the mask position with numpy : 0.0002505779266357422 nb_pixel_total : 9805 time to create 1 rle with old method : 0.01150965690612793 length of segment : 127 time for calcul the mask position with numpy : 0.0002181529998779297 nb_pixel_total : 9626 time to create 1 rle with old method : 0.010787248611450195 length of segment : 99 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 9198 time to create 1 rle with old method : 0.010916471481323242 length of segment : 129 time for calcul the mask position with numpy : 0.0007150173187255859 nb_pixel_total : 35697 time to create 1 rle with old method : 0.04131650924682617 length of segment : 199 time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 6327 time to create 1 rle with old method : 0.007791280746459961 length of segment : 83 time spent for convertir_results : 3.350925922393799 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 65 chid ids of type : 3594 Number RLEs to save : 13078 save missing photos in datou_result : time spend for datou_step_exec : 46.00674867630005 time spend to save output : 0.8276019096374512 total time spend for step 1 : 46.8343505859375 step2:crop_condition Tue Sep 9 14:21:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 15 ! batch 1 Loaded 65 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757420479_1236449 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.758519887924194 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757420491_1236449 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3996491432189941 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757420493_1236449 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8622198104858398 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757420504_1236449 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.655750274658203 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757420510_1236449 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9593169689178467 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1382771133, 1382771132, 1382771131, 1382771130, 1382771129, 1382771075, 1382771065, 1382771060, 1382771058, 1382771056, 1382771052, 1382770998, 1382770996, 1382770994, 1382770993] Looping around the photos to save general results len do output : 65 /1382777703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382777782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771133', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771132', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771131', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771130', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771129', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771075', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771065', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771060', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771058', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771056', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771052', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770998', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770996', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770994', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770993', None, None, None, None, None, '3684489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 210 time used for this insertion : 0.024193525314331055 save_final save missing photos in datou_result : time spend for datou_step_exec : 34.620227575302124 time spend to save output : 0.026971101760864258 total time spend for step 2 : 34.64719867706299 step3:rle_unique_nms_with_priority Tue Sep 9 14:21:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 65 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.0680694580078125 time for calcul the mask position with numpy : 0.04443788528442383 nb_pixel_total : 1253349 time to create 1 rle with new method : 0.44727468490600586 time for calcul the mask position with numpy : 0.015360593795776367 nb_pixel_total : 776713 time to create 1 rle with new method : 0.1826796531677246 time for calcul the mask position with numpy : 0.006984710693359375 nb_pixel_total : 3755 time to create 1 rle with old method : 0.004266977310180664 time for calcul the mask position with numpy : 0.00813913345336914 nb_pixel_total : 16978 time to create 1 rle with old method : 0.02100515365600586 time for calcul the mask position with numpy : 0.008776426315307617 nb_pixel_total : 10729 time to create 1 rle with old method : 0.011878013610839844 time for calcul the mask position with numpy : 0.0069293975830078125 nb_pixel_total : 12076 time to create 1 rle with old method : 0.013443231582641602 create new chi : 0.7885396480560303 time to delete rle : 0.021435260772705078 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5276 TO DO : save crop sub photo not yet done ! save time : 0.34696078300476074 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.4412667751312256 time for calcul the mask position with numpy : 0.23087453842163086 nb_pixel_total : 1999738 time to create 1 rle with new method : 0.0742638111114502 time for calcul the mask position with numpy : 0.006247520446777344 nb_pixel_total : 47038 time to create 1 rle with old method : 0.05138278007507324 time for calcul the mask position with numpy : 0.00593876838684082 nb_pixel_total : 2525 time to create 1 rle with old method : 0.002912282943725586 time for calcul the mask position with numpy : 0.006169557571411133 nb_pixel_total : 16270 time to create 1 rle with old method : 0.017993927001953125 time for calcul the mask position with numpy : 0.005986213684082031 nb_pixel_total : 8029 time to create 1 rle with old method : 0.008994340896606445 create new chi : 0.4144623279571533 time to delete rle : 0.00038552284240722656 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 2512 TO DO : save crop sub photo not yet done ! save time : 0.20117616653442383 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.6454226970672607 time for calcul the mask position with numpy : 0.05298256874084473 nb_pixel_total : 1881963 time to create 1 rle with new method : 0.2787973880767822 time for calcul the mask position with numpy : 0.0066525936126708984 nb_pixel_total : 9637 time to create 1 rle with old method : 0.011065006256103516 time for calcul the mask position with numpy : 0.00638270378112793 nb_pixel_total : 5451 time to create 1 rle with old method : 0.006277561187744141 time for calcul the mask position with numpy : 0.00625300407409668 nb_pixel_total : 11778 time to create 1 rle with old method : 0.013634681701660156 time for calcul the mask position with numpy : 0.006715297698974609 nb_pixel_total : 110459 time to create 1 rle with old method : 0.12305998802185059 time for calcul the mask position with numpy : 0.00710749626159668 nb_pixel_total : 7008 time to create 1 rle with old method : 0.00803065299987793 time for calcul the mask position with numpy : 0.006688594818115234 nb_pixel_total : 8480 time to create 1 rle with old method : 0.009818315505981445 time for calcul the mask position with numpy : 0.006865024566650391 nb_pixel_total : 33083 time to create 1 rle with old method : 0.05193519592285156 time for calcul the mask position with numpy : 0.007600069046020508 nb_pixel_total : 5741 time to create 1 rle with old method : 0.006615400314331055 create new chi : 0.6272563934326172 time to delete rle : 0.0006711483001708984 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 3826 TO DO : save crop sub photo not yet done ! save time : 0.30202722549438477 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.034943580627441406 time for calcul the mask position with numpy : 0.018909454345703125 nb_pixel_total : 1971086 time to create 1 rle with new method : 0.029165267944335938 time for calcul the mask position with numpy : 0.006807565689086914 nb_pixel_total : 102514 time to create 1 rle with old method : 0.11156153678894043 create new chi : 0.18239521980285645 time to delete rle : 0.0003161430358886719 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2096 TO DO : save crop sub photo not yet done ! save time : 0.1808912754058838 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.6850883960723877 time for calcul the mask position with numpy : 0.07840132713317871 nb_pixel_total : 2017884 time to create 1 rle with new method : 0.09287858009338379 time for calcul the mask position with numpy : 0.0068149566650390625 nb_pixel_total : 4368 time to create 1 rle with old method : 0.00495600700378418 time for calcul the mask position with numpy : 0.0063571929931640625 nb_pixel_total : 9056 time to create 1 rle with old method : 0.010277271270751953 time for calcul the mask position with numpy : 0.006510734558105469 nb_pixel_total : 18013 time to create 1 rle with old method : 0.020331859588623047 time for calcul the mask position with numpy : 0.007720470428466797 nb_pixel_total : 3251 time to create 1 rle with old method : 0.003657817840576172 time for calcul the mask position with numpy : 0.00687098503112793 nb_pixel_total : 13829 time to create 1 rle with old method : 0.015379667282104492 time for calcul the mask position with numpy : 0.006307363510131836 nb_pixel_total : 7199 time to create 1 rle with old method : 0.008050680160522461 create new chi : 0.2855520248413086 time to delete rle : 0.0004963874816894531 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 2488 TO DO : save crop sub photo not yet done ! save time : 0.1991441249847412 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05329155921936035 time for calcul the mask position with numpy : 0.021816730499267578 nb_pixel_total : 2018567 time to create 1 rle with new method : 0.029180049896240234 time for calcul the mask position with numpy : 0.006104946136474609 nb_pixel_total : 8296 time to create 1 rle with old method : 0.008835315704345703 time for calcul the mask position with numpy : 0.006433725357055664 nb_pixel_total : 46737 time to create 1 rle with old method : 0.050865888595581055 create new chi : 0.12356424331665039 time to delete rle : 0.0002777576446533203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1648 TO DO : save crop sub photo not yet done ! save time : 0.1464083194732666 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.09981417655944824 time for calcul the mask position with numpy : 0.2570827007293701 nb_pixel_total : 1972502 time to create 1 rle with new method : 0.31452274322509766 time for calcul the mask position with numpy : 0.0067288875579833984 nb_pixel_total : 6565 time to create 1 rle with old method : 0.007430076599121094 time for calcul the mask position with numpy : 0.006635427474975586 nb_pixel_total : 51286 time to create 1 rle with old method : 0.057322025299072266 time for calcul the mask position with numpy : 0.006196260452270508 nb_pixel_total : 11320 time to create 1 rle with old method : 0.012940645217895508 time for calcul the mask position with numpy : 0.006402015686035156 nb_pixel_total : 5759 time to create 1 rle with old method : 0.006539344787597656 time for calcul the mask position with numpy : 0.0062940120697021484 nb_pixel_total : 6581 time to create 1 rle with old method : 0.0073549747467041016 time for calcul the mask position with numpy : 0.007422208786010742 nb_pixel_total : 12074 time to create 1 rle with old method : 0.013706684112548828 time for calcul the mask position with numpy : 0.006701946258544922 nb_pixel_total : 7513 time to create 1 rle with old method : 0.008521556854248047 create new chi : 0.742964506149292 time to delete rle : 0.0005509853363037109 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 3286 TO DO : save crop sub photo not yet done ! save time : 0.2441394329071045 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.16723179817199707 time for calcul the mask position with numpy : 0.14768624305725098 nb_pixel_total : 1948054 time to create 1 rle with new method : 0.29121875762939453 time for calcul the mask position with numpy : 0.006810903549194336 nb_pixel_total : 10503 time to create 1 rle with old method : 0.011749982833862305 time for calcul the mask position with numpy : 0.00665283203125 nb_pixel_total : 31634 time to create 1 rle with old method : 0.035048723220825195 time for calcul the mask position with numpy : 0.006644010543823242 nb_pixel_total : 3622 time to create 1 rle with old method : 0.0041463375091552734 time for calcul the mask position with numpy : 0.006656646728515625 nb_pixel_total : 8698 time to create 1 rle with old method : 0.010036468505859375 time for calcul the mask position with numpy : 0.0065631866455078125 nb_pixel_total : 12323 time to create 1 rle with old method : 0.01601433753967285 time for calcul the mask position with numpy : 0.007143259048461914 nb_pixel_total : 6972 time to create 1 rle with old method : 0.0078008174896240234 time for calcul the mask position with numpy : 0.006713151931762695 nb_pixel_total : 37425 time to create 1 rle with old method : 0.043457746505737305 time for calcul the mask position with numpy : 0.006667137145996094 nb_pixel_total : 14369 time to create 1 rle with old method : 0.01623058319091797 create new chi : 0.6507389545440674 time to delete rle : 0.0006136894226074219 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 3674 TO DO : save crop sub photo not yet done ! save time : 0.25539374351501465 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.049947500228881836 time for calcul the mask position with numpy : 0.023485660552978516 nb_pixel_total : 2053670 time to create 1 rle with new method : 0.0287015438079834 time for calcul the mask position with numpy : 0.006402730941772461 nb_pixel_total : 3490 time to create 1 rle with old method : 0.003984212875366211 time for calcul the mask position with numpy : 0.006445646286010742 nb_pixel_total : 16440 time to create 1 rle with old method : 0.018379926681518555 create new chi : 0.08773207664489746 time to delete rle : 0.00029468536376953125 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 1786 TO DO : save crop sub photo not yet done ! save time : 0.14876580238342285 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0564579963684082 time for calcul the mask position with numpy : 0.02105259895324707 nb_pixel_total : 2050033 time to create 1 rle with new method : 0.12000536918640137 time for calcul the mask position with numpy : 0.008461475372314453 nb_pixel_total : 8765 time to create 1 rle with old method : 0.015572547912597656 time for calcul the mask position with numpy : 0.008771419525146484 nb_pixel_total : 3843 time to create 1 rle with old method : 0.007059335708618164 time for calcul the mask position with numpy : 0.00906682014465332 nb_pixel_total : 10959 time to create 1 rle with old method : 0.019217491149902344 create new chi : 0.21952366828918457 time to delete rle : 0.00044155120849609375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1780 TO DO : save crop sub photo not yet done ! save time : 0.16773152351379395 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05210995674133301 time for calcul the mask position with numpy : 0.10700678825378418 nb_pixel_total : 1949724 time to create 1 rle with new method : 0.09324240684509277 time for calcul the mask position with numpy : 0.007245302200317383 nb_pixel_total : 107695 time to create 1 rle with old method : 0.11955404281616211 time for calcul the mask position with numpy : 0.006848335266113281 nb_pixel_total : 8985 time to create 1 rle with old method : 0.010196685791015625 time for calcul the mask position with numpy : 0.006672382354736328 nb_pixel_total : 7196 time to create 1 rle with old method : 0.008432149887084961 create new chi : 0.37052035331726074 time to delete rle : 0.0004360675811767578 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2750 TO DO : save crop sub photo not yet done ! save time : 0.21310997009277344 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0847773551940918 time for calcul the mask position with numpy : 0.3336009979248047 nb_pixel_total : 1947212 time to create 1 rle with new method : 0.08969950675964355 time for calcul the mask position with numpy : 0.010828495025634766 nb_pixel_total : 106876 time to create 1 rle with old method : 0.11817193031311035 time for calcul the mask position with numpy : 0.007437229156494141 nb_pixel_total : 8296 time to create 1 rle with old method : 0.009433269500732422 time for calcul the mask position with numpy : 0.006063938140869141 nb_pixel_total : 2984 time to create 1 rle with old method : 0.0033588409423828125 time for calcul the mask position with numpy : 0.006158590316772461 nb_pixel_total : 8232 time to create 1 rle with old method : 0.009286880493164062 create new chi : 0.6073472499847412 time to delete rle : 0.00033020973205566406 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2722 TO DO : save crop sub photo not yet done ! save time : 0.2183220386505127 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05464935302734375 time for calcul the mask position with numpy : 0.03216099739074707 nb_pixel_total : 2061817 time to create 1 rle with new method : 0.3422417640686035 time for calcul the mask position with numpy : 0.0066869258880615234 nb_pixel_total : 11783 time to create 1 rle with old method : 0.016729354858398438 create new chi : 0.3983628749847412 time to delete rle : 0.00024056434631347656 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1462 TO DO : save crop sub photo not yet done ! save time : 0.12909555435180664 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.30501461029052734 time for calcul the mask position with numpy : 0.04438328742980957 nb_pixel_total : 1296349 time to create 1 rle with new method : 0.2121591567993164 time for calcul the mask position with numpy : 0.012898445129394531 nb_pixel_total : 747012 time to create 1 rle with new method : 0.15327048301696777 time for calcul the mask position with numpy : 0.006983280181884766 nb_pixel_total : 21909 time to create 1 rle with old method : 0.02414536476135254 time for calcul the mask position with numpy : 0.006291866302490234 nb_pixel_total : 8330 time to create 1 rle with old method : 0.00914311408996582 create new chi : 0.47877931594848633 time to delete rle : 0.0006198883056640625 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 3656 TO DO : save crop sub photo not yet done ! save time : 0.26837873458862305 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.2972452640533447 time for calcul the mask position with numpy : 0.1649167537689209 nb_pixel_total : 1950453 time to create 1 rle with new method : 0.2767813205718994 time for calcul the mask position with numpy : 0.006262779235839844 nb_pixel_total : 6327 time to create 1 rle with old method : 0.006989479064941406 time for calcul the mask position with numpy : 0.006280183792114258 nb_pixel_total : 35697 time to create 1 rle with old method : 0.039049386978149414 time for calcul the mask position with numpy : 0.0062558650970458984 nb_pixel_total : 9198 time to create 1 rle with old method : 0.01036214828491211 time for calcul the mask position with numpy : 0.005989789962768555 nb_pixel_total : 9626 time to create 1 rle with old method : 0.010660648345947266 time for calcul the mask position with numpy : 0.006615400314331055 nb_pixel_total : 9805 time to create 1 rle with old method : 0.010679960250854492 time for calcul the mask position with numpy : 0.0062808990478515625 nb_pixel_total : 10998 time to create 1 rle with old method : 0.012427330017089844 time for calcul the mask position with numpy : 0.006827116012573242 nb_pixel_total : 33996 time to create 1 rle with old method : 0.03739333152770996 time for calcul the mask position with numpy : 0.0061054229736328125 nb_pixel_total : 7500 time to create 1 rle with old method : 0.008350849151611328 create new chi : 0.6378319263458252 time to delete rle : 0.0005133152008056641 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 3228 TO DO : save crop sub photo not yet done ! save time : 0.24200057983398438 map_output_result : {1382771133: (0.0, 'Should be the crop_list due to order', 0), 1382771132: (0.0, 'Should be the crop_list due to order', 0), 1382771131: (0.0, 'Should be the crop_list due to order', 0), 1382771130: (0.0, 'Should be the crop_list due to order', 0), 1382771129: (0.0, 'Should be the crop_list due to order', 0), 1382771075: (0.0, 'Should be the crop_list due to order', 0), 1382771065: (0.0, 'Should be the crop_list due to order', 0), 1382771060: (0.0, 'Should be the crop_list due to order', 0), 1382771058: (0.0, 'Should be the crop_list due to order', 0), 1382771056: (0.0, 'Should be the crop_list due to order', 0), 1382771052: (0.0, 'Should be the crop_list due to order', 0), 1382770998: (0.0, 'Should be the crop_list due to order', 0), 1382770996: (0.0, 'Should be the crop_list due to order', 0), 1382770994: (0.0, 'Should be the crop_list due to order', 0), 1382770993: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1382771133, 1382771132, 1382771131, 1382771130, 1382771129, 1382771075, 1382771065, 1382771060, 1382771058, 1382771056, 1382771052, 1382770998, 1382770996, 1382770994, 1382770993] Looping around the photos to save general results len do output : 15 /1382771133.Didn't retrieve data . /1382771132.Didn't retrieve data . /1382771131.Didn't retrieve data . /1382771130.Didn't retrieve data . /1382771129.Didn't retrieve data . /1382771075.Didn't retrieve data . /1382771065.Didn't retrieve data . /1382771060.Didn't retrieve data . /1382771058.Didn't retrieve data . /1382771056.Didn't retrieve data . /1382771052.Didn't retrieve data . /1382770998.Didn't retrieve data . /1382770996.Didn't retrieve data . /1382770994.Didn't retrieve data . /1382770993.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771133', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771132', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771131', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771130', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771129', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771075', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771065', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771060', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771058', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771056', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771052', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770998', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770996', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770994', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770993', None, None, None, None, None, '3684489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.020740509033203125 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.524222373962402 time spend to save output : 0.021480083465576172 total time spend for step 3 : 15.545702457427979 step4:ventilate_hashtags_in_portfolio Tue Sep 9 14:22:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26685910 get user id for portfolio 26685910 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26685910 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','mal_croppe','pehd','autre','papier','environnement','carton','pet_fonce','background','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26685910 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','mal_croppe','pehd','autre','papier','environnement','carton','pet_fonce','background','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26685910 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','mal_croppe','pehd','autre','papier','environnement','carton','pet_fonce','background','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26686131,26686132,26686133,26686134,26686135,26686136,26686137,26686138,26686139,26686140,26686141?tags=flou,metal,mal_croppe,pehd,autre,papier,environnement,carton,pet_fonce,background,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1382771133, 1382771132, 1382771131, 1382771130, 1382771129, 1382771075, 1382771065, 1382771060, 1382771058, 1382771056, 1382771052, 1382770998, 1382770996, 1382770994, 1382770993] Looping around the photos to save general results len do output : 1 /26685910. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771133', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771132', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771131', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771130', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771129', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771075', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771065', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771060', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771058', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771056', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771052', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770998', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770996', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770994', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770993', None, None, None, None, None, '3684489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.017627954483032227 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7248106002807617 time spend to save output : 0.017916202545166016 total time spend for step 4 : 1.7427268028259277 step5:final Tue Sep 9 14:22:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1382771133: ('0.08782146990740743',), 1382771132: ('0.08782146990740743',), 1382771131: ('0.08782146990740743',), 1382771130: ('0.08782146990740743',), 1382771129: ('0.08782146990740743',), 1382771075: ('0.08782146990740743',), 1382771065: ('0.08782146990740743',), 1382771060: ('0.08782146990740743',), 1382771058: ('0.08782146990740743',), 1382771056: ('0.08782146990740743',), 1382771052: ('0.08782146990740743',), 1382770998: ('0.08782146990740743',), 1382770996: ('0.08782146990740743',), 1382770994: ('0.08782146990740743',), 1382770993: ('0.08782146990740743',)} new output for save of step final : {1382771133: ('0.08782146990740743',), 1382771132: ('0.08782146990740743',), 1382771131: ('0.08782146990740743',), 1382771130: ('0.08782146990740743',), 1382771129: ('0.08782146990740743',), 1382771075: ('0.08782146990740743',), 1382771065: ('0.08782146990740743',), 1382771060: ('0.08782146990740743',), 1382771058: ('0.08782146990740743',), 1382771056: ('0.08782146990740743',), 1382771052: ('0.08782146990740743',), 1382770998: ('0.08782146990740743',), 1382770996: ('0.08782146990740743',), 1382770994: ('0.08782146990740743',), 1382770993: ('0.08782146990740743',)} [1382771133, 1382771132, 1382771131, 1382771130, 1382771129, 1382771075, 1382771065, 1382771060, 1382771058, 1382771056, 1382771052, 1382770998, 1382770996, 1382770994, 1382770993] Looping around the photos to save general results len do output : 15 /1382771133.Didn't retrieve data . /1382771132.Didn't retrieve data . /1382771131.Didn't retrieve data . /1382771130.Didn't retrieve data . /1382771129.Didn't retrieve data . /1382771075.Didn't retrieve data . /1382771065.Didn't retrieve data . /1382771060.Didn't retrieve data . /1382771058.Didn't retrieve data . /1382771056.Didn't retrieve data . /1382771052.Didn't retrieve data . /1382770998.Didn't retrieve data . /1382770996.Didn't retrieve data . /1382770994.Didn't retrieve data . /1382770993.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771133', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771132', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771131', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771130', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771129', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771075', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771065', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771060', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771058', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771056', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771052', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770998', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770996', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770994', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770993', None, None, None, None, None, '3684489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.016605377197265625 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.128737211227417 time spend to save output : 0.01737046241760254 total time spend for step 5 : 0.14610767364501953 step6:blur_detection Tue Sep 9 14:22:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7.jpg resize: (1080, 1920) 1382771133 1.1409780586560385 treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c.jpg resize: (1080, 1920) 1382771132 1.912005950947717 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6.jpg resize: (1080, 1920) 1382771131 1.457615491530226 treat image : temp/1757420427_1236449_1382771130_57de90f41961eb8c242bc7ec03a9e0dc.jpg resize: (1080, 1920) 1382771130 4.534566792500041 treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc.jpg resize: (1080, 1920) 1382771129 0.0068906463222292375 treat image : temp/1757420427_1236449_1382771075_e0998736581691b8e64b2f0b4d5e3927.jpg resize: (1080, 1920) 1382771075 0.265985701486493 treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853.jpg resize: (1080, 1920) 1382771065 -0.005113793842784313 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3.jpg resize: (1080, 1920) 1382771060 -0.2587350999773813 treat image : temp/1757420427_1236449_1382771058_27e0d81bee3cb9b30d2789b572b2b4cc.jpg resize: (1080, 1920) 1382771058 -0.14693255774828995 treat image : temp/1757420427_1236449_1382771056_da1e362e2f94476b61ae604780412ff3.jpg resize: (1080, 1920) 1382771056 -0.35005738855506074 treat image : temp/1757420427_1236449_1382771052_ec26de7c2363296e20c47af7785de269.jpg resize: (1080, 1920) 1382771052 0.4330229113541191 treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9.jpg resize: (1080, 1920) 1382770998 -0.6028794270360425 treat image : temp/1757420427_1236449_1382770996_623f8a846160ef94785a8d07c593c6d0.jpg resize: (1080, 1920) 1382770996 -0.20862327960509333 treat image : temp/1757420427_1236449_1382770994_6def662b0ae5bd58778895d053f062ce.jpg resize: (1080, 1920) 1382770994 -0.10221211273531185 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116.jpg resize: (1080, 1920) 1382770993 0.04755905731237998 treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345577_0.png resize: (215, 89) 1382777703 -1.0698562849123625 treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345579_0.png resize: (199, 104) 1382777704 -0.891912641417338 treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345580_0.png resize: (115, 62) 1382777706 -1.7525013034094532 treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c_rle_crop_3952345582_0.png resize: (149, 97) 1382777707 -2.1743848945808155 treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c_rle_crop_3952345583_0.png resize: (206, 134) 1382777708 -0.23476348302965017 treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c_rle_crop_3952345584_0.png resize: (68, 75) 1382777709 -1.6496815246449243 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345586_0.png resize: (80, 82) 1382777710 11.13322398114607 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345588_0.png resize: (102, 144) 1382777711 0.27175251438756726 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345589_0.png resize: (94, 108) 1382777712 -1.8850527675989384 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345592_0.png resize: (84, 93) 1382777713 0.40213063231051016 treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345595_0.png resize: (92, 130) 1382777715 -1.3119052076143218 treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345597_0.png resize: (82, 58) 1382777716 -0.643032601428256 treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345598_0.png resize: (143, 248) 1382777717 -1.5545417016711556 treat image : temp/1757420427_1236449_1382771075_e0998736581691b8e64b2f0b4d5e3927_rle_crop_3952345601_0.png resize: (166, 406) 1382777718 0.9641422657392387 treat image : temp/1757420427_1236449_1382771075_e0998736581691b8e64b2f0b4d5e3927_rle_crop_3952345602_0.png resize: (110, 90) 1382777719 0.871386809968496 treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345603_0.png resize: (73, 122) 1382777720 8.392687428921922 treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345604_0.png resize: (158, 129) 1382777721 -1.662179983096181 treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345605_0.png resize: (160, 125) 1382777722 -2.0240215203672225 treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345606_0.png resize: (91, 105) 1382777723 -1.5834132109717203 treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345607_0.png resize: (115, 149) 1382777724 -1.0725114715819188 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345610_0.png resize: (147, 156) 1382777725 -1.6196156817508405 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345612_0.png resize: (122, 83) 1382777726 -0.6426161747235957 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345615_0.png resize: (95, 94) 1382777727 -2.473601378616246 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345616_0.png resize: (205, 411) 1382777728 -2.4584584782716217 treat image : temp/1757420427_1236449_1382771058_27e0d81bee3cb9b30d2789b572b2b4cc_rle_crop_3952345618_0.png resize: (191, 147) 1382777729 -2.462797062469598 treat image : temp/1757420427_1236449_1382771058_27e0d81bee3cb9b30d2789b572b2b4cc_rle_crop_3952345619_0.png resize: (70, 79) 1382777730 -0.4853738297091779 treat image : temp/1757420427_1236449_1382771056_da1e362e2f94476b61ae604780412ff3_rle_crop_3952345620_0.png resize: (185, 114) 1382777731 -0.7702421596270934 treat image : temp/1757420427_1236449_1382771056_da1e362e2f94476b61ae604780412ff3_rle_crop_3952345622_0.png resize: (121, 125) 1382777732 -0.6123573419918841 treat image : temp/1757420427_1236449_1382771052_ec26de7c2363296e20c47af7785de269_rle_crop_3952345624_0.png resize: (120, 131) 1382777733 -1.8522830834124953 treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9_rle_crop_3952345626_0.png resize: (107, 130) 1382777734 2.0609492341690703 treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9_rle_crop_3952345627_0.png resize: (76, 61) 1382777735 0.279692931430282 treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9_rle_crop_3952345628_0.png resize: (96, 136) 1382777736 -1.3110932788090768 treat image : temp/1757420427_1236449_1382770996_623f8a846160ef94785a8d07c593c6d0_rle_crop_3952345630_0.png resize: (190, 78) 1382777737 0.948373260393125 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345634_0.png resize: (123, 127) 1382777738 -2.2197299698332023 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345639_0.png resize: (129, 117) 1382777739 -1.561426054007632 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345640_0.png resize: (191, 230) 1382777740 -0.2118986366761717 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345641_0.png resize: (90, 137) 1382777741 -1.796155763076126 treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345599_0.png resize: (108, 113) 1382777743 -0.47212961494580624 treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345600_0.png resize: (126, 77) 1382777744 -1.674942095546257 treat image : temp/1757420427_1236449_1382771052_ec26de7c2363296e20c47af7785de269_rle_crop_3952345623_0.png resize: (167, 62) 1382777745 -1.2773795809051778 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345636_0.png resize: (106, 129) 1382777746 0.041896013098008805 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345613_0.png resize: (127, 140) 1382777748 -2.733210176149086 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345617_0.png resize: (128, 115) 1382777749 -2.353353767017091 treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345578_0.png resize: (146, 110) 1382777760 -0.4631640456537983 treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345581_0.png resize: (999, 1155) 1382777761 -0.1818020458312626 treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c_rle_crop_3952345585_0.png resize: (227, 315) 1382777763 -1.5427863095782486 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345587_0.png resize: (175, 242) 1382777764 -1.9698642631427492 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345590_0.png resize: (535, 328) 1382777765 0.4362879480194376 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345593_0.png resize: (95, 190) 1382777766 -0.6331322093069068 treat image : temp/1757420427_1236449_1382771130_57de90f41961eb8c242bc7ec03a9e0dc_rle_crop_3952345594_0.png resize: (507, 338) 1382777767 0.5084198205874293 treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345596_0.png resize: (108, 174) 1382777768 -3.7737881259267385 treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345608_0.png resize: (359, 270) 1382777769 -1.6754128519243678 treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345609_0.png resize: (91, 105) 1382777770 -3.7052180283710823 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345611_0.png resize: (206, 249) 1382777771 0.6911526768413341 treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345614_0.png resize: (91, 115) 1382777772 -1.9097279326255145 treat image : temp/1757420427_1236449_1382771056_da1e362e2f94476b61ae604780412ff3_rle_crop_3952345621_0.png resize: (43, 102) 1382777773 1.8228892240506012 treat image : temp/1757420427_1236449_1382771052_ec26de7c2363296e20c47af7785de269_rle_crop_3952345625_0.png resize: (525, 342) 1382777774 -0.5544261483059095 treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9_rle_crop_3952345629_0.png resize: (517, 337) 1382777775 0.3458155079028576 treat image : temp/1757420427_1236449_1382770994_6def662b0ae5bd58778895d053f062ce_rle_crop_3952345631_0.png resize: (81, 131) 1382777776 -4.771088112413262 treat image : temp/1757420427_1236449_1382770994_6def662b0ae5bd58778895d053f062ce_rle_crop_3952345632_0.png resize: (117, 239) 1382777777 -0.8571366270990617 treat image : temp/1757420427_1236449_1382770994_6def662b0ae5bd58778895d053f062ce_rle_crop_3952345633_0.png resize: (1003, 1034) 1382777778 -0.03706934081776307 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345635_0.png resize: (200, 243) 1382777779 -0.7921080940971912 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345637_0.png resize: (126, 107) 1382777780 -1.5231856764119607 treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345638_0.png resize: (99, 129) 1382777781 -1.2518907747013712 treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345591_0.png resize: (123, 138) 1382777782 -1.2233066966636679 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 80 time used for this insertion : 0.017116308212280273 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 80 time used for this insertion : 0.016196489334106445 save missing photos in datou_result : time spend for datou_step_exec : 12.880704164505005 time spend to save output : 0.03905916213989258 total time spend for step 6 : 12.919763326644897 step7:brightness Tue Sep 9 14:22:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7.jpg treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c.jpg treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6.jpg treat image : temp/1757420427_1236449_1382771130_57de90f41961eb8c242bc7ec03a9e0dc.jpg treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc.jpg treat image : temp/1757420427_1236449_1382771075_e0998736581691b8e64b2f0b4d5e3927.jpg treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853.jpg treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3.jpg treat image : temp/1757420427_1236449_1382771058_27e0d81bee3cb9b30d2789b572b2b4cc.jpg treat image : temp/1757420427_1236449_1382771056_da1e362e2f94476b61ae604780412ff3.jpg treat image : temp/1757420427_1236449_1382771052_ec26de7c2363296e20c47af7785de269.jpg treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9.jpg treat image : temp/1757420427_1236449_1382770996_623f8a846160ef94785a8d07c593c6d0.jpg treat image : temp/1757420427_1236449_1382770994_6def662b0ae5bd58778895d053f062ce.jpg treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116.jpg treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345577_0.png treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345579_0.png treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345580_0.png treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c_rle_crop_3952345582_0.png treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c_rle_crop_3952345583_0.png treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c_rle_crop_3952345584_0.png treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345586_0.png treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345588_0.png treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345589_0.png treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345592_0.png treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345595_0.png treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345597_0.png treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345598_0.png treat image : temp/1757420427_1236449_1382771075_e0998736581691b8e64b2f0b4d5e3927_rle_crop_3952345601_0.png treat image : temp/1757420427_1236449_1382771075_e0998736581691b8e64b2f0b4d5e3927_rle_crop_3952345602_0.png treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345603_0.png treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345604_0.png treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345605_0.png treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345606_0.png treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345607_0.png treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345610_0.png treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345612_0.png treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345615_0.png treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345616_0.png treat image : temp/1757420427_1236449_1382771058_27e0d81bee3cb9b30d2789b572b2b4cc_rle_crop_3952345618_0.png treat image : temp/1757420427_1236449_1382771058_27e0d81bee3cb9b30d2789b572b2b4cc_rle_crop_3952345619_0.png treat image : temp/1757420427_1236449_1382771056_da1e362e2f94476b61ae604780412ff3_rle_crop_3952345620_0.png treat image : temp/1757420427_1236449_1382771056_da1e362e2f94476b61ae604780412ff3_rle_crop_3952345622_0.png treat image : temp/1757420427_1236449_1382771052_ec26de7c2363296e20c47af7785de269_rle_crop_3952345624_0.png treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9_rle_crop_3952345626_0.png treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9_rle_crop_3952345627_0.png treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9_rle_crop_3952345628_0.png treat image : temp/1757420427_1236449_1382770996_623f8a846160ef94785a8d07c593c6d0_rle_crop_3952345630_0.png treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345634_0.png treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345639_0.png treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345640_0.png treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345641_0.png treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345599_0.png treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345600_0.png treat image : temp/1757420427_1236449_1382771052_ec26de7c2363296e20c47af7785de269_rle_crop_3952345623_0.png treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345636_0.png treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345613_0.png treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345617_0.png treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345578_0.png treat image : temp/1757420427_1236449_1382771133_2b5963ff26d84a1119ee98965d367ec7_rle_crop_3952345581_0.png treat image : temp/1757420427_1236449_1382771132_0d005cdcbb87fcfa8e1b73d272bd873c_rle_crop_3952345585_0.png treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345587_0.png treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345590_0.png treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345593_0.png treat image : temp/1757420427_1236449_1382771130_57de90f41961eb8c242bc7ec03a9e0dc_rle_crop_3952345594_0.png treat image : temp/1757420427_1236449_1382771129_8a1b737d73692f6105ae7e3eeee6d2dc_rle_crop_3952345596_0.png treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345608_0.png treat image : temp/1757420427_1236449_1382771065_92454a3dd1cdc2b893b948555a232853_rle_crop_3952345609_0.png treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345611_0.png treat image : temp/1757420427_1236449_1382771060_4aa74608488803867841d7fa14bc01b3_rle_crop_3952345614_0.png treat image : temp/1757420427_1236449_1382771056_da1e362e2f94476b61ae604780412ff3_rle_crop_3952345621_0.png treat image : temp/1757420427_1236449_1382771052_ec26de7c2363296e20c47af7785de269_rle_crop_3952345625_0.png treat image : temp/1757420427_1236449_1382770998_5d7f0a71a7c55c9a5d9bed85817012f9_rle_crop_3952345629_0.png treat image : temp/1757420427_1236449_1382770994_6def662b0ae5bd58778895d053f062ce_rle_crop_3952345631_0.png treat image : temp/1757420427_1236449_1382770994_6def662b0ae5bd58778895d053f062ce_rle_crop_3952345632_0.png treat image : temp/1757420427_1236449_1382770994_6def662b0ae5bd58778895d053f062ce_rle_crop_3952345633_0.png treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345635_0.png treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345637_0.png treat image : temp/1757420427_1236449_1382770993_9b91ad2e1ef78be86050f173f5810116_rle_crop_3952345638_0.png treat image : temp/1757420427_1236449_1382771131_04615e057df68d5cf0b2438c985a0ca6_rle_crop_3952345591_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 80 time used for this insertion : 0.014898538589477539 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 80 time used for this insertion : 0.015629053115844727 save missing photos in datou_result : time spend for datou_step_exec : 3.7938830852508545 time spend to save output : 0.034955501556396484 total time spend for step 7 : 3.828838586807251 step8:velours_tree Tue Sep 9 14:22:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09411096572875977 time spend to save output : 3.528594970703125e-05 total time spend for step 8 : 0.0941462516784668 step9:send_mail_cod Tue Sep 9 14:22:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26685910_09-09-2025_14_22_25.pdf 26686131 imagette266861311757420545 26686132 change filename to text .change filename to text .imagette266861321757420545 26686133 imagette266861331757420545 26686134 imagette266861341757420545 26686135 change filename to text .imagette266861351757420545 26686136 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266861361757420545 26686138 change filename to text .change filename to text .change filename to text .change filename to text .imagette266861381757420547 26686139 imagette266861391757420547 26686140 imagette266861401757420547 26686141 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266861411757420547 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26685910 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26686131,26686132,26686133,26686134,26686135,26686136,26686137,26686138,26686139,26686140,26686141?tags=flou,metal,mal_croppe,pehd,autre,papier,environnement,carton,pet_fonce,background,pet_clair args[1382771133] : ((1382771133, 1.1409780586560385, 492688767), (1382771133, 0.592562759733553, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771132] : ((1382771132, 1.912005950947717, 492688767), (1382771132, 0.5187731836906879, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771131] : ((1382771131, 1.457615491530226, 492688767), (1382771131, 0.3585061069053042, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771130] : ((1382771130, 4.534566792500041, 492688767), (1382771130, 0.3789824397729037, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771129] : ((1382771129, 0.0068906463222292375, 492688767), (1382771129, 0.455401589606403, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771075] : ((1382771075, 0.265985701486493, 492688767), (1382771075, 0.7331904590255849, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771065] : ((1382771065, -0.005113793842784313, 492688767), (1382771065, 0.5832731703146721, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771060] : ((1382771060, -0.2587350999773813, 492688767), (1382771060, 0.35232632454623997, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771058] : ((1382771058, -0.14693255774828995, 492688767), (1382771058, 0.6822065752978366, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771056] : ((1382771056, -0.35005738855506074, 492688767), (1382771056, 0.6364635218960604, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382771052] : ((1382771052, 0.4330229113541191, 492688767), (1382771052, 0.4063797004879004, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382770998] : ((1382770998, -0.6028794270360425, 492688767), (1382770998, 0.507654378585105, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382770996] : ((1382770996, -0.20862327960509333, 492688767), (1382770996, 0.5074436876405869, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382770994] : ((1382770994, -0.10221211273531185, 492688767), (1382770994, 0.6519511884157455, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com args[1382770993] : ((1382770993, 0.04755905731237998, 492688767), (1382770993, 0.4308873951978852, 2107752395), '0.08782146990740743') We are sending mail with results at report@fotonower.com refus_total : 0.08782146990740743 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26685910 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26685910_09-09-2025_14_22_25.pdf results_Auto_P26685910_09-09-2025_14_22_25.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26685910_09-09-2025_14_22_25.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26685910','results_Auto_P26685910_09-09-2025_14_22_25.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26685910_09-09-2025_14_22_25.pdf','pdf','','0.32','0.08782146990740743') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26685910

https://www.fotonower.com/image?json=false&list_photos_id=1382771133
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1409780586560385)
https://www.fotonower.com/image?json=false&list_photos_id=1382771132
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.912005950947717)
https://www.fotonower.com/image?json=false&list_photos_id=1382771131
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.457615491530226)
https://www.fotonower.com/image?json=false&list_photos_id=1382771130
La photo est trop floue, merci de reprendre une photo.(avec le score = 4.534566792500041)
https://www.fotonower.com/image?json=false&list_photos_id=1382771129
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382771075
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382771065
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382771060
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382771058
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382771056
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382771052
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382770998
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382770996
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382770994
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382770993
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.78%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/26686132?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26686135?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26686136?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26686138?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26686141?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26685910_09-09-2025_14_22_25.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26686131,26686132,26686133,26686134,26686135,26686136,26686137,26686138,26686139,26686140,26686141?tags=flou,metal,mal_croppe,pehd,autre,papier,environnement,carton,pet_fonce,background,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 09 Sep 2025 12:22:30 GMT Content-Length: 0 Connection: close X-Message-Id: HhOSysjZQuiA-NDpIr1aVQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1382771133, 1382771132, 1382771131, 1382771130, 1382771129, 1382771075, 1382771065, 1382771060, 1382771058, 1382771056, 1382771052, 1382770998, 1382770996, 1382770994, 1382770993] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771133', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771132', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771131', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771130', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771129', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771075', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771065', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771060', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771058', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771056', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771052', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770998', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770996', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770994', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770993', None, None, None, None, None, '3684489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014693260192871094 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.092821836471558 time spend to save output : 0.01505899429321289 total time spend for step 9 : 5.1078808307647705 step10:split_time_score Tue Sep 9 14:22:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 15),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 09092025 26685910 Nombre de photos uploadées : 15 / 23040 (0%) 09092025 26685910 Nombre de photos taguées (types de déchets): 0 / 15 (0%) 09092025 26685910 Nombre de photos taguées (volume) : 0 / 15 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ??????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007627010345458984 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20137405395507812 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.06336376886145406 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26677451_09-09-2025_09_11_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26677451 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26677451 AND mptpi.`type`=3594 To do Qualite : 0.05401843412422839 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26677708_09-09-2025_10_56_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26677708 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26677708 AND mptpi.`type`=3594 To do Qualite : 0.20552528077846366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26677710_09-09-2025_10_51_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26677710 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26677710 AND mptpi.`type`=3594 To do Qualite : 0.014393888245884773 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26680696_09-09-2025_11_21_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26680696 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26680696 AND mptpi.`type`=3594 To do Qualite : 0.07049739583333335 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26680700_09-09-2025_11_11_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26680700 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26680700 AND mptpi.`type`=3594 To do Qualite : 0.045615676440329225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26684302_09-09-2025_13_01_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26684302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26684302 AND mptpi.`type`=3594 To do Qualite : 0.09322024498456788 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26684306_09-09-2025_12_51_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26684306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26684306 AND mptpi.`type`=3594 To do Qualite : 0.08782146990740743 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26685910_09-09-2025_14_22_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26685910 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26685910 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'09092025': {'nb_upload': 15, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1382771133, 1382771132, 1382771131, 1382771130, 1382771129, 1382771075, 1382771065, 1382771060, 1382771058, 1382771056, 1382771052, 1382770998, 1382770996, 1382770994, 1382770993] Looping around the photos to save general results len do output : 1 /26685910Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771133', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771132', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771131', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771130', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771129', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771075', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771065', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771060', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771058', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771056', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382771052', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770998', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770996', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770994', None, None, None, None, None, '3684489') ('3318', None, None, None, None, None, None, None, '3684489') ('3318', '26685910', '1382770993', None, None, None, None, None, '3684489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.01430821418762207 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.848907470703125 time spend to save output : 0.014718294143676758 total time spend for step 10 : 0.8636257648468018 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 15 set_done_treatment 53.04user 25.14system 2:06.62elapsed 61%CPU (0avgtext+0avgdata 2792140maxresident)k 525624inputs+25288outputs (76major+1753818minor)pagefaults 0swaps