python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1186623 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3460108'] with mtr_portfolio_ids : ['25727194'] and first list_photo_ids : [] new path : /proc/1186623/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 35 ; length of list_pids : 35 ; length of list_args : 35 time to download the photos : 4.12473464012146 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Aug 6 14:10:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10801 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-06 14:10:34.868861: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-06 14:10:34.895467: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-06 14:10:34.897364: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe178000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-06 14:10:34.897397: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-06 14:10:34.901083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-06 14:10:35.026512: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x27c0e6e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-06 14:10:35.026551: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-06 14:10:35.027800: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 14:10:35.028174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 14:10:35.030960: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 14:10:35.033264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 14:10:35.033640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 14:10:35.036036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 14:10:35.037211: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 14:10:35.041470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 14:10:35.042897: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 14:10:35.042959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 14:10:35.043743: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-06 14:10:35.043760: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-06 14:10:35.043768: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-06 14:10:35.045120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-06 14:10:35.339309: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 14:10:35.339421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 14:10:35.339445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 14:10:35.339466: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 14:10:35.339486: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 14:10:35.339506: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 14:10:35.339525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 14:10:35.339545: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 14:10:35.341126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 14:10:35.342441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 14:10:35.342477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 14:10:35.342497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 14:10:35.342514: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 14:10:35.342531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 14:10:35.342548: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 14:10:35.342564: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 14:10:35.342581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 14:10:35.344144: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 14:10:35.344172: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-06 14:10:35.344181: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-06 14:10:35.344189: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-06 14:10:35.345497: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-06 14:10:44.211516: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 14:10:44.448141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 35 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.20000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 1187246 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 695 tf kernel not reseted sub process len(results) : 35 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 35 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7177 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006823539733886719 nb_pixel_total : 14524 time to create 1 rle with old method : 0.017685890197753906 length of segment : 183 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 11993 time to create 1 rle with old method : 0.014302253723144531 length of segment : 175 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 3488 time to create 1 rle with old method : 0.004419088363647461 length of segment : 93 time for calcul the mask position with numpy : 0.034655094146728516 nb_pixel_total : 759396 time to create 1 rle with new method : 0.06305646896362305 length of segment : 1149 time for calcul the mask position with numpy : 0.001752614974975586 nb_pixel_total : 105123 time to create 1 rle with old method : 0.13611793518066406 length of segment : 565 time for calcul the mask position with numpy : 0.00018143653869628906 nb_pixel_total : 6942 time to create 1 rle with old method : 0.008447647094726562 length of segment : 109 time for calcul the mask position with numpy : 0.00017023086547851562 nb_pixel_total : 9620 time to create 1 rle with old method : 0.011739253997802734 length of segment : 81 time for calcul the mask position with numpy : 0.0015921592712402344 nb_pixel_total : 104453 time to create 1 rle with old method : 0.12282013893127441 length of segment : 561 time for calcul the mask position with numpy : 0.00016999244689941406 nb_pixel_total : 6518 time to create 1 rle with old method : 0.009233713150024414 length of segment : 115 time for calcul the mask position with numpy : 0.00021028518676757812 nb_pixel_total : 8216 time to create 1 rle with old method : 0.011661529541015625 length of segment : 93 time for calcul the mask position with numpy : 0.0008723735809326172 nb_pixel_total : 41535 time to create 1 rle with old method : 0.054448843002319336 length of segment : 230 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 3544 time to create 1 rle with old method : 0.004129886627197266 length of segment : 61 time for calcul the mask position with numpy : 0.4008350372314453 nb_pixel_total : 992815 time to create 1 rle with new method : 0.07722020149230957 length of segment : 1653 time for calcul the mask position with numpy : 0.002867460250854492 nb_pixel_total : 90376 time to create 1 rle with old method : 0.09771156311035156 length of segment : 531 time for calcul the mask position with numpy : 0.0020706653594970703 nb_pixel_total : 97424 time to create 1 rle with old method : 0.12031245231628418 length of segment : 395 time for calcul the mask position with numpy : 0.0002989768981933594 nb_pixel_total : 5459 time to create 1 rle with old method : 0.006667613983154297 length of segment : 108 time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 35368 time to create 1 rle with old method : 0.04167890548706055 length of segment : 307 time for calcul the mask position with numpy : 0.0004329681396484375 nb_pixel_total : 8261 time to create 1 rle with old method : 0.016371488571166992 length of segment : 290 time for calcul the mask position with numpy : 0.00022125244140625 nb_pixel_total : 6802 time to create 1 rle with old method : 0.008417844772338867 length of segment : 60 time for calcul the mask position with numpy : 0.0028362274169921875 nb_pixel_total : 109678 time to create 1 rle with old method : 0.12844443321228027 length of segment : 563 time for calcul the mask position with numpy : 0.0001804828643798828 nb_pixel_total : 5018 time to create 1 rle with old method : 0.005997419357299805 length of segment : 113 time for calcul the mask position with numpy : 0.0027170181274414062 nb_pixel_total : 116099 time to create 1 rle with old method : 0.13560891151428223 length of segment : 564 time for calcul the mask position with numpy : 0.000385284423828125 nb_pixel_total : 11395 time to create 1 rle with old method : 0.013708353042602539 length of segment : 136 time for calcul the mask position with numpy : 0.0002129077911376953 nb_pixel_total : 5402 time to create 1 rle with old method : 0.006795644760131836 length of segment : 71 time for calcul the mask position with numpy : 0.0002994537353515625 nb_pixel_total : 7510 time to create 1 rle with old method : 0.009021520614624023 length of segment : 109 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 5856 time to create 1 rle with old method : 0.007352590560913086 length of segment : 75 time for calcul the mask position with numpy : 0.016259193420410156 nb_pixel_total : 758199 time to create 1 rle with new method : 0.7430799007415771 length of segment : 954 time for calcul the mask position with numpy : 0.0024907588958740234 nb_pixel_total : 107132 time to create 1 rle with old method : 0.12206077575683594 length of segment : 544 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 9751 time to create 1 rle with old method : 0.011503219604492188 length of segment : 130 time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 4101 time to create 1 rle with old method : 0.004765033721923828 length of segment : 67 time for calcul the mask position with numpy : 0.0003085136413574219 nb_pixel_total : 8850 time to create 1 rle with old method : 0.010340690612792969 length of segment : 119 time for calcul the mask position with numpy : 0.03032541275024414 nb_pixel_total : 944224 time to create 1 rle with new method : 0.10216641426086426 length of segment : 1528 time for calcul the mask position with numpy : 0.002935171127319336 nb_pixel_total : 120546 time to create 1 rle with old method : 0.13258838653564453 length of segment : 574 time for calcul the mask position with numpy : 0.0021479129791259766 nb_pixel_total : 111023 time to create 1 rle with old method : 0.12795042991638184 length of segment : 533 time for calcul the mask position with numpy : 0.014905691146850586 nb_pixel_total : 767171 time to create 1 rle with new method : 0.06404304504394531 length of segment : 993 time for calcul the mask position with numpy : 0.0017371177673339844 nb_pixel_total : 107078 time to create 1 rle with old method : 0.13190102577209473 length of segment : 595 time for calcul the mask position with numpy : 0.0005159378051757812 nb_pixel_total : 22300 time to create 1 rle with old method : 0.026818037033081055 length of segment : 132 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 10119 time to create 1 rle with old method : 0.012249469757080078 length of segment : 109 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 5855 time to create 1 rle with old method : 0.007193088531494141 length of segment : 71 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 1819 time to create 1 rle with old method : 0.002316713333129883 length of segment : 48 time for calcul the mask position with numpy : 0.02084803581237793 nb_pixel_total : 885420 time to create 1 rle with new method : 0.06617975234985352 length of segment : 1487 time for calcul the mask position with numpy : 0.0027647018432617188 nb_pixel_total : 119617 time to create 1 rle with old method : 0.1401045322418213 length of segment : 549 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 8530 time to create 1 rle with old method : 0.010479450225830078 length of segment : 101 time for calcul the mask position with numpy : 0.1408402919769287 nb_pixel_total : 1202739 time to create 1 rle with new method : 0.07647085189819336 length of segment : 1571 time for calcul the mask position with numpy : 0.0004317760467529297 nb_pixel_total : 26871 time to create 1 rle with old method : 0.03264331817626953 length of segment : 170 time for calcul the mask position with numpy : 0.0003230571746826172 nb_pixel_total : 10639 time to create 1 rle with old method : 0.01286458969116211 length of segment : 142 time for calcul the mask position with numpy : 0.0004990100860595703 nb_pixel_total : 18445 time to create 1 rle with old method : 0.022025585174560547 length of segment : 175 time for calcul the mask position with numpy : 0.002209901809692383 nb_pixel_total : 106834 time to create 1 rle with old method : 0.12510037422180176 length of segment : 511 time for calcul the mask position with numpy : 0.00024247169494628906 nb_pixel_total : 4442 time to create 1 rle with old method : 0.006278514862060547 length of segment : 95 time for calcul the mask position with numpy : 0.00023174285888671875 nb_pixel_total : 4329 time to create 1 rle with old method : 0.007618904113769531 length of segment : 82 time for calcul the mask position with numpy : 0.0023941993713378906 nb_pixel_total : 116813 time to create 1 rle with old method : 0.1374824047088623 length of segment : 561 time for calcul the mask position with numpy : 0.00019884109497070312 nb_pixel_total : 4949 time to create 1 rle with old method : 0.006087779998779297 length of segment : 122 time for calcul the mask position with numpy : 0.011176824569702148 nb_pixel_total : 738056 time to create 1 rle with new method : 0.3002297878265381 length of segment : 987 time for calcul the mask position with numpy : 0.0019445419311523438 nb_pixel_total : 94316 time to create 1 rle with old method : 0.13329243659973145 length of segment : 509 time for calcul the mask position with numpy : 0.015799760818481445 nb_pixel_total : 1242511 time to create 1 rle with new method : 0.0661325454711914 length of segment : 1509 time for calcul the mask position with numpy : 0.0018029212951660156 nb_pixel_total : 90721 time to create 1 rle with old method : 0.10463523864746094 length of segment : 491 time for calcul the mask position with numpy : 0.0016820430755615234 nb_pixel_total : 92571 time to create 1 rle with old method : 0.10688328742980957 length of segment : 489 time for calcul the mask position with numpy : 0.0016198158264160156 nb_pixel_total : 87465 time to create 1 rle with old method : 0.10135912895202637 length of segment : 489 time spent for convertir_results : 8.863937139511108 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 58 chid ids of type : 3594 Number RLEs to save : 24827 save missing photos in datou_result : time spend for datou_step_exec : 40.703649044036865 time spend to save output : 1.4366166591644287 total time spend for step 1 : 42.140265703201294 step2:crop_condition Wed Aug 6 14:11:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 35 ! batch 1 Loaded 58 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754482275_1186623 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.495426893234253 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754482279_1186623 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8132927417755127 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754482280_1186623 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9609994888305664 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754482320_1186623 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.78950023651123 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754482332_1186623 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9424948692321777 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754482335_1186623 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6137044429779053 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375450808, 1375450805, 1375450771, 1375450768, 1375450764, 1375450760, 1375450757, 1375450753, 1375450722, 1375450719, 1375450717, 1375450715, 1375450710, 1375450707, 1375450693, 1375450690, 1375450687, 1375450682, 1375450678, 1375450674, 1375450505, 1375450487, 1375450485, 1375450483, 1375450392, 1375450377, 1375450328, 1375450304, 1375450292, 1375450165, 1375450077, 1375450044, 1375449744, 1375449638, 1375449265] Looping around the photos to save general results len do output : 58 /1375481978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375481981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375481984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375481985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375481988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375481991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375481993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375481996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375481999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375482683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450808', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450805', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450771', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450768', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450764', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450760', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450757', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450753', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450722', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450719', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450717', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450715', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450710', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450707', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450693', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450690', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450687', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450682', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450678', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450674', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450505', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450487', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450485', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450483', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450392', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450377', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450328', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450304', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450292', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450165', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450077', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450044', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449744', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449638', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449265', None, None, None, None, None, '3460108') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 209 time used for this insertion : 0.027187824249267578 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.46281123161316 time spend to save output : 0.02966928482055664 total time spend for step 2 : 61.492480516433716 step3:rle_unique_nms_with_priority Wed Aug 6 14:12:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 58 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.7341899871826172 time for calcul the mask position with numpy : 0.054239511489868164 nb_pixel_total : 1164029 time to create 1 rle with new method : 0.2602086067199707 time for calcul the mask position with numpy : 0.0064907073974609375 nb_pixel_total : 9620 time to create 1 rle with old method : 0.011197328567504883 time for calcul the mask position with numpy : 0.006066799163818359 nb_pixel_total : 6942 time to create 1 rle with old method : 0.0080413818359375 time for calcul the mask position with numpy : 0.006827354431152344 nb_pixel_total : 105123 time to create 1 rle with old method : 0.12423110008239746 time for calcul the mask position with numpy : 0.01504063606262207 nb_pixel_total : 757881 time to create 1 rle with new method : 0.1631009578704834 time for calcul the mask position with numpy : 0.007285594940185547 nb_pixel_total : 3488 time to create 1 rle with old method : 0.004132270812988281 time for calcul the mask position with numpy : 0.0066585540771484375 nb_pixel_total : 11993 time to create 1 rle with old method : 0.01400899887084961 time for calcul the mask position with numpy : 0.007037162780761719 nb_pixel_total : 14524 time to create 1 rle with old method : 0.016955852508544922 create new chi : 0.7319352626800537 time to delete rle : 0.020447969436645508 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 5700 TO DO : save crop sub photo not yet done ! save time : 0.3981316089630127 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05614137649536133 time for calcul the mask position with numpy : 0.024818897247314453 nb_pixel_total : 1962629 time to create 1 rle with new method : 0.03449273109436035 time for calcul the mask position with numpy : 0.007389545440673828 nb_pixel_total : 6518 time to create 1 rle with old method : 0.010367393493652344 time for calcul the mask position with numpy : 0.01058053970336914 nb_pixel_total : 104453 time to create 1 rle with old method : 0.12488293647766113 create new chi : 0.21329379081726074 time to delete rle : 0.0009608268737792969 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 2432 TO DO : save crop sub photo not yet done ! save time : 0.18938946723937988 No data in photo_id : 1375450771 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05582165718078613 time for calcul the mask position with numpy : 0.02927112579345703 nb_pixel_total : 2020305 time to create 1 rle with new method : 0.19054508209228516 time for calcul the mask position with numpy : 0.006541728973388672 nb_pixel_total : 3544 time to create 1 rle with old method : 0.0041997432708740234 time for calcul the mask position with numpy : 0.0067441463470458984 nb_pixel_total : 41535 time to create 1 rle with old method : 0.04839944839477539 time for calcul the mask position with numpy : 0.00662684440612793 nb_pixel_total : 8216 time to create 1 rle with old method : 0.00977468490600586 create new chi : 0.3095548152923584 time to delete rle : 0.00041413307189941406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1848 TO DO : save crop sub photo not yet done ! save time : 0.15522098541259766 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05616450309753418 time for calcul the mask position with numpy : 0.013878822326660156 nb_pixel_total : 990409 time to create 1 rle with new method : 0.0999302864074707 time for calcul the mask position with numpy : 0.0065190792083740234 nb_pixel_total : 90376 time to create 1 rle with old method : 0.10981106758117676 time for calcul the mask position with numpy : 0.013318061828613281 nb_pixel_total : 992815 time to create 1 rle with new method : 0.24990272521972656 create new chi : 0.508110761642456 time to delete rle : 0.0007331371307373047 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 5448 TO DO : save crop sub photo not yet done ! save time : 0.35816216468811035 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.16950607299804688 time for calcul the mask position with numpy : 0.07967591285705566 nb_pixel_total : 1970717 time to create 1 rle with new method : 0.2109990119934082 time for calcul the mask position with numpy : 0.006262540817260742 nb_pixel_total : 5459 time to create 1 rle with old method : 0.0064585208892822266 time for calcul the mask position with numpy : 0.0065844058990478516 nb_pixel_total : 97424 time to create 1 rle with old method : 0.11480474472045898 create new chi : 0.43482470512390137 time to delete rle : 0.0004413127899169922 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2086 TO DO : save crop sub photo not yet done ! save time : 0.17051267623901367 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.379791259765625 time for calcul the mask position with numpy : 0.16707968711853027 nb_pixel_total : 1910986 time to create 1 rle with new method : 0.11425018310546875 time for calcul the mask position with numpy : 0.010679244995117188 nb_pixel_total : 2505 time to create 1 rle with old method : 0.0029592514038085938 time for calcul the mask position with numpy : 0.011034011840820312 nb_pixel_total : 109678 time to create 1 rle with old method : 0.12547993659973145 time for calcul the mask position with numpy : 0.006211996078491211 nb_pixel_total : 6802 time to create 1 rle with old method : 0.007860898971557617 time for calcul the mask position with numpy : 0.006612300872802734 nb_pixel_total : 8261 time to create 1 rle with old method : 0.009565591812133789 time for calcul the mask position with numpy : 0.006618976593017578 nb_pixel_total : 35368 time to create 1 rle with old method : 0.04057884216308594 create new chi : 0.5196127891540527 time to delete rle : 0.0005643367767333984 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3675 TO DO : save crop sub photo not yet done ! save time : 0.2677023410797119 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06176280975341797 time for calcul the mask position with numpy : 0.02017068862915039 nb_pixel_total : 1946106 time to create 1 rle with new method : 0.26906442642211914 time for calcul the mask position with numpy : 0.006605625152587891 nb_pixel_total : 11395 time to create 1 rle with old method : 0.013183832168579102 time for calcul the mask position with numpy : 0.00792074203491211 nb_pixel_total : 116099 time to create 1 rle with old method : 0.13410568237304688 create new chi : 0.4514584541320801 time to delete rle : 0.0004143714904785156 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2480 TO DO : save crop sub photo not yet done ! save time : 0.17547273635864258 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.14652729034423828 time for calcul the mask position with numpy : 0.08058333396911621 nb_pixel_total : 2068198 time to create 1 rle with new method : 0.320406436920166 time for calcul the mask position with numpy : 0.006198883056640625 nb_pixel_total : 5402 time to create 1 rle with old method : 0.006239652633666992 create new chi : 0.42400264739990234 time to delete rle : 0.00026679039001464844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1222 TO DO : save crop sub photo not yet done ! save time : 0.11690330505371094 No data in photo_id : 1375450719 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.034624338150024414 time for calcul the mask position with numpy : 0.2567102909088135 nb_pixel_total : 2066090 time to create 1 rle with new method : 0.0983283519744873 time for calcul the mask position with numpy : 0.006799936294555664 nb_pixel_total : 7510 time to create 1 rle with old method : 0.008475303649902344 create new chi : 0.38285231590270996 time to delete rle : 0.00021958351135253906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1298 TO DO : save crop sub photo not yet done ! save time : 0.12225651741027832 No data in photo_id : 1375450715 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.191575288772583 time for calcul the mask position with numpy : 0.04640698432922363 nb_pixel_total : 1202413 time to create 1 rle with new method : 0.2043757438659668 time for calcul the mask position with numpy : 0.007193803787231445 nb_pixel_total : 107132 time to create 1 rle with old method : 0.1442408561706543 time for calcul the mask position with numpy : 0.015219449996948242 nb_pixel_total : 758199 time to create 1 rle with new method : 0.1935281753540039 time for calcul the mask position with numpy : 0.0062220096588134766 nb_pixel_total : 5856 time to create 1 rle with old method : 0.006697177886962891 create new chi : 0.6335725784301758 time to delete rle : 0.0006775856018066406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4226 TO DO : save crop sub photo not yet done ! save time : 0.29062366485595703 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.061348676681518555 time for calcul the mask position with numpy : 0.014327764511108398 nb_pixel_total : 1116747 time to create 1 rle with new method : 0.21439576148986816 time for calcul the mask position with numpy : 0.01241302490234375 nb_pixel_total : 934151 time to create 1 rle with new method : 0.09823870658874512 time for calcul the mask position with numpy : 0.006283760070800781 nb_pixel_total : 8850 time to create 1 rle with old method : 0.010275602340698242 time for calcul the mask position with numpy : 0.006146430969238281 nb_pixel_total : 4101 time to create 1 rle with old method : 0.004793882369995117 time for calcul the mask position with numpy : 0.006059169769287109 nb_pixel_total : 9751 time to create 1 rle with old method : 0.01112985610961914 create new chi : 0.4002809524536133 time to delete rle : 0.0007412433624267578 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 4760 TO DO : save crop sub photo not yet done ! save time : 0.3229973316192627 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.10335588455200195 time for calcul the mask position with numpy : 0.0832982063293457 nb_pixel_total : 1953054 time to create 1 rle with new method : 0.11809015274047852 time for calcul the mask position with numpy : 0.007678508758544922 nb_pixel_total : 120546 time to create 1 rle with old method : 0.14533019065856934 create new chi : 0.3548769950866699 time to delete rle : 0.0005774497985839844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2228 TO DO : save crop sub photo not yet done ! save time : 0.17336010932922363 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0618593692779541 time for calcul the mask position with numpy : 0.22742509841918945 nb_pixel_total : 1962577 time to create 1 rle with new method : 0.10288500785827637 time for calcul the mask position with numpy : 0.007416963577270508 nb_pixel_total : 111023 time to create 1 rle with old method : 0.13420677185058594 create new chi : 0.4806244373321533 time to delete rle : 0.00040221214294433594 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2146 TO DO : save crop sub photo not yet done ! save time : 0.16962552070617676 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.21746158599853516 time for calcul the mask position with numpy : 0.15595412254333496 nb_pixel_total : 1199351 time to create 1 rle with new method : 0.10295820236206055 time for calcul the mask position with numpy : 0.006524324417114258 nb_pixel_total : 107078 time to create 1 rle with old method : 0.12212872505187988 time for calcul the mask position with numpy : 0.012057065963745117 nb_pixel_total : 767171 time to create 1 rle with new method : 0.617567777633667 create new chi : 1.0258817672729492 time to delete rle : 0.0005750656127929688 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 4256 TO DO : save crop sub photo not yet done ! save time : 0.2874023914337158 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0490880012512207 time for calcul the mask position with numpy : 0.01947951316833496 nb_pixel_total : 2041181 time to create 1 rle with new method : 0.1029977798461914 time for calcul the mask position with numpy : 0.0060939788818359375 nb_pixel_total : 10119 time to create 1 rle with old method : 0.011725664138793945 time for calcul the mask position with numpy : 0.006194353103637695 nb_pixel_total : 22300 time to create 1 rle with old method : 0.02600884437561035 create new chi : 0.18304967880249023 time to delete rle : 0.00035643577575683594 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1562 TO DO : save crop sub photo not yet done ! save time : 0.13906311988830566 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03318524360656738 time for calcul the mask position with numpy : 0.28257131576538086 nb_pixel_total : 2067745 time to create 1 rle with new method : 0.5043179988861084 time for calcul the mask position with numpy : 0.006262302398681641 nb_pixel_total : 5855 time to create 1 rle with old method : 0.006758689880371094 create new chi : 0.808861255645752 time to delete rle : 0.00023984909057617188 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1222 TO DO : save crop sub photo not yet done ! save time : 0.11636543273925781 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.048264265060424805 time for calcul the mask position with numpy : 0.04830670356750488 nb_pixel_total : 1186611 time to create 1 rle with new method : 0.18666386604309082 time for calcul the mask position with numpy : 0.015645503997802734 nb_pixel_total : 885170 time to create 1 rle with new method : 0.08986783027648926 time for calcul the mask position with numpy : 0.006114482879638672 nb_pixel_total : 1819 time to create 1 rle with old method : 0.0020918846130371094 create new chi : 0.35832881927490234 time to delete rle : 0.0006411075592041016 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 4150 TO DO : save crop sub photo not yet done ! save time : 0.28269314765930176 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06957125663757324 time for calcul the mask position with numpy : 0.011737346649169922 nb_pixel_total : 736494 time to create 1 rle with new method : 0.2604982852935791 time for calcul the mask position with numpy : 0.00607609748840332 nb_pixel_total : 6266 time to create 1 rle with old method : 0.007022857666015625 time for calcul the mask position with numpy : 0.04595828056335449 nb_pixel_total : 1202693 time to create 1 rle with new method : 0.17192530632019043 time for calcul the mask position with numpy : 0.0063419342041015625 nb_pixel_total : 8530 time to create 1 rle with old method : 0.009797811508178711 time for calcul the mask position with numpy : 0.006686210632324219 nb_pixel_total : 119617 time to create 1 rle with old method : 0.13588666915893555 create new chi : 0.6768820285797119 time to delete rle : 0.0008270740509033203 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5640 TO DO : save crop sub photo not yet done ! save time : 0.3677525520324707 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04785776138305664 time for calcul the mask position with numpy : 0.02407526969909668 nb_pixel_total : 1937682 time to create 1 rle with new method : 0.19172382354736328 time for calcul the mask position with numpy : 0.0067596435546875 nb_pixel_total : 106834 time to create 1 rle with old method : 0.1211087703704834 time for calcul the mask position with numpy : 0.005936622619628906 nb_pixel_total : 18445 time to create 1 rle with old method : 0.021011829376220703 time for calcul the mask position with numpy : 0.0058209896087646484 nb_pixel_total : 10639 time to create 1 rle with old method : 0.012303352355957031 create new chi : 0.39597105979919434 time to delete rle : 0.0003135204315185547 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2736 TO DO : save crop sub photo not yet done ! save time : 0.20125722885131836 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03897714614868164 time for calcul the mask position with numpy : 0.07698726654052734 nb_pixel_total : 2069158 time to create 1 rle with new method : 0.1955578327178955 time for calcul the mask position with numpy : 0.005915403366088867 nb_pixel_total : 4442 time to create 1 rle with old method : 0.0051195621490478516 create new chi : 0.29399919509887695 time to delete rle : 0.00023221969604492188 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1270 TO DO : save crop sub photo not yet done ! save time : 0.12453627586364746 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.442795991897583 time for calcul the mask position with numpy : 0.04503917694091797 nb_pixel_total : 1213776 time to create 1 rle with new method : 0.20221400260925293 time for calcul the mask position with numpy : 0.010941743850708008 nb_pixel_total : 733733 time to create 1 rle with new method : 0.0881350040435791 time for calcul the mask position with numpy : 0.00611567497253418 nb_pixel_total : 4949 time to create 1 rle with old method : 0.005719423294067383 time for calcul the mask position with numpy : 0.006265878677368164 nb_pixel_total : 116813 time to create 1 rle with old method : 0.13123822212219238 time for calcul the mask position with numpy : 0.005985260009765625 nb_pixel_total : 4329 time to create 1 rle with old method : 0.005006313323974609 create new chi : 0.5151848793029785 time to delete rle : 0.0011954307556152344 batch 1 Loaded 9 chid ids of type : 3594 ++++++++Number RLEs to save : 4568 TO DO : save crop sub photo not yet done ! save time : 0.312028169631958 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04951596260070801 time for calcul the mask position with numpy : 0.010842084884643555 nb_pixel_total : 736773 time to create 1 rle with new method : 0.1716318130493164 time for calcul the mask position with numpy : 0.013788938522338867 nb_pixel_total : 1242511 time to create 1 rle with new method : 0.02798318862915039 time for calcul the mask position with numpy : 0.006440639495849609 nb_pixel_total : 94316 time to create 1 rle with old method : 0.10940790176391602 create new chi : 0.3407096862792969 time to delete rle : 0.0007863044738769531 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 5116 TO DO : save crop sub photo not yet done ! save time : 0.33811187744140625 No data in photo_id : 1375450377 No data in photo_id : 1375450328 No data in photo_id : 1375450304 No data in photo_id : 1375450292 No data in photo_id : 1375450165 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07276082038879395 time for calcul the mask position with numpy : 0.14884448051452637 nb_pixel_total : 1982879 time to create 1 rle with new method : 0.1779038906097412 time for calcul the mask position with numpy : 0.006561279296875 nb_pixel_total : 90721 time to create 1 rle with old method : 0.10207915306091309 create new chi : 0.44540858268737793 time to delete rle : 0.0004668235778808594 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2062 TO DO : save crop sub photo not yet done ! save time : 0.16136646270751953 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03277993202209473 time for calcul the mask position with numpy : 0.07831645011901855 nb_pixel_total : 1981029 time to create 1 rle with new method : 0.17583656311035156 time for calcul the mask position with numpy : 0.006583452224731445 nb_pixel_total : 92571 time to create 1 rle with old method : 0.10589075088500977 create new chi : 0.3768041133880615 time to delete rle : 0.0003814697265625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2058 TO DO : save crop sub photo not yet done ! save time : 0.17553400993347168 No data in photo_id : 1375449744 No data in photo_id : 1375449638 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03216195106506348 time for calcul the mask position with numpy : 0.1817777156829834 nb_pixel_total : 1986135 time to create 1 rle with new method : 0.09518146514892578 time for calcul the mask position with numpy : 0.006521463394165039 nb_pixel_total : 87465 time to create 1 rle with old method : 0.09795641899108887 create new chi : 0.3919084072113037 time to delete rle : 0.00035262107849121094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2058 TO DO : save crop sub photo not yet done ! save time : 0.17474699020385742 map_output_result : {1375450808: (0.0, 'Should be the crop_list due to order', 0), 1375450805: (0.0, 'Should be the crop_list due to order', 0), 1375450771: (0.0, 'Should be the crop_list due to order', 0.0), 1375450768: (0.0, 'Should be the crop_list due to order', 0), 1375450764: (0.0, 'Should be the crop_list due to order', 0), 1375450760: (0.0, 'Should be the crop_list due to order', 0), 1375450757: (0.0, 'Should be the crop_list due to order', 0), 1375450753: (0.0, 'Should be the crop_list due to order', 0), 1375450722: (0.0, 'Should be the crop_list due to order', 0), 1375450719: (0.0, 'Should be the crop_list due to order', 0.0), 1375450717: (0.0, 'Should be the crop_list due to order', 0), 1375450715: (0.0, 'Should be the crop_list due to order', 0.0), 1375450710: (0.0, 'Should be the crop_list due to order', 0), 1375450707: (0.0, 'Should be the crop_list due to order', 0), 1375450693: (0.0, 'Should be the crop_list due to order', 0), 1375450690: (0.0, 'Should be the crop_list due to order', 0), 1375450687: (0.0, 'Should be the crop_list due to order', 0), 1375450682: (0.0, 'Should be the crop_list due to order', 0), 1375450678: (0.0, 'Should be the crop_list due to order', 0), 1375450674: (0.0, 'Should be the crop_list due to order', 0), 1375450505: (0.0, 'Should be the crop_list due to order', 0), 1375450487: (0.0, 'Should be the crop_list due to order', 0), 1375450485: (0.0, 'Should be the crop_list due to order', 0), 1375450483: (0.0, 'Should be the crop_list due to order', 0), 1375450392: (0.0, 'Should be the crop_list due to order', 0), 1375450377: (0.0, 'Should be the crop_list due to order', 0.0), 1375450328: (0.0, 'Should be the crop_list due to order', 0.0), 1375450304: (0.0, 'Should be the crop_list due to order', 0.0), 1375450292: (0.0, 'Should be the crop_list due to order', 0.0), 1375450165: (0.0, 'Should be the crop_list due to order', 0.0), 1375450077: (0.0, 'Should be the crop_list due to order', 0), 1375450044: (0.0, 'Should be the crop_list due to order', 0), 1375449744: (0.0, 'Should be the crop_list due to order', 0.0), 1375449638: (0.0, 'Should be the crop_list due to order', 0.0), 1375449265: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375450808, 1375450805, 1375450771, 1375450768, 1375450764, 1375450760, 1375450757, 1375450753, 1375450722, 1375450719, 1375450717, 1375450715, 1375450710, 1375450707, 1375450693, 1375450690, 1375450687, 1375450682, 1375450678, 1375450674, 1375450505, 1375450487, 1375450485, 1375450483, 1375450392, 1375450377, 1375450328, 1375450304, 1375450292, 1375450165, 1375450077, 1375450044, 1375449744, 1375449638, 1375449265] Looping around the photos to save general results len do output : 35 /1375450808.Didn't retrieve data . /1375450805.Didn't retrieve data . /1375450771.Didn't retrieve data . /1375450768.Didn't retrieve data . /1375450764.Didn't retrieve data . /1375450760.Didn't retrieve data . /1375450757.Didn't retrieve data . /1375450753.Didn't retrieve data . /1375450722.Didn't retrieve data . /1375450719.Didn't retrieve data . /1375450717.Didn't retrieve data . /1375450715.Didn't retrieve data . /1375450710.Didn't retrieve data . /1375450707.Didn't retrieve data . /1375450693.Didn't retrieve data . /1375450690.Didn't retrieve data . /1375450687.Didn't retrieve data . /1375450682.Didn't retrieve data . /1375450678.Didn't retrieve data . /1375450674.Didn't retrieve data . /1375450505.Didn't retrieve data . /1375450487.Didn't retrieve data . /1375450485.Didn't retrieve data . /1375450483.Didn't retrieve data . /1375450392.Didn't retrieve data . /1375450377.Didn't retrieve data . /1375450328.Didn't retrieve data . /1375450304.Didn't retrieve data . /1375450292.Didn't retrieve data . /1375450165.Didn't retrieve data . /1375450077.Didn't retrieve data . /1375450044.Didn't retrieve data . /1375449744.Didn't retrieve data . /1375449638.Didn't retrieve data . /1375449265.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450808', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450805', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450771', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450768', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450764', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450760', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450757', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450753', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450722', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450719', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450717', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450715', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450710', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450707', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450693', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450690', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450687', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450682', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450678', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450674', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450505', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450487', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450485', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450483', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450392', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450377', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450328', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450304', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450292', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450165', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450077', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450044', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449744', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449638', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449265', None, None, None, None, None, '3460108') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 105 time used for this insertion : 0.018967390060424805 save_final save missing photos in datou_result : time spend for datou_step_exec : 21.305490493774414 time spend to save output : 0.020320415496826172 total time spend for step 3 : 21.32581090927124 step4:ventilate_hashtags_in_portfolio Wed Aug 6 14:12:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25727194 get user id for portfolio 25727194 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727194 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','metal','flou','pehd','carton','pet_fonce','papier','mal_croppe','pet_clair','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727194 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','metal','flou','pehd','carton','pet_fonce','papier','mal_croppe','pet_clair','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727194 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','metal','flou','pehd','carton','pet_fonce','papier','mal_croppe','pet_clair','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25729128,25729129,25729130,25729131,25729132,25729133,25729134,25729135,25729136,25729137,25729138?tags=environnement,autre,metal,flou,pehd,carton,pet_fonce,papier,mal_croppe,pet_clair,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375450808, 1375450805, 1375450771, 1375450768, 1375450764, 1375450760, 1375450757, 1375450753, 1375450722, 1375450719, 1375450717, 1375450715, 1375450710, 1375450707, 1375450693, 1375450690, 1375450687, 1375450682, 1375450678, 1375450674, 1375450505, 1375450487, 1375450485, 1375450483, 1375450392, 1375450377, 1375450328, 1375450304, 1375450292, 1375450165, 1375450077, 1375450044, 1375449744, 1375449638, 1375449265] Looping around the photos to save general results len do output : 1 /25727194. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450808', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450805', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450771', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450768', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450764', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450760', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450757', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450753', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450722', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450719', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450717', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450715', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450710', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450707', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450693', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450690', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450687', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450682', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450678', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450674', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450505', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450487', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450485', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450483', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450392', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450377', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450328', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450304', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450292', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450165', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450077', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450044', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449744', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449638', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449265', None, None, None, None, None, '3460108') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.017058372497558594 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6214442253112793 time spend to save output : 0.01747274398803711 total time spend for step 4 : 1.6389169692993164 step5:final Wed Aug 6 14:12:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375450808: ('0.14284234457671954',), 1375450805: ('0.14284234457671954',), 1375450771: ('0.14284234457671954',), 1375450768: ('0.14284234457671954',), 1375450764: ('0.14284234457671954',), 1375450760: ('0.14284234457671954',), 1375450757: ('0.14284234457671954',), 1375450753: ('0.14284234457671954',), 1375450722: ('0.14284234457671954',), 1375450719: ('0.14284234457671954',), 1375450717: ('0.14284234457671954',), 1375450715: ('0.14284234457671954',), 1375450710: ('0.14284234457671954',), 1375450707: ('0.14284234457671954',), 1375450693: ('0.14284234457671954',), 1375450690: ('0.14284234457671954',), 1375450687: ('0.14284234457671954',), 1375450682: ('0.14284234457671954',), 1375450678: ('0.14284234457671954',), 1375450674: ('0.14284234457671954',), 1375450505: ('0.14284234457671954',), 1375450487: ('0.14284234457671954',), 1375450485: ('0.14284234457671954',), 1375450483: ('0.14284234457671954',), 1375450392: ('0.14284234457671954',), 1375450377: ('0.14284234457671954',), 1375450328: ('0.14284234457671954',), 1375450304: ('0.14284234457671954',), 1375450292: ('0.14284234457671954',), 1375450165: ('0.14284234457671954',), 1375450077: ('0.14284234457671954',), 1375450044: ('0.14284234457671954',), 1375449744: ('0.14284234457671954',), 1375449638: ('0.14284234457671954',), 1375449265: ('0.14284234457671954',)} new output for save of step final : {1375450808: ('0.14284234457671954',), 1375450805: ('0.14284234457671954',), 1375450771: ('0.14284234457671954',), 1375450768: ('0.14284234457671954',), 1375450764: ('0.14284234457671954',), 1375450760: ('0.14284234457671954',), 1375450757: ('0.14284234457671954',), 1375450753: ('0.14284234457671954',), 1375450722: ('0.14284234457671954',), 1375450719: ('0.14284234457671954',), 1375450717: ('0.14284234457671954',), 1375450715: ('0.14284234457671954',), 1375450710: ('0.14284234457671954',), 1375450707: ('0.14284234457671954',), 1375450693: ('0.14284234457671954',), 1375450690: ('0.14284234457671954',), 1375450687: ('0.14284234457671954',), 1375450682: ('0.14284234457671954',), 1375450678: ('0.14284234457671954',), 1375450674: ('0.14284234457671954',), 1375450505: ('0.14284234457671954',), 1375450487: ('0.14284234457671954',), 1375450485: ('0.14284234457671954',), 1375450483: ('0.14284234457671954',), 1375450392: ('0.14284234457671954',), 1375450377: ('0.14284234457671954',), 1375450328: ('0.14284234457671954',), 1375450304: ('0.14284234457671954',), 1375450292: ('0.14284234457671954',), 1375450165: ('0.14284234457671954',), 1375450077: ('0.14284234457671954',), 1375450044: ('0.14284234457671954',), 1375449744: ('0.14284234457671954',), 1375449638: ('0.14284234457671954',), 1375449265: ('0.14284234457671954',)} [1375450808, 1375450805, 1375450771, 1375450768, 1375450764, 1375450760, 1375450757, 1375450753, 1375450722, 1375450719, 1375450717, 1375450715, 1375450710, 1375450707, 1375450693, 1375450690, 1375450687, 1375450682, 1375450678, 1375450674, 1375450505, 1375450487, 1375450485, 1375450483, 1375450392, 1375450377, 1375450328, 1375450304, 1375450292, 1375450165, 1375450077, 1375450044, 1375449744, 1375449638, 1375449265] Looping around the photos to save general results len do output : 35 /1375450808.Didn't retrieve data . /1375450805.Didn't retrieve data . /1375450771.Didn't retrieve data . /1375450768.Didn't retrieve data . /1375450764.Didn't retrieve data . /1375450760.Didn't retrieve data . /1375450757.Didn't retrieve data . /1375450753.Didn't retrieve data . /1375450722.Didn't retrieve data . /1375450719.Didn't retrieve data . /1375450717.Didn't retrieve data . /1375450715.Didn't retrieve data . /1375450710.Didn't retrieve data . /1375450707.Didn't retrieve data . /1375450693.Didn't retrieve data . /1375450690.Didn't retrieve data . /1375450687.Didn't retrieve data . /1375450682.Didn't retrieve data . /1375450678.Didn't retrieve data . /1375450674.Didn't retrieve data . /1375450505.Didn't retrieve data . /1375450487.Didn't retrieve data . /1375450485.Didn't retrieve data . /1375450483.Didn't retrieve data . /1375450392.Didn't retrieve data . /1375450377.Didn't retrieve data . /1375450328.Didn't retrieve data . /1375450304.Didn't retrieve data . /1375450292.Didn't retrieve data . /1375450165.Didn't retrieve data . /1375450077.Didn't retrieve data . /1375450044.Didn't retrieve data . /1375449744.Didn't retrieve data . /1375449638.Didn't retrieve data . /1375449265.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450808', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450805', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450771', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450768', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450764', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450760', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450757', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450753', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450722', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450719', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450717', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450715', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450710', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450707', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450693', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450690', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450687', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450682', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450678', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450674', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450505', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450487', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450485', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450483', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450392', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450377', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450328', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450304', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450292', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450165', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450077', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450044', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449744', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449638', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449265', None, None, None, None, None, '3460108') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 105 time used for this insertion : 0.016091108322143555 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11861848831176758 time spend to save output : 0.017537832260131836 total time spend for step 5 : 0.13615632057189941 step6:blur_detection Wed Aug 6 14:12:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce.jpg resize: (1080, 1920) 1375450808 -1.8308605760554668 treat image : temp/1754482228_1186623_1375450805_f1251685c2de5d7370bc1afe27000eeb.jpg resize: (1080, 1920) 1375450805 -2.666590919706964 treat image : temp/1754482228_1186623_1375450771_4b672d2d8850548900e78d7003ed778c.jpg resize: (1080, 1920) 1375450771 -1.0824523364059035 treat image : temp/1754482228_1186623_1375450768_c8938babd32534feade6f8c765f2c067.jpg resize: (1080, 1920) 1375450768 -1.5718022810515264 treat image : temp/1754482228_1186623_1375450764_8eb6e45ed25349db15ea15a0eb3f5512.jpg resize: (1080, 1920) 1375450764 -2.4715257777327166 treat image : temp/1754482228_1186623_1375450760_5e7e84870b7cfa622841fed032156a45.jpg resize: (1080, 1920) 1375450760 -2.8339700134772863 treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a.jpg resize: (1080, 1920) 1375450757 -1.887383484228995 treat image : temp/1754482228_1186623_1375450753_9d75177a689ade8beea9fadfc1b95202.jpg resize: (1080, 1920) 1375450753 -4.592748238552295 treat image : temp/1754482228_1186623_1375450722_a002c99cc81dabfecf9663f2f5947068.jpg resize: (1080, 1920) 1375450722 -2.81472235009827 treat image : temp/1754482228_1186623_1375450719_176e7660ac190d82993afebb2618eeba.jpg resize: (1080, 1920) 1375450719 -2.6284394805847278 treat image : temp/1754482228_1186623_1375450717_b8b1cd0db74f914dcd2d194b0583972c.jpg resize: (1080, 1920) 1375450717 -2.8909980763678735 treat image : temp/1754482228_1186623_1375450715_c71798a1f14862e840e652f715acd162.jpg resize: (1080, 1920) 1375450715 -2.3604972209111614 treat image : temp/1754482228_1186623_1375450710_b2bdda35e972288acb14628187c62208.jpg resize: (1080, 1920) 1375450710 -0.9597151183627682 treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30.jpg resize: (1080, 1920) 1375450707 -2.5091414725930448 treat image : temp/1754482228_1186623_1375450693_dbad3a144e8f073730b99564e8858f88.jpg resize: (1080, 1920) 1375450693 -2.5274750395334604 treat image : temp/1754482228_1186623_1375450690_4bedda13aa8b42ae81565e0f672ac2c4.jpg resize: (1080, 1920) 1375450690 -2.144353606646684 treat image : temp/1754482228_1186623_1375450687_c444ef463c1c749689314c8e4dca2342.jpg resize: (1080, 1920) 1375450687 -2.2219007689229895 treat image : temp/1754482228_1186623_1375450682_d20dca89a4347cecabc76160dec7d9a6.jpg resize: (1080, 1920) 1375450682 -2.844120414109627 treat image : temp/1754482228_1186623_1375450678_fe89f7631441d379f7366bfcc3a726fd.jpg resize: (1080, 1920) 1375450678 -2.7571594814171787 treat image : temp/1754482228_1186623_1375450674_d336fa71fc47c6a48a6f1e51cab3c4dd.jpg resize: (1080, 1920) 1375450674 -1.5349095722164883 treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc.jpg resize: (1080, 1920) 1375450505 -1.8873299664975092 treat image : temp/1754482228_1186623_1375450487_fe8e46c300705fbe93eac5660ad20fb2.jpg resize: (1080, 1920) 1375450487 -3.093104945299045 treat image : temp/1754482228_1186623_1375450485_3dd7beab53d8887c3924f78214035c01.jpg resize: (1080, 1920) 1375450485 -2.068057547133894 treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653.jpg resize: (1080, 1920) 1375450483 -2.3139699670580063 treat image : temp/1754482228_1186623_1375450392_8f05116e7097705c53d7f4dd500a9c3b.jpg resize: (1080, 1920) 1375450392 11.496936475961943 treat image : temp/1754482228_1186623_1375450377_f8073248a19a12e477cdae622ed532e2.jpg resize: (1080, 1920) 1375450377 9.803559245121738 treat image : temp/1754482228_1186623_1375450328_f5f417bac45c9f30924a7bb44649418a.jpg resize: (1080, 1920) 1375450328 9.379359360117558 treat image : temp/1754482228_1186623_1375450304_04504beb05f8544409612273146160e0.jpg resize: (1080, 1920) 1375450304 10.224172984293757 treat image : temp/1754482228_1186623_1375450292_18c2ad0ebfce7b0c00f0b40d02a1e5a0.jpg resize: (1080, 1920) 1375450292 10.366112107714567 treat image : temp/1754482228_1186623_1375450165_0f5e8306f98aa79b69648d2a1edd6a26.jpg resize: (1080, 1920) 1375450165 10.438435717178312 treat image : temp/1754482228_1186623_1375450077_60a49dbd64e3ef7d02ae2140ff6876c6.jpg resize: (1080, 1920) 1375450077 10.11439155106836 treat image : temp/1754482228_1186623_1375450044_a739f7644f4242495c721d6132e69b63.jpg resize: (1080, 1920) 1375450044 10.27862775629169 treat image : temp/1754482228_1186623_1375449744_6e26c9ed4c788125e73f1910a2f68346.jpg resize: (1080, 1920) 1375449744 10.029186031065894 treat image : temp/1754482228_1186623_1375449638_5676bcd66cb6a1a8dc3a87581bf051f3.jpg resize: (1080, 1920) 1375449638 10.386477395916986 treat image : temp/1754482228_1186623_1375449265_949d3e0cb6880aa3bd354ddb811738dd.jpg resize: (1080, 1920) 1375449265 10.561895386937204 treat image : temp/1754482228_1186623_1375450760_5e7e84870b7cfa622841fed032156a45_rle_crop_3904817622_0.png resize: (108, 88) 1375481978 -2.687785873338823 treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817624_0.png resize: (258, 81) 1375481981 -3.1453961132312727 treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817625_0.png resize: (60, 147) 1375481984 -1.760161197035646 treat image : temp/1754482228_1186623_1375450722_a002c99cc81dabfecf9663f2f5947068_rle_crop_3904817630_0.png resize: (65, 116) 1375481985 -2.759422520922952 treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30_rle_crop_3904817635_0.png resize: (127, 107) 1375481988 -0.9444589408415313 treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30_rle_crop_3904817636_0.png resize: (66, 81) 1375481991 -3.156349913304079 treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30_rle_crop_3904817637_0.png resize: (109, 118) 1375481993 -2.7610405799706608 treat image : temp/1754482228_1186623_1375450487_fe8e46c300705fbe93eac5660ad20fb2_rle_crop_3904817652_0.png resize: (142, 110) 1375481996 -0.2864926313853297 treat image : temp/1754482228_1186623_1375450487_fe8e46c300705fbe93eac5660ad20fb2_rle_crop_3904817653_0.png resize: (173, 184) 1375481999 -1.5616637222708243 treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653_rle_crop_3904817656_0.png resize: (82, 69) 1375482000 -0.4188097525107947 treat image : temp/1754482228_1186623_1375450768_c8938babd32534feade6f8c765f2c067_rle_crop_3904817616_0.png resize: (91, 102) 1375482022 -0.3368202508319971 treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc_rle_crop_3904817649_0.png resize: (100, 119) 1375482023 -0.971708303618751 treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817609_0.png resize: (68, 76) 1375482044 -3.4195733224081604 treat image : temp/1754482228_1186623_1375450768_c8938babd32534feade6f8c765f2c067_rle_crop_3904817618_0.png resize: (61, 76) 1375482046 -2.1554343420834536 treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817607_0.png resize: (183, 173) 1375482616 -2.577859755772214 treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817608_0.png resize: (175, 87) 1375482617 -4.985379765666449 treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817610_0.png resize: (1002, 1056) 1375482620 -0.5605785400673632 treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817611_0.png resize: (535, 340) 1375482621 0.030214402418195098 treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817612_0.png resize: (109, 108) 1375482622 -2.1359071000525596 treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817613_0.png resize: (81, 158) 1375482624 -2.051440635351388 treat image : temp/1754482228_1186623_1375450805_f1251685c2de5d7370bc1afe27000eeb_rle_crop_3904817614_0.png resize: (545, 308) 1375482625 -0.4589639988775732 treat image : temp/1754482228_1186623_1375450805_f1251685c2de5d7370bc1afe27000eeb_rle_crop_3904817615_0.png resize: (115, 62) 1375482626 -3.5393157179519603 treat image : temp/1754482228_1186623_1375450768_c8938babd32534feade6f8c765f2c067_rle_crop_3904817617_0.png resize: (228, 268) 1375482628 -1.2584262051569566 treat image : temp/1754482228_1186623_1375450764_8eb6e45ed25349db15ea15a0eb3f5512_rle_crop_3904817619_0.png resize: (995, 1266) 1375482629 -1.4736210490386976 treat image : temp/1754482228_1186623_1375450764_8eb6e45ed25349db15ea15a0eb3f5512_rle_crop_3904817620_0.png resize: (545, 324) 1375482630 -0.60185851187139 treat image : temp/1754482228_1186623_1375450760_5e7e84870b7cfa622841fed032156a45_rle_crop_3904817621_0.png resize: (393, 357) 1375482632 0.43577763479368287 treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817626_0.png resize: (539, 343) 1375482633 -0.0733615453960478 treat image : temp/1754482228_1186623_1375450753_9d75177a689ade8beea9fadfc1b95202_rle_crop_3904817628_0.png resize: (564, 342) 1375482634 -0.12899020647437529 treat image : temp/1754482228_1186623_1375450710_b2bdda35e972288acb14628187c62208_rle_crop_3904817632_0.png resize: (69, 121) 1375482636 -4.515223186571897 treat image : temp/1754482228_1186623_1375450710_b2bdda35e972288acb14628187c62208_rle_crop_3904817633_0.png resize: (952, 1043) 1375482637 0.7715168087559168 treat image : temp/1754482228_1186623_1375450710_b2bdda35e972288acb14628187c62208_rle_crop_3904817634_0.png resize: (540, 336) 1375482638 0.20176010529651764 treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30_rle_crop_3904817638_0.png resize: (1015, 1247) 1375482640 -1.4269300133862008 treat image : temp/1754482228_1186623_1375450693_dbad3a144e8f073730b99564e8858f88_rle_crop_3904817639_0.png resize: (568, 373) 1375482641 0.2780075338590319 treat image : temp/1754482228_1186623_1375450690_4bedda13aa8b42ae81565e0f672ac2c4_rle_crop_3904817640_0.png resize: (529, 352) 1375482642 -0.18441863186262736 treat image : temp/1754482228_1186623_1375450687_c444ef463c1c749689314c8e4dca2342_rle_crop_3904817641_0.png resize: (990, 1078) 1375482644 -0.28590159397933773 treat image : temp/1754482228_1186623_1375450687_c444ef463c1c749689314c8e4dca2342_rle_crop_3904817642_0.png resize: (552, 333) 1375482645 -0.004230060791190442 treat image : temp/1754482228_1186623_1375450682_d20dca89a4347cecabc76160dec7d9a6_rle_crop_3904817643_0.png resize: (118, 236) 1375482646 -3.5290719292042723 treat image : temp/1754482228_1186623_1375450682_d20dca89a4347cecabc76160dec7d9a6_rle_crop_3904817644_0.png resize: (104, 117) 1375482648 -1.2709548965538775 treat image : temp/1754482228_1186623_1375450678_fe89f7631441d379f7366bfcc3a726fd_rle_crop_3904817645_0.png resize: (70, 97) 1375482649 -3.8939590418679573 treat image : temp/1754482228_1186623_1375450674_d336fa71fc47c6a48a6f1e51cab3c4dd_rle_crop_3904817646_0.png resize: (48, 52) 1375482650 0.5094870689663245 treat image : temp/1754482228_1186623_1375450674_d336fa71fc47c6a48a6f1e51cab3c4dd_rle_crop_3904817647_0.png resize: (982, 1273) 1375482652 -0.5602936600146003 treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc_rle_crop_3904817648_0.png resize: (540, 371) 1375482653 0.39322855842311216 treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc_rle_crop_3904817650_0.png resize: (989, 1493) 1375482654 -2.2287530732891643 treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc_rle_crop_3904817651_0.png resize: (166, 245) 1375482656 -3.713323624684573 treat image : temp/1754482228_1186623_1375450487_fe8e46c300705fbe93eac5660ad20fb2_rle_crop_3904817654_0.png resize: (507, 334) 1375482657 0.057042806679108965 treat image : temp/1754482228_1186623_1375450485_3dd7beab53d8887c3924f78214035c01_rle_crop_3904817655_0.png resize: (95, 59) 1375482658 -2.3355601929338574 treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653_rle_crop_3904817657_0.png resize: (558, 359) 1375482659 0.17354938858555197 treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653_rle_crop_3904817659_0.png resize: (984, 1004) 1375482660 0.022588001753921987 treat image : temp/1754482228_1186623_1375450392_8f05116e7097705c53d7f4dd500a9c3b_rle_crop_3904817661_0.png resize: (1006, 1378) 1375482661 1.5693268267833766 treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817623_0.png resize: (250, 187) 1375482668 -1.29867944317739 treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817627_0.png resize: (113, 59) 1375482669 -1.479030380420033 treat image : temp/1754482228_1186623_1375450753_9d75177a689ade8beea9fadfc1b95202_rle_crop_3904817629_0.png resize: (134, 108) 1375482670 -2.1510802031380627 treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653_rle_crop_3904817658_0.png resize: (116, 63) 1375482671 -2.0599206510633308 treat image : temp/1754482228_1186623_1375450392_8f05116e7097705c53d7f4dd500a9c3b_rle_crop_3904817660_0.png resize: (501, 304) 1375482672 0.5627737377447409 treat image : temp/1754482228_1186623_1375450077_60a49dbd64e3ef7d02ae2140ff6876c6_rle_crop_3904817662_0.png resize: (491, 314) 1375482673 0.6161055339038153 treat image : temp/1754482228_1186623_1375450044_a739f7644f4242495c721d6132e69b63_rle_crop_3904817663_0.png resize: (489, 319) 1375482674 0.44869424666176816 treat image : temp/1754482228_1186623_1375449265_949d3e0cb6880aa3bd354ddb811738dd_rle_crop_3904817664_0.png resize: (488, 302) 1375482675 0.433638911204429 treat image : temp/1754482228_1186623_1375450717_b8b1cd0db74f914dcd2d194b0583972c_rle_crop_3904817631_0.png resize: (109, 105) 1375482683 -1.9824607950106299 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 93 time used for this insertion : 0.01599884033203125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 93 time used for this insertion : 0.02008509635925293 save missing photos in datou_result : time spend for datou_step_exec : 30.583776473999023 time spend to save output : 0.040834903717041016 total time spend for step 6 : 30.624611377716064 step7:brightness Wed Aug 6 14:13:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce.jpg treat image : temp/1754482228_1186623_1375450805_f1251685c2de5d7370bc1afe27000eeb.jpg treat image : temp/1754482228_1186623_1375450771_4b672d2d8850548900e78d7003ed778c.jpg treat image : temp/1754482228_1186623_1375450768_c8938babd32534feade6f8c765f2c067.jpg treat image : temp/1754482228_1186623_1375450764_8eb6e45ed25349db15ea15a0eb3f5512.jpg treat image : temp/1754482228_1186623_1375450760_5e7e84870b7cfa622841fed032156a45.jpg treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a.jpg treat image : temp/1754482228_1186623_1375450753_9d75177a689ade8beea9fadfc1b95202.jpg treat image : temp/1754482228_1186623_1375450722_a002c99cc81dabfecf9663f2f5947068.jpg treat image : temp/1754482228_1186623_1375450719_176e7660ac190d82993afebb2618eeba.jpg treat image : temp/1754482228_1186623_1375450717_b8b1cd0db74f914dcd2d194b0583972c.jpg treat image : temp/1754482228_1186623_1375450715_c71798a1f14862e840e652f715acd162.jpg treat image : temp/1754482228_1186623_1375450710_b2bdda35e972288acb14628187c62208.jpg treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30.jpg treat image : temp/1754482228_1186623_1375450693_dbad3a144e8f073730b99564e8858f88.jpg treat image : temp/1754482228_1186623_1375450690_4bedda13aa8b42ae81565e0f672ac2c4.jpg treat image : temp/1754482228_1186623_1375450687_c444ef463c1c749689314c8e4dca2342.jpg treat image : temp/1754482228_1186623_1375450682_d20dca89a4347cecabc76160dec7d9a6.jpg treat image : temp/1754482228_1186623_1375450678_fe89f7631441d379f7366bfcc3a726fd.jpg treat image : temp/1754482228_1186623_1375450674_d336fa71fc47c6a48a6f1e51cab3c4dd.jpg treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc.jpg treat image : temp/1754482228_1186623_1375450487_fe8e46c300705fbe93eac5660ad20fb2.jpg treat image : temp/1754482228_1186623_1375450485_3dd7beab53d8887c3924f78214035c01.jpg treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653.jpg treat image : temp/1754482228_1186623_1375450392_8f05116e7097705c53d7f4dd500a9c3b.jpg treat image : temp/1754482228_1186623_1375450377_f8073248a19a12e477cdae622ed532e2.jpg treat image : temp/1754482228_1186623_1375450328_f5f417bac45c9f30924a7bb44649418a.jpg treat image : temp/1754482228_1186623_1375450304_04504beb05f8544409612273146160e0.jpg treat image : temp/1754482228_1186623_1375450292_18c2ad0ebfce7b0c00f0b40d02a1e5a0.jpg treat image : temp/1754482228_1186623_1375450165_0f5e8306f98aa79b69648d2a1edd6a26.jpg treat image : temp/1754482228_1186623_1375450077_60a49dbd64e3ef7d02ae2140ff6876c6.jpg treat image : temp/1754482228_1186623_1375450044_a739f7644f4242495c721d6132e69b63.jpg treat image : temp/1754482228_1186623_1375449744_6e26c9ed4c788125e73f1910a2f68346.jpg treat image : temp/1754482228_1186623_1375449638_5676bcd66cb6a1a8dc3a87581bf051f3.jpg treat image : temp/1754482228_1186623_1375449265_949d3e0cb6880aa3bd354ddb811738dd.jpg treat image : temp/1754482228_1186623_1375450760_5e7e84870b7cfa622841fed032156a45_rle_crop_3904817622_0.png treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817624_0.png treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817625_0.png treat image : temp/1754482228_1186623_1375450722_a002c99cc81dabfecf9663f2f5947068_rle_crop_3904817630_0.png treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30_rle_crop_3904817635_0.png treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30_rle_crop_3904817636_0.png treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30_rle_crop_3904817637_0.png treat image : temp/1754482228_1186623_1375450487_fe8e46c300705fbe93eac5660ad20fb2_rle_crop_3904817652_0.png treat image : temp/1754482228_1186623_1375450487_fe8e46c300705fbe93eac5660ad20fb2_rle_crop_3904817653_0.png treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653_rle_crop_3904817656_0.png treat image : temp/1754482228_1186623_1375450768_c8938babd32534feade6f8c765f2c067_rle_crop_3904817616_0.png treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc_rle_crop_3904817649_0.png treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817609_0.png treat image : temp/1754482228_1186623_1375450768_c8938babd32534feade6f8c765f2c067_rle_crop_3904817618_0.png treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817607_0.png treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817608_0.png treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817610_0.png treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817611_0.png treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817612_0.png treat image : temp/1754482228_1186623_1375450808_77c277cb7081d069a23a959678688cce_rle_crop_3904817613_0.png treat image : temp/1754482228_1186623_1375450805_f1251685c2de5d7370bc1afe27000eeb_rle_crop_3904817614_0.png treat image : temp/1754482228_1186623_1375450805_f1251685c2de5d7370bc1afe27000eeb_rle_crop_3904817615_0.png treat image : temp/1754482228_1186623_1375450768_c8938babd32534feade6f8c765f2c067_rle_crop_3904817617_0.png treat image : temp/1754482228_1186623_1375450764_8eb6e45ed25349db15ea15a0eb3f5512_rle_crop_3904817619_0.png treat image : temp/1754482228_1186623_1375450764_8eb6e45ed25349db15ea15a0eb3f5512_rle_crop_3904817620_0.png treat image : temp/1754482228_1186623_1375450760_5e7e84870b7cfa622841fed032156a45_rle_crop_3904817621_0.png treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817626_0.png treat image : temp/1754482228_1186623_1375450753_9d75177a689ade8beea9fadfc1b95202_rle_crop_3904817628_0.png treat image : temp/1754482228_1186623_1375450710_b2bdda35e972288acb14628187c62208_rle_crop_3904817632_0.png treat image : temp/1754482228_1186623_1375450710_b2bdda35e972288acb14628187c62208_rle_crop_3904817633_0.png treat image : temp/1754482228_1186623_1375450710_b2bdda35e972288acb14628187c62208_rle_crop_3904817634_0.png treat image : temp/1754482228_1186623_1375450707_b1d037897cf72315fb9b45e4aa757d30_rle_crop_3904817638_0.png treat image : temp/1754482228_1186623_1375450693_dbad3a144e8f073730b99564e8858f88_rle_crop_3904817639_0.png treat image : temp/1754482228_1186623_1375450690_4bedda13aa8b42ae81565e0f672ac2c4_rle_crop_3904817640_0.png treat image : temp/1754482228_1186623_1375450687_c444ef463c1c749689314c8e4dca2342_rle_crop_3904817641_0.png treat image : temp/1754482228_1186623_1375450687_c444ef463c1c749689314c8e4dca2342_rle_crop_3904817642_0.png treat image : temp/1754482228_1186623_1375450682_d20dca89a4347cecabc76160dec7d9a6_rle_crop_3904817643_0.png treat image : temp/1754482228_1186623_1375450682_d20dca89a4347cecabc76160dec7d9a6_rle_crop_3904817644_0.png treat image : temp/1754482228_1186623_1375450678_fe89f7631441d379f7366bfcc3a726fd_rle_crop_3904817645_0.png treat image : temp/1754482228_1186623_1375450674_d336fa71fc47c6a48a6f1e51cab3c4dd_rle_crop_3904817646_0.png treat image : temp/1754482228_1186623_1375450674_d336fa71fc47c6a48a6f1e51cab3c4dd_rle_crop_3904817647_0.png treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc_rle_crop_3904817648_0.png treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc_rle_crop_3904817650_0.png treat image : temp/1754482228_1186623_1375450505_44c67175968026ad1c0d6ef8ecdbc8cc_rle_crop_3904817651_0.png treat image : temp/1754482228_1186623_1375450487_fe8e46c300705fbe93eac5660ad20fb2_rle_crop_3904817654_0.png treat image : temp/1754482228_1186623_1375450485_3dd7beab53d8887c3924f78214035c01_rle_crop_3904817655_0.png treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653_rle_crop_3904817657_0.png treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653_rle_crop_3904817659_0.png treat image : temp/1754482228_1186623_1375450392_8f05116e7097705c53d7f4dd500a9c3b_rle_crop_3904817661_0.png treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817623_0.png treat image : temp/1754482228_1186623_1375450757_ecbc9b436ee49ca92b5138e9043c771a_rle_crop_3904817627_0.png treat image : temp/1754482228_1186623_1375450753_9d75177a689ade8beea9fadfc1b95202_rle_crop_3904817629_0.png treat image : temp/1754482228_1186623_1375450483_27afbffc27342e6dade8132a55414653_rle_crop_3904817658_0.png treat image : temp/1754482228_1186623_1375450392_8f05116e7097705c53d7f4dd500a9c3b_rle_crop_3904817660_0.png treat image : temp/1754482228_1186623_1375450077_60a49dbd64e3ef7d02ae2140ff6876c6_rle_crop_3904817662_0.png treat image : temp/1754482228_1186623_1375450044_a739f7644f4242495c721d6132e69b63_rle_crop_3904817663_0.png treat image : temp/1754482228_1186623_1375449265_949d3e0cb6880aa3bd354ddb811738dd_rle_crop_3904817664_0.png treat image : temp/1754482228_1186623_1375450717_b8b1cd0db74f914dcd2d194b0583972c_rle_crop_3904817631_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 93 time used for this insertion : 0.016078948974609375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 93 time used for this insertion : 0.019483089447021484 save missing photos in datou_result : time spend for datou_step_exec : 9.120149612426758 time spend to save output : 0.04099249839782715 total time spend for step 7 : 9.161142110824585 step8:velours_tree Wed Aug 6 14:13:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08949089050292969 time spend to save output : 3.6716461181640625e-05 total time spend for step 8 : 0.08952760696411133 step9:send_mail_cod Wed Aug 6 14:13:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25727194_06-08-2025_14_13_18.pdf 25729129 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257291291754482398 25729130 change filename to text .change filename to text .imagette257291301754482399 25729131 imagette257291311754482399 25729132 imagette257291321754482399 25729133 change filename to text .change filename to text .imagette257291331754482399 25729134 change filename to text .imagette257291341754482399 25729135 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257291351754482399 25729136 imagette257291361754482400 25729137 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257291371754482400 25729138 imagette257291381754482401 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25727194 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25729128,25729129,25729130,25729131,25729132,25729133,25729134,25729135,25729136,25729137,25729138?tags=environnement,autre,metal,flou,pehd,carton,pet_fonce,papier,mal_croppe,pet_clair,background args[1375450808] : ((1375450808, -1.8308605760554668, 492688767), (1375450808, 0.680125277737241, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450805] : ((1375450805, -2.666590919706964, 492609224), (1375450805, 0.7307657678979554, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450771] : ((1375450771, -1.0824523364059035, 492688767), (1375450771, 0.3937790328405915, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450768] : ((1375450768, -1.5718022810515264, 492688767), (1375450768, 0.5110943516669658, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450764] : ((1375450764, -2.4715257777327166, 492609224), (1375450764, 0.6028643145892766, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450760] : ((1375450760, -2.8339700134772863, 492609224), (1375450760, 0.6506515796766099, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450757] : ((1375450757, -1.887383484228995, 492688767), (1375450757, 0.5318116087181962, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450753] : ((1375450753, -4.592748238552295, 492609224), (1375450753, 0.2969577338235978, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450722] : ((1375450722, -2.81472235009827, 492609224), (1375450722, 0.658340738932831, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450719] : ((1375450719, -2.6284394805847278, 492609224), (1375450719, 0.5816407076405734, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450717] : ((1375450717, -2.8909980763678735, 492609224), (1375450717, 0.5460345635230004, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450715] : ((1375450715, -2.3604972209111614, 492609224), (1375450715, 0.6073586340506812, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450710] : ((1375450710, -0.9597151183627682, 492688767), (1375450710, 0.42865571177237677, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450707] : ((1375450707, -2.5091414725930448, 492609224), (1375450707, 0.5431367928756341, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450693] : ((1375450693, -2.5274750395334604, 492609224), (1375450693, 0.5465170319518642, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450690] : ((1375450690, -2.144353606646684, 492609224), (1375450690, 0.47508423385786064, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450687] : ((1375450687, -2.2219007689229895, 492609224), (1375450687, 0.7327452560095559, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450682] : ((1375450682, -2.844120414109627, 492609224), (1375450682, 0.6889381620530088, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450678] : ((1375450678, -2.7571594814171787, 492609224), (1375450678, 0.6952379194449331, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450674] : ((1375450674, -1.5349095722164883, 492688767), (1375450674, 0.44146237765723584, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450505] : ((1375450505, -1.8873299664975092, 492688767), (1375450505, 0.5274509706214434, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450487] : ((1375450487, -3.093104945299045, 492609224), (1375450487, 0.5470400238213066, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450485] : ((1375450485, -2.068057547133894, 492609224), (1375450485, 0.6089742959876218, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450483] : ((1375450483, -2.3139699670580063, 492609224), (1375450483, 0.5457840960146058, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450392] : ((1375450392, 11.496936475961943, 492688767), (1375450392, 0.38379345471014203, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450377] : ((1375450377, 9.803559245121738, 492688767), (1375450377, 0.43556172149018374, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450328] : ((1375450328, 9.379359360117558, 492688767), (1375450328, 0.40117796686165214, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450304] : ((1375450304, 10.224172984293757, 492688767), (1375450304, 0.4043900226281992, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450292] : ((1375450292, 10.366112107714567, 492688767), (1375450292, 0.42536702620778044, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450165] : ((1375450165, 10.438435717178312, 492688767), (1375450165, 0.42279598082340986, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450077] : ((1375450077, 10.11439155106836, 492688767), (1375450077, 0.4267669200350677, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375450044] : ((1375450044, 10.27862775629169, 492688767), (1375450044, 0.38609508030570294, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375449744] : ((1375449744, 10.029186031065894, 492688767), (1375449744, 0.46512162147007596, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375449638] : ((1375449638, 10.386477395916986, 492688767), (1375449638, 0.41088281514621067, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com args[1375449265] : ((1375449265, 10.561895386937204, 492688767), (1375449265, 0.4147427743647419, 2107752395), '0.14284234457671954') We are sending mail with results at report@fotonower.com refus_total : 0.14284234457671954 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25727194 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727194_06-08-2025_14_13_18.pdf results_Auto_P25727194_06-08-2025_14_13_18.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727194_06-08-2025_14_13_18.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25727194','results_Auto_P25727194_06-08-2025_14_13_18.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727194_06-08-2025_14_13_18.pdf','pdf','','0.97','0.14284234457671954') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25727194

https://www.fotonower.com/image?json=false&list_photos_id=1375450808
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450805
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450771
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450768
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450764
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450760
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450757
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450753
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450722
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450719
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450717
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450715
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450710
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450707
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450693
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450690
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450687
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450682
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450678
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450674
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450505
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450487
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450485
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450483
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375450392
La photo est trop floue, merci de reprendre une photo.(avec le score = 11.496936475961943)
https://www.fotonower.com/image?json=false&list_photos_id=1375450377
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.803559245121738)
https://www.fotonower.com/image?json=false&list_photos_id=1375450328
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.379359360117558)
https://www.fotonower.com/image?json=false&list_photos_id=1375450304
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.224172984293757)
https://www.fotonower.com/image?json=false&list_photos_id=1375450292
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.366112107714567)
https://www.fotonower.com/image?json=false&list_photos_id=1375450165
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.438435717178312)
https://www.fotonower.com/image?json=false&list_photos_id=1375450077
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.11439155106836)
https://www.fotonower.com/image?json=false&list_photos_id=1375450044
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.27862775629169)
https://www.fotonower.com/image?json=false&list_photos_id=1375449744
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.029186031065894)
https://www.fotonower.com/image?json=false&list_photos_id=1375449638
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.386477395916986)
https://www.fotonower.com/image?json=false&list_photos_id=1375449265
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.561895386937204)

Dans ces conditions,le taux de refus est: 14.28%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/25729129?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25729130?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25729133?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/25729134?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25729135?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25729137?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727194_06-08-2025_14_13_18.pdf.

Lien vers velours :https://www.fotonower.com/velours/25729128,25729129,25729130,25729131,25729132,25729133,25729134,25729135,25729136,25729137,25729138?tags=environnement,autre,metal,flou,pehd,carton,pet_fonce,papier,mal_croppe,pet_clair,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 06 Aug 2025 12:13:24 GMT Content-Length: 0 Connection: close X-Message-Id: JBmg1WAZQ9m95VX5Q0RFsw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375450808, 1375450805, 1375450771, 1375450768, 1375450764, 1375450760, 1375450757, 1375450753, 1375450722, 1375450719, 1375450717, 1375450715, 1375450710, 1375450707, 1375450693, 1375450690, 1375450687, 1375450682, 1375450678, 1375450674, 1375450505, 1375450487, 1375450485, 1375450483, 1375450392, 1375450377, 1375450328, 1375450304, 1375450292, 1375450165, 1375450077, 1375450044, 1375449744, 1375449638, 1375449265] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450808', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450805', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450771', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450768', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450764', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450760', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450757', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450753', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450722', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450719', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450717', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450715', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450710', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450707', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450693', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450690', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450687', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450682', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450678', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450674', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450505', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450487', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450485', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450483', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450392', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450377', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450328', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450304', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450292', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450165', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450077', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450044', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449744', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449638', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449265', None, None, None, None, None, '3460108') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 35 time used for this insertion : 0.017782926559448242 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.991215705871582 time spend to save output : 0.01812601089477539 total time spend for step 9 : 6.009341716766357 step10:split_time_score Wed Aug 6 14:13:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 35),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06082025 25727194 Nombre de photos uploadées : 35 / 23040 (0%) 06082025 25727194 Nombre de photos taguées (types de déchets): 0 / 35 (0%) 06082025 25727194 Nombre de photos taguées (volume) : 0 / 35 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ??????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0016243457794189453 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20047688484191895 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.11844979745370371 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25716934_06-08-2025_08_42_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25716934 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25716934 AND mptpi.`type`=3594 To do Qualite : 0.05851508601125635 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25717830_06-08-2025_09_22_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25717830 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25717830 AND mptpi.`type`=3594 To do Qualite : 0.1097653653252612 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727185_06-08-2025_13_48_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727185 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727185 AND mptpi.`type`=3594 To do Qualite : 0.037152867083904896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727189_06-08-2025_14_07_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727189 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727189 AND mptpi.`type`=3594 To do Qualite : 0.2675555332977209 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727191_06-08-2025_14_12_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727191 AND mptpi.`type`=3594 To do Qualite : 0.14284234457671954 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727194_06-08-2025_14_13_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727194 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727194 AND mptpi.`type`=3594 To do Qualite : 0.12946329615600452 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727196_06-08-2025_14_01_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727196 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727196 AND mptpi.`type`=3594 To do Qualite : 0.24456746720679012 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727198_06-08-2025_13_51_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727198 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727198 AND mptpi.`type`=3594 To do Qualite : 0.12766646499719417 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727203_06-08-2025_13_41_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727203 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727203 AND mptpi.`type`=3594 To do Qualite : 0.11182745341792408 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727206_06-08-2025_13_33_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727206 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727206 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06082025': {'nb_upload': 35, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375450808, 1375450805, 1375450771, 1375450768, 1375450764, 1375450760, 1375450757, 1375450753, 1375450722, 1375450719, 1375450717, 1375450715, 1375450710, 1375450707, 1375450693, 1375450690, 1375450687, 1375450682, 1375450678, 1375450674, 1375450505, 1375450487, 1375450485, 1375450483, 1375450392, 1375450377, 1375450328, 1375450304, 1375450292, 1375450165, 1375450077, 1375450044, 1375449744, 1375449638, 1375449265] Looping around the photos to save general results len do output : 1 /25727194Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450808', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450805', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450771', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450768', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450764', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450760', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450757', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450753', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450722', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450719', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450717', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450715', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450710', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450707', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450693', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450690', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450687', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450682', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450678', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450674', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450505', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450487', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450485', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450483', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450392', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450377', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450328', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450304', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450292', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450165', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450077', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375450044', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449744', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449638', None, None, None, None, None, '3460108') ('3318', None, None, None, None, None, None, None, '3460108') ('3318', '25727194', '1375449265', None, None, None, None, None, '3460108') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.019752025604248047 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.9532878398895264 time spend to save output : 0.020109176635742188 total time spend for step 10 : 0.9733970165252686 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 35 set_done_treatment 120.42user 39.73system 3:01.55elapsed 88%CPU (0avgtext+0avgdata 3286276maxresident)k 68472inputs+73776outputs (5720major+2671217minor)pagefaults 0swaps