python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 987158 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2957324'] with mtr_portfolio_ids : ['23351468'] and first list_photo_ids : [] new path : /proc/987158/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.5971698760986328 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 18:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3244 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 18:50:33.599388: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 18:50:33.627153: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 18:50:33.629377: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0128000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 18:50:33.629437: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 18:50:33.633288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 18:50:33.771635: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1f7b26f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 18:50:33.771688: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 18:50:33.772829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 18:50:33.773232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 18:50:33.776424: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 18:50:33.779519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 18:50:33.779915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 18:50:33.782266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 18:50:33.783383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 18:50:33.787989: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 18:50:33.789098: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 18:50:33.789173: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 18:50:33.789761: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 18:50:33.789779: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 18:50:33.789788: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 18:50:33.790771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2792 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-26 18:50:34.066415: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 18:50:34.066520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 18:50:34.066552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 18:50:34.066581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 18:50:34.066609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 18:50:34.066636: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 18:50:34.066663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 18:50:34.066691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 18:50:34.068101: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 18:50:34.069094: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 18:50:34.069128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 18:50:34.069147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 18:50:34.069164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 18:50:34.069181: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 18:50:34.069198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 18:50:34.069215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 18:50:34.069232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 18:50:34.070256: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 18:50:34.070287: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 18:50:34.070297: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 18:50:34.070307: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 18:50:34.071408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2792 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-26 18:50:46.299701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 18:50:46.477768: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 18:50:47.689399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.689455: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.690082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.690098: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.697130: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.697150: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.697734: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.697749: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.704319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.704342: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.704965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.704980: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.735990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.736030: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.736656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.736671: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.742520: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.742541: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.743192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.743210: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-26 18:50:47.776931: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.777527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.779485: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.780116: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.823840: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.824431: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.826698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.827291: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.857403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.857990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.859720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.860303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.866442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.867071: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.868841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.869428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.875230: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.875820: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.877400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.877986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.904545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.905137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.905721: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.906304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.909832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.910420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.925823: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.926413: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.927029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.927617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.940009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.940599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.941232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.941853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.946219: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.946812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.951538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.952198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.964633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.965242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.969454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.970086: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.970719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.971378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.972156: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.972788: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.983433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.984050: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.984647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.985230: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.985811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:47.986399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.001369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.001954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.029478: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.029526: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-26 18:50:48.030614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.031750: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.038801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.039442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.047391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.047979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.068463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.069258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.070042: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.070810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.075154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.075932: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.076533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.077112: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.078024: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.088399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.089028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.098080: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.098672: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.099317: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.099947: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.100552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-26 18:50:48.101138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.23G (2392719360 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 Detection mask done ! Trying to reset tf kernel 987866 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4635 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5675 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0014600753784179688 nb_pixel_total : 38177 time to create 1 rle with old method : 0.04709649085998535 length of segment : 255 time for calcul the mask position with numpy : 0.0011355876922607422 nb_pixel_total : 36199 time to create 1 rle with old method : 0.04307246208190918 length of segment : 350 time for calcul the mask position with numpy : 0.006329536437988281 nb_pixel_total : 137061 time to create 1 rle with old method : 0.15942096710205078 length of segment : 889 time for calcul the mask position with numpy : 0.000431060791015625 nb_pixel_total : 17061 time to create 1 rle with old method : 0.020709991455078125 length of segment : 167 time for calcul the mask position with numpy : 0.001466989517211914 nb_pixel_total : 52057 time to create 1 rle with old method : 0.07211422920227051 length of segment : 446 time for calcul the mask position with numpy : 0.0004165172576904297 nb_pixel_total : 20465 time to create 1 rle with old method : 0.024913311004638672 length of segment : 163 time for calcul the mask position with numpy : 0.0018203258514404297 nb_pixel_total : 84963 time to create 1 rle with old method : 0.10720133781433105 length of segment : 475 time for calcul the mask position with numpy : 0.0006022453308105469 nb_pixel_total : 15614 time to create 1 rle with old method : 0.019556283950805664 length of segment : 339 time for calcul the mask position with numpy : 0.0013725757598876953 nb_pixel_total : 49345 time to create 1 rle with old method : 0.05853438377380371 length of segment : 383 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 27910 time to create 1 rle with old method : 0.03790426254272461 length of segment : 222 time for calcul the mask position with numpy : 0.5045995712280273 nb_pixel_total : 462653 time to create 1 rle with new method : 0.06308770179748535 length of segment : 1220 time for calcul the mask position with numpy : 0.0006952285766601562 nb_pixel_total : 14014 time to create 1 rle with old method : 0.017035245895385742 length of segment : 140 time for calcul the mask position with numpy : 0.0005631446838378906 nb_pixel_total : 10888 time to create 1 rle with old method : 0.013650894165039062 length of segment : 135 time for calcul the mask position with numpy : 0.0004911422729492188 nb_pixel_total : 9870 time to create 1 rle with old method : 0.012338399887084961 length of segment : 103 time for calcul the mask position with numpy : 0.0010175704956054688 nb_pixel_total : 22262 time to create 1 rle with old method : 0.02688908576965332 length of segment : 258 time for calcul the mask position with numpy : 0.012280702590942383 nb_pixel_total : 680079 time to create 1 rle with new method : 0.07115435600280762 length of segment : 1342 time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 29202 time to create 1 rle with old method : 0.03579258918762207 length of segment : 172 time for calcul the mask position with numpy : 0.0008437633514404297 nb_pixel_total : 26886 time to create 1 rle with old method : 0.048157691955566406 length of segment : 248 time for calcul the mask position with numpy : 0.0004360675811767578 nb_pixel_total : 11563 time to create 1 rle with old method : 0.019124984741210938 length of segment : 162 time for calcul the mask position with numpy : 0.0008268356323242188 nb_pixel_total : 19071 time to create 1 rle with old method : 0.02346038818359375 length of segment : 168 time for calcul the mask position with numpy : 0.0013611316680908203 nb_pixel_total : 49289 time to create 1 rle with old method : 0.06168866157531738 length of segment : 304 time for calcul the mask position with numpy : 0.0005300045013427734 nb_pixel_total : 7921 time to create 1 rle with old method : 0.01045680046081543 length of segment : 85 time for calcul the mask position with numpy : 0.001001596450805664 nb_pixel_total : 23995 time to create 1 rle with old method : 0.034311532974243164 length of segment : 231 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 9355 time to create 1 rle with old method : 0.015383005142211914 length of segment : 137 time for calcul the mask position with numpy : 0.0013496875762939453 nb_pixel_total : 21971 time to create 1 rle with old method : 0.0387568473815918 length of segment : 206 time for calcul the mask position with numpy : 0.0016145706176757812 nb_pixel_total : 57160 time to create 1 rle with old method : 0.07080745697021484 length of segment : 400 time for calcul the mask position with numpy : 0.001100778579711914 nb_pixel_total : 51768 time to create 1 rle with old method : 0.06166434288024902 length of segment : 341 time for calcul the mask position with numpy : 0.0010025501251220703 nb_pixel_total : 45097 time to create 1 rle with old method : 0.05382800102233887 length of segment : 282 time for calcul the mask position with numpy : 0.005760908126831055 nb_pixel_total : 21522 time to create 1 rle with old method : 0.026277542114257812 length of segment : 160 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 7575 time to create 1 rle with old method : 0.00929570198059082 length of segment : 146 time for calcul the mask position with numpy : 0.0021505355834960938 nb_pixel_total : 100730 time to create 1 rle with old method : 0.12369346618652344 length of segment : 322 time for calcul the mask position with numpy : 0.00110626220703125 nb_pixel_total : 52150 time to create 1 rle with old method : 0.06173586845397949 length of segment : 242 time for calcul the mask position with numpy : 0.0015354156494140625 nb_pixel_total : 77121 time to create 1 rle with old method : 0.09214448928833008 length of segment : 389 time for calcul the mask position with numpy : 0.0012919902801513672 nb_pixel_total : 40284 time to create 1 rle with old method : 0.0497279167175293 length of segment : 204 time for calcul the mask position with numpy : 0.001497507095336914 nb_pixel_total : 39658 time to create 1 rle with old method : 0.047319650650024414 length of segment : 254 time for calcul the mask position with numpy : 0.0015375614166259766 nb_pixel_total : 30693 time to create 1 rle with old method : 0.03940272331237793 length of segment : 310 time for calcul the mask position with numpy : 0.0022559165954589844 nb_pixel_total : 51065 time to create 1 rle with old method : 0.07917118072509766 length of segment : 526 time for calcul the mask position with numpy : 0.0010318756103515625 nb_pixel_total : 34639 time to create 1 rle with old method : 0.04121756553649902 length of segment : 201 time for calcul the mask position with numpy : 0.0014929771423339844 nb_pixel_total : 36168 time to create 1 rle with old method : 0.04310011863708496 length of segment : 347 time for calcul the mask position with numpy : 0.0006029605865478516 nb_pixel_total : 25680 time to create 1 rle with old method : 0.031032085418701172 length of segment : 226 time for calcul the mask position with numpy : 0.002401590347290039 nb_pixel_total : 120735 time to create 1 rle with old method : 0.1409621238708496 length of segment : 555 time for calcul the mask position with numpy : 0.003945112228393555 nb_pixel_total : 243929 time to create 1 rle with new method : 0.012522220611572266 length of segment : 503 time for calcul the mask position with numpy : 0.0014543533325195312 nb_pixel_total : 71441 time to create 1 rle with old method : 0.08870148658752441 length of segment : 410 time for calcul the mask position with numpy : 0.0002567768096923828 nb_pixel_total : 7852 time to create 1 rle with old method : 0.009427309036254883 length of segment : 102 time for calcul the mask position with numpy : 0.00021314620971679688 nb_pixel_total : 8954 time to create 1 rle with old method : 0.010970115661621094 length of segment : 111 time for calcul the mask position with numpy : 0.0008673667907714844 nb_pixel_total : 49398 time to create 1 rle with old method : 0.0583951473236084 length of segment : 286 time for calcul the mask position with numpy : 0.001085042953491211 nb_pixel_total : 23950 time to create 1 rle with old method : 0.028544187545776367 length of segment : 256 time for calcul the mask position with numpy : 0.0010161399841308594 nb_pixel_total : 23971 time to create 1 rle with old method : 0.02884531021118164 length of segment : 144 time for calcul the mask position with numpy : 0.0019741058349609375 nb_pixel_total : 51496 time to create 1 rle with old method : 0.0604090690612793 length of segment : 272 time for calcul the mask position with numpy : 0.006654500961303711 nb_pixel_total : 194883 time to create 1 rle with new method : 0.014772653579711914 length of segment : 756 time for calcul the mask position with numpy : 0.0020987987518310547 nb_pixel_total : 50610 time to create 1 rle with old method : 0.06356000900268555 length of segment : 302 time for calcul the mask position with numpy : 0.0029222965240478516 nb_pixel_total : 77672 time to create 1 rle with old method : 0.09850621223449707 length of segment : 327 time for calcul the mask position with numpy : 0.002849102020263672 nb_pixel_total : 131406 time to create 1 rle with old method : 0.15253114700317383 length of segment : 524 time for calcul the mask position with numpy : 0.0005385875701904297 nb_pixel_total : 8435 time to create 1 rle with old method : 0.014466524124145508 length of segment : 74 time for calcul the mask position with numpy : 0.0018703937530517578 nb_pixel_total : 38202 time to create 1 rle with old method : 0.058760881423950195 length of segment : 243 time for calcul the mask position with numpy : 0.000396728515625 nb_pixel_total : 12427 time to create 1 rle with old method : 0.01544952392578125 length of segment : 130 time for calcul the mask position with numpy : 0.0008137226104736328 nb_pixel_total : 11979 time to create 1 rle with old method : 0.015146255493164062 length of segment : 114 time for calcul the mask position with numpy : 0.004754781723022461 nb_pixel_total : 135519 time to create 1 rle with old method : 0.18074250221252441 length of segment : 597 time for calcul the mask position with numpy : 0.001271963119506836 nb_pixel_total : 15910 time to create 1 rle with old method : 0.02978992462158203 length of segment : 149 time for calcul the mask position with numpy : 0.003502368927001953 nb_pixel_total : 67534 time to create 1 rle with old method : 0.09358763694763184 length of segment : 430 time for calcul the mask position with numpy : 0.0009982585906982422 nb_pixel_total : 16950 time to create 1 rle with old method : 0.02036571502685547 length of segment : 233 time for calcul the mask position with numpy : 0.005865812301635742 nb_pixel_total : 125738 time to create 1 rle with old method : 0.14939165115356445 length of segment : 492 time for calcul the mask position with numpy : 0.00862264633178711 nb_pixel_total : 181920 time to create 1 rle with new method : 0.012936115264892578 length of segment : 701 time for calcul the mask position with numpy : 0.0017521381378173828 nb_pixel_total : 44714 time to create 1 rle with old method : 0.05262398719787598 length of segment : 250 time for calcul the mask position with numpy : 0.0013804435729980469 nb_pixel_total : 28993 time to create 1 rle with old method : 0.04874396324157715 length of segment : 229 time for calcul the mask position with numpy : 0.0009715557098388672 nb_pixel_total : 16856 time to create 1 rle with old method : 0.02017354965209961 length of segment : 151 time for calcul the mask position with numpy : 0.0035276412963867188 nb_pixel_total : 94643 time to create 1 rle with old method : 0.1119692325592041 length of segment : 297 time for calcul the mask position with numpy : 0.00032782554626464844 nb_pixel_total : 10786 time to create 1 rle with old method : 0.013014793395996094 length of segment : 164 time for calcul the mask position with numpy : 0.0010416507720947266 nb_pixel_total : 24571 time to create 1 rle with old method : 0.029666662216186523 length of segment : 201 time for calcul the mask position with numpy : 0.001262664794921875 nb_pixel_total : 44623 time to create 1 rle with old method : 0.053362369537353516 length of segment : 306 time for calcul the mask position with numpy : 0.002701997756958008 nb_pixel_total : 43672 time to create 1 rle with old method : 0.05319380760192871 length of segment : 393 time for calcul the mask position with numpy : 0.0014579296112060547 nb_pixel_total : 33264 time to create 1 rle with old method : 0.03963828086853027 length of segment : 208 time for calcul the mask position with numpy : 0.0017478466033935547 nb_pixel_total : 51098 time to create 1 rle with old method : 0.06132674217224121 length of segment : 328 time for calcul the mask position with numpy : 0.0020847320556640625 nb_pixel_total : 38210 time to create 1 rle with old method : 0.04573965072631836 length of segment : 285 time for calcul the mask position with numpy : 0.00869894027709961 nb_pixel_total : 129839 time to create 1 rle with old method : 0.15369176864624023 length of segment : 584 time for calcul the mask position with numpy : 0.0024404525756835938 nb_pixel_total : 49142 time to create 1 rle with old method : 0.05876326560974121 length of segment : 264 time for calcul the mask position with numpy : 0.0016748905181884766 nb_pixel_total : 21895 time to create 1 rle with old method : 0.026304960250854492 length of segment : 174 time for calcul the mask position with numpy : 0.0007243156433105469 nb_pixel_total : 11002 time to create 1 rle with old method : 0.013850212097167969 length of segment : 96 time for calcul the mask position with numpy : 0.0021257400512695312 nb_pixel_total : 39840 time to create 1 rle with old method : 0.04790353775024414 length of segment : 289 time for calcul the mask position with numpy : 0.0007276535034179688 nb_pixel_total : 15130 time to create 1 rle with old method : 0.01824474334716797 length of segment : 153 time for calcul the mask position with numpy : 0.003631114959716797 nb_pixel_total : 60150 time to create 1 rle with old method : 0.07161092758178711 length of segment : 331 time for calcul the mask position with numpy : 0.0007193088531494141 nb_pixel_total : 14496 time to create 1 rle with old method : 0.017832040786743164 length of segment : 107 time for calcul the mask position with numpy : 0.0007183551788330078 nb_pixel_total : 16039 time to create 1 rle with old method : 0.01989293098449707 length of segment : 143 time for calcul the mask position with numpy : 0.0052258968353271484 nb_pixel_total : 90855 time to create 1 rle with old method : 0.10968279838562012 length of segment : 444 time for calcul the mask position with numpy : 0.0008652210235595703 nb_pixel_total : 17031 time to create 1 rle with old method : 0.020444154739379883 length of segment : 119 time for calcul the mask position with numpy : 0.005156993865966797 nb_pixel_total : 153654 time to create 1 rle with new method : 0.010322332382202148 length of segment : 412 time for calcul the mask position with numpy : 0.0044574737548828125 nb_pixel_total : 124207 time to create 1 rle with old method : 0.14882302284240723 length of segment : 392 time for calcul the mask position with numpy : 0.004163503646850586 nb_pixel_total : 153983 time to create 1 rle with new method : 0.00587916374206543 length of segment : 298 time for calcul the mask position with numpy : 0.003040790557861328 nb_pixel_total : 53311 time to create 1 rle with old method : 0.06272006034851074 length of segment : 372 time for calcul the mask position with numpy : 0.0010309219360351562 nb_pixel_total : 26820 time to create 1 rle with old method : 0.031434059143066406 length of segment : 275 time for calcul the mask position with numpy : 0.001220703125 nb_pixel_total : 50515 time to create 1 rle with old method : 0.062003374099731445 length of segment : 285 time for calcul the mask position with numpy : 0.0015361309051513672 nb_pixel_total : 48438 time to create 1 rle with old method : 0.05964040756225586 length of segment : 310 time for calcul the mask position with numpy : 0.0011386871337890625 nb_pixel_total : 50520 time to create 1 rle with old method : 0.0631871223449707 length of segment : 309 time for calcul the mask position with numpy : 0.0011301040649414062 nb_pixel_total : 32112 time to create 1 rle with old method : 0.038054704666137695 length of segment : 238 time for calcul the mask position with numpy : 0.004943132400512695 nb_pixel_total : 124858 time to create 1 rle with old method : 0.16127943992614746 length of segment : 434 time for calcul the mask position with numpy : 0.0013408660888671875 nb_pixel_total : 28614 time to create 1 rle with old method : 0.03722715377807617 length of segment : 249 time for calcul the mask position with numpy : 0.0006997585296630859 nb_pixel_total : 14821 time to create 1 rle with old method : 0.018215179443359375 length of segment : 137 time for calcul the mask position with numpy : 0.012313127517700195 nb_pixel_total : 393327 time to create 1 rle with new method : 0.03811979293823242 length of segment : 813 time for calcul the mask position with numpy : 0.004828214645385742 nb_pixel_total : 136622 time to create 1 rle with old method : 0.16548705101013184 length of segment : 329 time for calcul the mask position with numpy : 0.0019443035125732422 nb_pixel_total : 123911 time to create 1 rle with old method : 0.17041563987731934 length of segment : 353 time for calcul the mask position with numpy : 0.0009436607360839844 nb_pixel_total : 32297 time to create 1 rle with old method : 0.03834986686706543 length of segment : 154 time for calcul the mask position with numpy : 0.002898693084716797 nb_pixel_total : 127209 time to create 1 rle with old method : 0.1468350887298584 length of segment : 462 time for calcul the mask position with numpy : 0.002729654312133789 nb_pixel_total : 58792 time to create 1 rle with old method : 0.06986570358276367 length of segment : 316 time for calcul the mask position with numpy : 0.002522706985473633 nb_pixel_total : 65605 time to create 1 rle with old method : 0.07610034942626953 length of segment : 338 time for calcul the mask position with numpy : 0.0032961368560791016 nb_pixel_total : 95232 time to create 1 rle with old method : 0.11256098747253418 length of segment : 485 time for calcul the mask position with numpy : 0.003526449203491211 nb_pixel_total : 110234 time to create 1 rle with old method : 0.1369321346282959 length of segment : 289 time for calcul the mask position with numpy : 0.002993345260620117 nb_pixel_total : 96432 time to create 1 rle with old method : 0.1127004623413086 length of segment : 426 time for calcul the mask position with numpy : 0.002727031707763672 nb_pixel_total : 68470 time to create 1 rle with old method : 0.0818331241607666 length of segment : 293 time for calcul the mask position with numpy : 0.0016932487487792969 nb_pixel_total : 46392 time to create 1 rle with old method : 0.05692434310913086 length of segment : 272 time for calcul the mask position with numpy : 0.003991127014160156 nb_pixel_total : 110984 time to create 1 rle with old method : 0.13787293434143066 length of segment : 406 time for calcul the mask position with numpy : 0.0018894672393798828 nb_pixel_total : 49857 time to create 1 rle with old method : 0.05929207801818848 length of segment : 290 time for calcul the mask position with numpy : 0.0036420822143554688 nb_pixel_total : 66459 time to create 1 rle with old method : 0.0775461196899414 length of segment : 498 time for calcul the mask position with numpy : 0.0007138252258300781 nb_pixel_total : 18109 time to create 1 rle with old method : 0.021288633346557617 length of segment : 167 time for calcul the mask position with numpy : 0.0029611587524414062 nb_pixel_total : 77818 time to create 1 rle with old method : 0.09442400932312012 length of segment : 331 time for calcul the mask position with numpy : 0.002094745635986328 nb_pixel_total : 54555 time to create 1 rle with old method : 0.07986927032470703 length of segment : 296 time for calcul the mask position with numpy : 0.0022628307342529297 nb_pixel_total : 40731 time to create 1 rle with old method : 0.05737018585205078 length of segment : 325 time for calcul the mask position with numpy : 0.0054204463958740234 nb_pixel_total : 51100 time to create 1 rle with old method : 0.0629417896270752 length of segment : 463 time for calcul the mask position with numpy : 0.0013196468353271484 nb_pixel_total : 40593 time to create 1 rle with old method : 0.06204938888549805 length of segment : 317 time for calcul the mask position with numpy : 0.0008494853973388672 nb_pixel_total : 24308 time to create 1 rle with old method : 0.029024362564086914 length of segment : 143 time for calcul the mask position with numpy : 0.0005078315734863281 nb_pixel_total : 16096 time to create 1 rle with old method : 0.019873619079589844 length of segment : 101 time for calcul the mask position with numpy : 0.003951549530029297 nb_pixel_total : 112995 time to create 1 rle with old method : 0.131087064743042 length of segment : 666 time spent for convertir_results : 14.71721863746643 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 121 chid ids of type : 3594 Number RLEs to save : 38421 save missing photos in datou_result : time spend for datou_step_exec : 97.24875903129578 time spend to save output : 2.2771384716033936 total time spend for step 1 : 99.52589750289917 step2:crop_condition Mon May 26 18:52:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 121 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3736932 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748278350_987158 we have uploaded 51 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.970771551132202 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748278371_987158 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.7849783897399902 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748278378_987158 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.647508382797241 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748278395_987158 we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.726836681365967 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748278406_987158 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6347272396087646 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748278410_987158 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9831852912902832 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361115333, 1361115322, 1361115317, 1361115311, 1361115297, 1361115293, 1361115291, 1361115289, 1361115287, 1361115283] Looping around the photos to save general results len do output : 121 /1361135631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361135894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115333', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115322', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115317', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115311', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115297', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115293', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115291', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115289', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115287', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115283', None, None, None, None, None, '2957324') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 373 time used for this insertion : 0.028553485870361328 save_final save missing photos in datou_result : time spend for datou_step_exec : 80.85270237922668 time spend to save output : 0.03526020050048828 total time spend for step 2 : 80.88796257972717 step3:rle_unique_nms_with_priority Mon May 26 18:53:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 121 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 10.82581377029419 time for calcul the mask position with numpy : 0.921457052230835 nb_pixel_total : 7321884 time to create 1 rle with new method : 0.9750974178314209 time for calcul the mask position with numpy : 0.04027605056762695 nb_pixel_total : 22262 time to create 1 rle with old method : 0.025127887725830078 time for calcul the mask position with numpy : 0.04082942008972168 nb_pixel_total : 9870 time to create 1 rle with old method : 0.011303186416625977 time for calcul the mask position with numpy : 0.04034924507141113 nb_pixel_total : 10888 time to create 1 rle with old method : 0.012815713882446289 time for calcul the mask position with numpy : 0.040879011154174805 nb_pixel_total : 14014 time to create 1 rle with old method : 0.016301870346069336 time for calcul the mask position with numpy : 0.04545879364013672 nb_pixel_total : 462653 time to create 1 rle with new method : 1.0074748992919922 time for calcul the mask position with numpy : 0.03932619094848633 nb_pixel_total : 1888 time to create 1 rle with old method : 0.002321004867553711 time for calcul the mask position with numpy : 0.03946638107299805 nb_pixel_total : 49345 time to create 1 rle with old method : 0.05873274803161621 time for calcul the mask position with numpy : 0.040383338928222656 nb_pixel_total : 15613 time to create 1 rle with old method : 0.01708245277404785 time for calcul the mask position with numpy : 0.040409088134765625 nb_pixel_total : 84963 time to create 1 rle with old method : 0.10079717636108398 time for calcul the mask position with numpy : 0.04276633262634277 nb_pixel_total : 20465 time to create 1 rle with old method : 0.024222612380981445 time for calcul the mask position with numpy : 0.04138517379760742 nb_pixel_total : 52057 time to create 1 rle with old method : 0.060063838958740234 time for calcul the mask position with numpy : 0.043445587158203125 nb_pixel_total : 17061 time to create 1 rle with old method : 0.020679712295532227 time for calcul the mask position with numpy : 0.042496681213378906 nb_pixel_total : 137061 time to create 1 rle with old method : 0.16108918190002441 time for calcul the mask position with numpy : 0.0401463508605957 nb_pixel_total : 36199 time to create 1 rle with old method : 0.0423891544342041 time for calcul the mask position with numpy : 0.03745698928833008 nb_pixel_total : 38177 time to create 1 rle with old method : 0.04420280456542969 create new chi : 4.180011987686157 time to delete rle : 0.02086353302001953 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 12973 TO DO : save crop sub photo not yet done ! save time : 0.8550574779510498 nb_obj : 18 nb_hashtags : 5 time to prepare the origin masks : 13.322480201721191 time for calcul the mask position with numpy : 1.4254858493804932 nb_pixel_total : 7008205 time to create 1 rle with new method : 1.8938357830047607 time for calcul the mask position with numpy : 0.04836678504943848 nb_pixel_total : 77121 time to create 1 rle with old method : 0.08929133415222168 time for calcul the mask position with numpy : 0.04539608955383301 nb_pixel_total : 52150 time to create 1 rle with old method : 0.06006312370300293 time for calcul the mask position with numpy : 0.046527862548828125 nb_pixel_total : 100730 time to create 1 rle with old method : 0.1165168285369873 time for calcul the mask position with numpy : 0.040831804275512695 nb_pixel_total : 7575 time to create 1 rle with old method : 0.008865594863891602 time for calcul the mask position with numpy : 0.04234766960144043 nb_pixel_total : 21522 time to create 1 rle with old method : 0.024831533432006836 time for calcul the mask position with numpy : 0.04166007041931152 nb_pixel_total : 45095 time to create 1 rle with old method : 0.05497598648071289 time for calcul the mask position with numpy : 0.043801307678222656 nb_pixel_total : 51768 time to create 1 rle with old method : 0.0606234073638916 time for calcul the mask position with numpy : 0.04188394546508789 nb_pixel_total : 57160 time to create 1 rle with old method : 0.0663447380065918 time for calcul the mask position with numpy : 0.04235982894897461 nb_pixel_total : 21971 time to create 1 rle with old method : 0.02587890625 time for calcul the mask position with numpy : 0.04295754432678223 nb_pixel_total : 9355 time to create 1 rle with old method : 0.011073112487792969 time for calcul the mask position with numpy : 0.04220414161682129 nb_pixel_total : 23995 time to create 1 rle with old method : 0.028326034545898438 time for calcul the mask position with numpy : 0.04181361198425293 nb_pixel_total : 7921 time to create 1 rle with old method : 0.009303092956542969 time for calcul the mask position with numpy : 0.02726435661315918 nb_pixel_total : 49289 time to create 1 rle with old method : 0.05963587760925293 time for calcul the mask position with numpy : 0.027339696884155273 nb_pixel_total : 19071 time to create 1 rle with old method : 0.022737979888916016 time for calcul the mask position with numpy : 0.02783203125 nb_pixel_total : 5305 time to create 1 rle with old method : 0.006201267242431641 time for calcul the mask position with numpy : 0.02654266357421875 nb_pixel_total : 26886 time to create 1 rle with old method : 0.03141140937805176 time for calcul the mask position with numpy : 0.025778532028198242 nb_pixel_total : 29202 time to create 1 rle with old method : 0.03422832489013672 time for calcul the mask position with numpy : 0.03325486183166504 nb_pixel_total : 680079 time to create 1 rle with new method : 1.0199193954467773 create new chi : 5.824174880981445 time to delete rle : 0.003324270248413086 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 12671 TO DO : save crop sub photo not yet done ! save time : 0.8564956188201904 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 4.913001298904419 time for calcul the mask position with numpy : 1.080873966217041 nb_pixel_total : 8061893 time to create 1 rle with new method : 1.176464319229126 time for calcul the mask position with numpy : 0.039134979248046875 nb_pixel_total : 36168 time to create 1 rle with old method : 0.0414586067199707 time for calcul the mask position with numpy : 0.04043102264404297 nb_pixel_total : 34639 time to create 1 rle with old method : 0.04084205627441406 time for calcul the mask position with numpy : 0.02713632583618164 nb_pixel_total : 51065 time to create 1 rle with old method : 0.061324119567871094 time for calcul the mask position with numpy : 0.026332855224609375 nb_pixel_total : 30693 time to create 1 rle with old method : 0.03718256950378418 time for calcul the mask position with numpy : 0.027916431427001953 nb_pixel_total : 39658 time to create 1 rle with old method : 0.04657387733459473 time for calcul the mask position with numpy : 0.027848243713378906 nb_pixel_total : 40284 time to create 1 rle with old method : 0.0470128059387207 create new chi : 2.7659943103790283 time to delete rle : 0.00115203857421875 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 5844 TO DO : save crop sub photo not yet done ! save time : 0.45355820655822754 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 5.561328649520874 time for calcul the mask position with numpy : 0.8889985084533691 nb_pixel_total : 7742461 time to create 1 rle with new method : 1.3145904541015625 time for calcul the mask position with numpy : 0.027216196060180664 nb_pixel_total : 23950 time to create 1 rle with old method : 0.028057336807250977 time for calcul the mask position with numpy : 0.02980494499206543 nb_pixel_total : 49398 time to create 1 rle with old method : 0.05804324150085449 time for calcul the mask position with numpy : 0.029647111892700195 nb_pixel_total : 8954 time to create 1 rle with old method : 0.011260747909545898 time for calcul the mask position with numpy : 0.02858424186706543 nb_pixel_total : 7852 time to create 1 rle with old method : 0.010535717010498047 time for calcul the mask position with numpy : 0.03046441078186035 nb_pixel_total : 71441 time to create 1 rle with old method : 0.08252811431884766 time for calcul the mask position with numpy : 0.027107954025268555 nb_pixel_total : 243929 time to create 1 rle with new method : 1.0670208930969238 time for calcul the mask position with numpy : 0.030027151107788086 nb_pixel_total : 120735 time to create 1 rle with old method : 0.1479809284210205 time for calcul the mask position with numpy : 0.0462489128112793 nb_pixel_total : 25680 time to create 1 rle with old method : 0.030351638793945312 create new chi : 3.980558395385742 time to delete rle : 0.0011925697326660156 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7058 TO DO : save crop sub photo not yet done ! save time : 0.4873528480529785 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 8.359290361404419 time for calcul the mask position with numpy : 0.9003922939300537 nb_pixel_total : 7599079 time to create 1 rle with new method : 1.1272506713867188 time for calcul the mask position with numpy : 0.03861737251281738 nb_pixel_total : 67534 time to create 1 rle with old method : 0.07544755935668945 time for calcul the mask position with numpy : 0.03980541229248047 nb_pixel_total : 15910 time to create 1 rle with old method : 0.017755508422851562 time for calcul the mask position with numpy : 0.040667057037353516 nb_pixel_total : 135519 time to create 1 rle with old method : 0.15649747848510742 time for calcul the mask position with numpy : 0.03829026222229004 nb_pixel_total : 11979 time to create 1 rle with old method : 0.013377904891967773 time for calcul the mask position with numpy : 0.03927946090698242 nb_pixel_total : 12427 time to create 1 rle with old method : 0.01397085189819336 time for calcul the mask position with numpy : 0.039566755294799805 nb_pixel_total : 38202 time to create 1 rle with old method : 0.04292750358581543 time for calcul the mask position with numpy : 0.03963160514831543 nb_pixel_total : 8435 time to create 1 rle with old method : 0.009559154510498047 time for calcul the mask position with numpy : 0.02396559715270996 nb_pixel_total : 6683 time to create 1 rle with old method : 0.009278059005737305 time for calcul the mask position with numpy : 0.024728059768676758 nb_pixel_total : 77672 time to create 1 rle with old method : 0.09574198722839355 time for calcul the mask position with numpy : 0.02364969253540039 nb_pixel_total : 50610 time to create 1 rle with old method : 0.05567026138305664 time for calcul the mask position with numpy : 0.025332212448120117 nb_pixel_total : 194883 time to create 1 rle with new method : 0.9863648414611816 time for calcul the mask position with numpy : 0.023494482040405273 nb_pixel_total : 51496 time to create 1 rle with old method : 0.05621170997619629 time for calcul the mask position with numpy : 0.025302410125732422 nb_pixel_total : 23971 time to create 1 rle with old method : 0.027007579803466797 create new chi : 4.080471038818359 time to delete rle : 0.00240325927734375 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9748 TO DO : save crop sub photo not yet done ! save time : 0.6518735885620117 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 9.637254476547241 time for calcul the mask position with numpy : 0.7683384418487549 nb_pixel_total : 7588171 time to create 1 rle with new method : 0.7078094482421875 time for calcul the mask position with numpy : 0.035964250564575195 nb_pixel_total : 51098 time to create 1 rle with old method : 0.05970358848571777 time for calcul the mask position with numpy : 0.024562358856201172 nb_pixel_total : 33264 time to create 1 rle with old method : 0.03838682174682617 time for calcul the mask position with numpy : 0.027564048767089844 nb_pixel_total : 43672 time to create 1 rle with old method : 0.07095098495483398 time for calcul the mask position with numpy : 0.0263671875 nb_pixel_total : 43006 time to create 1 rle with old method : 0.05228161811828613 time for calcul the mask position with numpy : 0.025765419006347656 nb_pixel_total : 24571 time to create 1 rle with old method : 0.02853250503540039 time for calcul the mask position with numpy : 0.026341915130615234 nb_pixel_total : 804 time to create 1 rle with old method : 0.0009911060333251953 time for calcul the mask position with numpy : 0.02548694610595703 nb_pixel_total : 94643 time to create 1 rle with old method : 0.10947728157043457 time for calcul the mask position with numpy : 0.025735855102539062 nb_pixel_total : 16856 time to create 1 rle with old method : 0.019873857498168945 time for calcul the mask position with numpy : 0.025691747665405273 nb_pixel_total : 28993 time to create 1 rle with old method : 0.03378701210021973 time for calcul the mask position with numpy : 0.02502751350402832 nb_pixel_total : 44714 time to create 1 rle with old method : 0.05041790008544922 time for calcul the mask position with numpy : 0.028177976608276367 nb_pixel_total : 181920 time to create 1 rle with new method : 2.1058356761932373 time for calcul the mask position with numpy : 0.029270172119140625 nb_pixel_total : 125738 time to create 1 rle with old method : 0.14280009269714355 time for calcul the mask position with numpy : 0.02791285514831543 nb_pixel_total : 16950 time to create 1 rle with old method : 0.019922256469726562 create new chi : 4.642568588256836 time to delete rle : 0.0015900135040283203 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9649 TO DO : save crop sub photo not yet done ! save time : 0.6480937004089355 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 7.162343978881836 time for calcul the mask position with numpy : 1.328195333480835 nb_pixel_total : 7899920 time to create 1 rle with new method : 0.9673738479614258 time for calcul the mask position with numpy : 0.03954958915710449 nb_pixel_total : 16019 time to create 1 rle with old method : 0.018743515014648438 time for calcul the mask position with numpy : 0.04047966003417969 nb_pixel_total : 13253 time to create 1 rle with old method : 0.015774011611938477 time for calcul the mask position with numpy : 0.029214143753051758 nb_pixel_total : 60150 time to create 1 rle with old method : 0.07059884071350098 time for calcul the mask position with numpy : 0.026146650314331055 nb_pixel_total : 15130 time to create 1 rle with old method : 0.01752495765686035 time for calcul the mask position with numpy : 0.027315139770507812 nb_pixel_total : 39840 time to create 1 rle with old method : 0.060480356216430664 time for calcul the mask position with numpy : 0.028170108795166016 nb_pixel_total : 11002 time to create 1 rle with old method : 0.012836456298828125 time for calcul the mask position with numpy : 0.027611255645751953 nb_pixel_total : 21895 time to create 1 rle with old method : 0.027186870574951172 time for calcul the mask position with numpy : 0.026592254638671875 nb_pixel_total : 49142 time to create 1 rle with old method : 0.05859375 time for calcul the mask position with numpy : 0.028800010681152344 nb_pixel_total : 129839 time to create 1 rle with old method : 0.1632099151611328 time for calcul the mask position with numpy : 0.04446077346801758 nb_pixel_total : 38210 time to create 1 rle with old method : 0.0442352294921875 create new chi : 3.1504933834075928 time to delete rle : 0.0012788772583007812 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7008 TO DO : save crop sub photo not yet done ! save time : 0.5154561996459961 nb_obj : 10 nb_hashtags : 5 time to prepare the origin masks : 7.454478025436401 time for calcul the mask position with numpy : 0.6512470245361328 nb_pixel_total : 7572646 time to create 1 rle with new method : 1.4099903106689453 time for calcul the mask position with numpy : 0.03930044174194336 nb_pixel_total : 2944 time to create 1 rle with old method : 0.003655672073364258 time for calcul the mask position with numpy : 0.03964948654174805 nb_pixel_total : 48438 time to create 1 rle with old method : 0.05522489547729492 time for calcul the mask position with numpy : 0.04268932342529297 nb_pixel_total : 50511 time to create 1 rle with old method : 0.05793309211730957 time for calcul the mask position with numpy : 0.029066801071166992 nb_pixel_total : 26820 time to create 1 rle with old method : 0.03092336654663086 time for calcul the mask position with numpy : 0.026667118072509766 nb_pixel_total : 53311 time to create 1 rle with old method : 0.060102224349975586 time for calcul the mask position with numpy : 0.025194168090820312 nb_pixel_total : 153983 time to create 1 rle with new method : 0.49362754821777344 time for calcul the mask position with numpy : 0.028094768524169922 nb_pixel_total : 124207 time to create 1 rle with old method : 0.14122772216796875 time for calcul the mask position with numpy : 0.026180028915405273 nb_pixel_total : 153654 time to create 1 rle with new method : 0.8723311424255371 time for calcul the mask position with numpy : 0.025427818298339844 nb_pixel_total : 17031 time to create 1 rle with old method : 0.019852161407470703 time for calcul the mask position with numpy : 0.025964021682739258 nb_pixel_total : 90855 time to create 1 rle with old method : 0.10342931747436523 create new chi : 4.30648136138916 time to delete rle : 0.0013835430145263672 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8525 TO DO : save crop sub photo not yet done ! save time : 0.5756587982177734 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 10.08061408996582 time for calcul the mask position with numpy : 1.0874297618865967 nb_pixel_total : 7183923 time to create 1 rle with new method : 1.062988042831421 time for calcul the mask position with numpy : 0.026849746704101562 nb_pixel_total : 95232 time to create 1 rle with old method : 0.11009407043457031 time for calcul the mask position with numpy : 0.03223752975463867 nb_pixel_total : 65605 time to create 1 rle with old method : 0.11785483360290527 time for calcul the mask position with numpy : 0.026912689208984375 nb_pixel_total : 58792 time to create 1 rle with old method : 0.06870436668395996 time for calcul the mask position with numpy : 0.027309417724609375 nb_pixel_total : 127209 time to create 1 rle with old method : 0.14796066284179688 time for calcul the mask position with numpy : 0.02959609031677246 nb_pixel_total : 32297 time to create 1 rle with old method : 0.054555654525756836 time for calcul the mask position with numpy : 0.026416540145874023 nb_pixel_total : 988 time to create 1 rle with old method : 0.002413034439086914 time for calcul the mask position with numpy : 0.02904796600341797 nb_pixel_total : 136622 time to create 1 rle with old method : 0.16837525367736816 time for calcul the mask position with numpy : 0.028262615203857422 nb_pixel_total : 393327 time to create 1 rle with new method : 1.297194242477417 time for calcul the mask position with numpy : 0.031121492385864258 nb_pixel_total : 14821 time to create 1 rle with old method : 0.018855571746826172 time for calcul the mask position with numpy : 0.025879621505737305 nb_pixel_total : 28614 time to create 1 rle with old method : 0.03340268135070801 time for calcul the mask position with numpy : 0.026307106018066406 nb_pixel_total : 124858 time to create 1 rle with old method : 0.17412209510803223 time for calcul the mask position with numpy : 0.041359901428222656 nb_pixel_total : 32112 time to create 1 rle with old method : 0.037781715393066406 create new chi : 4.810411214828491 time to delete rle : 0.001744985580444336 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 10227 TO DO : save crop sub photo not yet done ! save time : 0.6594572067260742 nb_obj : 16 nb_hashtags : 5 time to prepare the origin masks : 13.73444652557373 time for calcul the mask position with numpy : 1.5271716117858887 nb_pixel_total : 7345956 time to create 1 rle with new method : 0.8893213272094727 time for calcul the mask position with numpy : 0.05021047592163086 nb_pixel_total : 112995 time to create 1 rle with old method : 0.13992738723754883 time for calcul the mask position with numpy : 0.046999216079711914 nb_pixel_total : 16096 time to create 1 rle with old method : 0.018815040588378906 time for calcul the mask position with numpy : 0.025879859924316406 nb_pixel_total : 24308 time to create 1 rle with old method : 0.02831578254699707 time for calcul the mask position with numpy : 0.026388168334960938 nb_pixel_total : 4380 time to create 1 rle with old method : 0.005308389663696289 time for calcul the mask position with numpy : 0.03174233436584473 nb_pixel_total : 51100 time to create 1 rle with old method : 0.06113314628601074 time for calcul the mask position with numpy : 0.026312828063964844 nb_pixel_total : 40731 time to create 1 rle with old method : 0.04958653450012207 time for calcul the mask position with numpy : 0.02629232406616211 nb_pixel_total : 54079 time to create 1 rle with old method : 0.06302189826965332 time for calcul the mask position with numpy : 0.029041767120361328 nb_pixel_total : 77818 time to create 1 rle with old method : 0.09129810333251953 time for calcul the mask position with numpy : 0.02927231788635254 nb_pixel_total : 18109 time to create 1 rle with old method : 0.0212552547454834 time for calcul the mask position with numpy : 0.02717447280883789 nb_pixel_total : 66459 time to create 1 rle with old method : 0.07904839515686035 time for calcul the mask position with numpy : 0.027781009674072266 nb_pixel_total : 49857 time to create 1 rle with old method : 0.08022880554199219 time for calcul the mask position with numpy : 0.02797985076904297 nb_pixel_total : 110984 time to create 1 rle with old method : 0.1549532413482666 time for calcul the mask position with numpy : 0.027611255645751953 nb_pixel_total : 46392 time to create 1 rle with old method : 0.05545926094055176 time for calcul the mask position with numpy : 0.027922868728637695 nb_pixel_total : 68470 time to create 1 rle with old method : 0.07999539375305176 time for calcul the mask position with numpy : 0.029633045196533203 nb_pixel_total : 96432 time to create 1 rle with old method : 0.11153149604797363 time for calcul the mask position with numpy : 0.03187394142150879 nb_pixel_total : 110234 time to create 1 rle with old method : 0.1289823055267334 create new chi : 4.164108991622925 time to delete rle : 0.0034170150756835938 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12278 TO DO : save crop sub photo not yet done ! save time : 0.7878768444061279 map_output_result : {1361115333: (0.0, 'Should be the crop_list due to order', 0), 1361115322: (0.0, 'Should be the crop_list due to order', 0), 1361115317: (0.0, 'Should be the crop_list due to order', 0), 1361115311: (0.0, 'Should be the crop_list due to order', 0), 1361115297: (0.0, 'Should be the crop_list due to order', 0), 1361115293: (0.0, 'Should be the crop_list due to order', 0), 1361115291: (0.0, 'Should be the crop_list due to order', 0), 1361115289: (0.0, 'Should be the crop_list due to order', 0), 1361115287: (0.0, 'Should be the crop_list due to order', 0), 1361115283: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361115333, 1361115322, 1361115317, 1361115311, 1361115297, 1361115293, 1361115291, 1361115289, 1361115287, 1361115283] Looping around the photos to save general results len do output : 10 /1361115333.Didn't retrieve data . /1361115322.Didn't retrieve data . /1361115317.Didn't retrieve data . /1361115311.Didn't retrieve data . /1361115297.Didn't retrieve data . /1361115293.Didn't retrieve data . /1361115291.Didn't retrieve data . /1361115289.Didn't retrieve data . /1361115287.Didn't retrieve data . /1361115283.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115333', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115322', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115317', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115311', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115297', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115293', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115291', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115289', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115287', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115283', None, None, None, None, None, '2957324') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.015969276428222656 save_final save missing photos in datou_result : time spend for datou_step_exec : 140.96771502494812 time spend to save output : 0.017065763473510742 total time spend for step 3 : 140.98478078842163 step4:ventilate_hashtags_in_portfolio Mon May 26 18:55:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23351468 get user id for portfolio 23351468 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23351468 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','papier','environnement','flou','pet_clair','carton','pehd','metal','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23351468 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','papier','environnement','flou','pet_clair','carton','pehd','metal','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23351468 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','papier','environnement','flou','pet_clair','carton','pehd','metal','mal_croppe','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23352449,23352450,23352451,23352452,23352453,23352454,23352455,23352456,23352457,23352458,23352459?tags=pet_fonce,background,papier,environnement,flou,pet_clair,carton,pehd,metal,mal_croppe,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361115333, 1361115322, 1361115317, 1361115311, 1361115297, 1361115293, 1361115291, 1361115289, 1361115287, 1361115283] Looping around the photos to save general results len do output : 1 /23351468. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115333', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115322', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115317', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115311', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115297', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115293', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115291', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115289', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115287', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115283', None, None, None, None, None, '2957324') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015735626220703125 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5965640544891357 time spend to save output : 0.01627516746520996 total time spend for step 4 : 1.6128392219543457 step5:final Mon May 26 18:55:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361115333: ('0.0918675491898148',), 1361115322: ('0.0918675491898148',), 1361115317: ('0.0918675491898148',), 1361115311: ('0.0918675491898148',), 1361115297: ('0.0918675491898148',), 1361115293: ('0.0918675491898148',), 1361115291: ('0.0918675491898148',), 1361115289: ('0.0918675491898148',), 1361115287: ('0.0918675491898148',), 1361115283: ('0.0918675491898148',)} new output for save of step final : {1361115333: ('0.0918675491898148',), 1361115322: ('0.0918675491898148',), 1361115317: ('0.0918675491898148',), 1361115311: ('0.0918675491898148',), 1361115297: ('0.0918675491898148',), 1361115293: ('0.0918675491898148',), 1361115291: ('0.0918675491898148',), 1361115289: ('0.0918675491898148',), 1361115287: ('0.0918675491898148',), 1361115283: ('0.0918675491898148',)} [1361115333, 1361115322, 1361115317, 1361115311, 1361115297, 1361115293, 1361115291, 1361115289, 1361115287, 1361115283] Looping around the photos to save general results len do output : 10 /1361115333.Didn't retrieve data . /1361115322.Didn't retrieve data . /1361115317.Didn't retrieve data . /1361115311.Didn't retrieve data . /1361115297.Didn't retrieve data . /1361115293.Didn't retrieve data . /1361115291.Didn't retrieve data . /1361115289.Didn't retrieve data . /1361115287.Didn't retrieve data . /1361115283.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115333', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115322', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115317', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115311', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115297', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115293', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115291', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115289', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115287', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115283', None, None, None, None, None, '2957324') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014108419418334961 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11429834365844727 time spend to save output : 0.014805793762207031 total time spend for step 5 : 0.1291041374206543 step6:blur_detection Mon May 26 18:55:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb.jpg resize: (2160, 3840) 1361115333 -6.527532542105707 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57.jpg resize: (2160, 3840) 1361115322 -6.517740495882392 treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28.jpg resize: (2160, 3840) 1361115317 -6.590517344490121 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502.jpg resize: (2160, 3840) 1361115311 -6.5532604203913 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa.jpg resize: (2160, 3840) 1361115297 -6.4285781046241794 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8.jpg resize: (2160, 3840) 1361115293 -6.448266728241706 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4.jpg resize: (2160, 3840) 1361115291 -6.360194203773563 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9.jpg resize: (2160, 3840) 1361115289 -5.978236471705415 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407.jpg resize: (2160, 3840) 1361115287 -5.713304278418469 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11.jpg resize: (2160, 3840) 1361115283 -5.845892503643994 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357326_0.png resize: (255, 178) 1361135631 -4.090901133929409 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357327_0.png resize: (342, 166) 1361135632 -3.3387475282585815 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357328_0.png resize: (889, 316) 1361135633 -3.271502193120327 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357330_0.png resize: (293, 359) 1361135634 -4.071338369070643 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357331_0.png resize: (104, 269) 1361135635 -4.973783196033574 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357332_0.png resize: (319, 426) 1361135636 -4.9416912816519405 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357333_0.png resize: (138, 241) 1361135637 -4.033963786182152 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357334_0.png resize: (247, 315) 1361135638 -4.432533830684337 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357336_0.png resize: (748, 896) 1361135639 -4.689870651037094 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357340_0.png resize: (258, 122) 1361135640 -3.9216076133263935 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357342_0.png resize: (172, 285) 1361135641 -3.042877072997302 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357344_0.png resize: (162, 104) 1361135642 -3.527477239650748 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357346_0.png resize: (303, 234) 1361135643 -3.9259454660600412 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357349_0.png resize: (133, 99) 1361135644 -3.7975828662998583 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357350_0.png resize: (248, 164) 1361135645 -4.006813736102974 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357353_0.png resize: (277, 220) 1361135646 -4.6754259044216875 treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357361_0.png resize: (252, 340) 1361135647 -3.4572651950690485 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357365_0.png resize: (213, 177) 1361135648 -3.8540584854741593 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357366_0.png resize: (483, 436) 1361135649 -4.294251570751505 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357367_0.png resize: (503, 733) 1361135650 -4.447951990479126 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357368_0.png resize: (402, 226) 1361135651 -3.8025027823610658 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357369_0.png resize: (99, 99) 1361135652 -1.2102949126538975 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357372_0.png resize: (250, 161) 1361135653 -3.5506187160784957 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357373_0.png resize: (136, 216) 1361135654 -2.484611044929043 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357374_0.png resize: (272, 292) 1361135655 -3.7598293597892884 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357375_0.png resize: (529, 541) 1361135656 -5.174146007161661 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357376_0.png resize: (301, 252) 1361135657 -3.1245843844120413 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357377_0.png resize: (324, 412) 1361135658 -3.5500915595951326 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357381_0.png resize: (109, 140) 1361135659 -4.249996173008884 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357382_0.png resize: (114, 182) 1361135660 -3.776768769906907 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357387_0.png resize: (492, 517) 1361135661 -3.278987839198866 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357388_0.png resize: (698, 466) 1361135662 -4.205893761269485 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357396_0.png resize: (226, 298) 1361135663 -4.667803599912138 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357398_0.png resize: (327, 213) 1361135664 -2.0206529288848203 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357400_0.png resize: (479, 566) 1361135665 -3.3062341361558865 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357401_0.png resize: (250, 298) 1361135666 -3.8114440386774575 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357405_0.png resize: (151, 146) 1361135667 -3.151189740134795 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357407_0.png resize: (99, 192) 1361135668 -2.0059773056118204 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357409_0.png resize: (423, 406) 1361135669 -4.979781193806413 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357412_0.png resize: (392, 446) 1361135670 -4.248907727621477 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357414_0.png resize: (277, 410) 1361135671 -4.0884515676763025 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357415_0.png resize: (176, 200) 1361135673 -4.583636911019653 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357416_0.png resize: (269, 245) 1361135674 -3.453533281842146 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357425_0.png resize: (309, 649) 1361135675 -4.241150080181019 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357427_0.png resize: (455, 325) 1361135676 -4.78306582372703 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357428_0.png resize: (316, 500) 1361135677 -3.3016212753815433 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357429_0.png resize: (237, 475) 1361135678 -4.937735872099425 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357431_0.png resize: (289, 533) 1361135679 -4.036092154731368 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357432_0.png resize: (365, 316) 1361135680 -4.151780950657598 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357435_0.png resize: (406, 459) 1361135681 -1.4968442609015555 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357446_0.png resize: (652, 222) 1361135682 -4.299271169156197 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357329_0.png resize: (152, 170) 1361135687 -3.7620799486330485 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357335_0.png resize: (170, 293) 1361135688 -3.600682448417563 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357337_0.png resize: (138, 146) 1361135689 -2.1754772475272013 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357341_0.png resize: (930, 969) 1361135690 -5.708452361488238 treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357359_0.png resize: (203, 291) 1361135691 -3.987408245674126 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357386_0.png resize: (233, 88) 1361135692 -1.782142328895732 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357390_0.png resize: (225, 217) 1361135693 -3.653357035918512 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357391_0.png resize: (151, 162) 1361135695 -3.6562583628495835 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357393_0.png resize: (161, 79) 1361135696 -2.814183081013779 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357394_0.png resize: (200, 150) 1361135697 -3.305415222490447 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357395_0.png resize: (272, 272) 1361135698 -3.5552946822118496 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357399_0.png resize: (285, 183) 1361135699 -3.3163961356428233 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357404_0.png resize: (208, 256) 1361135700 -4.08510404419335 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357433_0.png resize: (292, 413) 1361135701 -3.7640936569579444 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357434_0.png resize: (260, 270) 1361135702 -4.165680752738704 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357441_0.png resize: (325, 188) 1361135703 -2.9160516587363055 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357338_0.png resize: (135, 99) 1361135706 -4.707838223463176 treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357339_0.png resize: (103, 119) 1361135707 -3.5450440220693724 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357345_0.png resize: (164, 143) 1361135708 -4.76692139052396 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357347_0.png resize: (82, 121) 1361135709 -2.1744123742521344 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357348_0.png resize: (231, 169) 1361135710 -5.216140964518916 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357354_0.png resize: (160, 170) 1361135711 -4.3186468725361005 treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357360_0.png resize: (239, 227) 1361135712 -5.211375447133573 treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357363_0.png resize: (196, 245) 1361135713 -4.052348558221211 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357379_0.png resize: (74, 148) 1361135714 -4.51739618933812 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357384_0.png resize: (149, 144) 1361135715 -4.480545910507824 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357402_0.png resize: (173, 175) 1361135716 -3.8133090858702015 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357403_0.png resize: (96, 148) 1361135717 -4.549844848271403 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357418_0.png resize: (309, 182) 1361135718 -4.381304047203044 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357422_0.png resize: (136, 142) 1361135719 -4.049718640002011 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357438_0.png resize: (167, 137) 1361135720 -3.9806670616186546 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357445_0.png resize: (101, 240) 1361135721 -3.3643039366734597 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357343_0.png resize: (247, 171) 1361135782 -3.9501301545234875 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357351_0.png resize: (399, 197) 1361135783 -4.18261153669333 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357355_0.png resize: (128, 72) 1361135784 -3.2006080320585673 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357356_0.png resize: (321, 364) 1361135786 -4.855260381670151 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357357_0.png resize: (216, 343) 1361135787 -4.531251812332682 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357358_0.png resize: (389, 268) 1361135788 -5.008627078386029 treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357362_0.png resize: (522, 135) 1361135790 -4.352407474763354 treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357364_0.png resize: (346, 158) 1361135791 -4.073040465919741 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357371_0.png resize: (278, 199) 1361135792 -4.5642339176415 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357378_0.png resize: (448, 435) 1361135794 -5.020709617177906 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357383_0.png resize: (545, 361) 1361135795 -5.128072870398957 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357385_0.png resize: (417, 226) 1361135796 -2.984757587868928 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357389_0.png resize: (247, 237) 1361135798 -4.316978453176205 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357392_0.png resize: (297, 456) 1361135799 -4.456356782989049 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357406_0.png resize: (275, 331) 1361135800 -3.6619019625306457 treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357408_0.png resize: (141, 141) 1361135802 -4.1967509675565955 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357411_0.png resize: (412, 472) 1361135803 -5.442374981962706 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357417_0.png resize: (310, 173) 1361135804 -4.157576961732194 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357419_0.png resize: (238, 169) 1361135806 -4.1909917823714 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357420_0.png resize: (429, 413) 1361135807 -3.9000374117769168 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357421_0.png resize: (249, 194) 1361135809 -4.306397076858631 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357423_0.png resize: (769, 645) 1361135810 -5.583084845718524 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357424_0.png resize: (317, 684) 1361135811 -4.257212361808635 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357426_0.png resize: (152, 298) 1361135813 -4.5534019201425275 treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357430_0.png resize: (484, 300) 1361135814 -4.061622241984881 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357437_0.png resize: (346, 344) 1361135815 -4.037017576720532 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357439_0.png resize: (246, 543) 1361135817 -4.322004330933212 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357442_0.png resize: (463, 290) 1361135818 -3.4791014380975476 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357443_0.png resize: (314, 158) 1361135819 -3.813056123382151 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357444_0.png resize: (137, 225) 1361135821 -4.086612158253137 treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357352_0.png resize: (341, 170) 1361135857 -5.121855510928085 treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357370_0.png resize: (111, 105) 1361135859 -3.3471339239817097 treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357397_0.png resize: (208, 215) 1361135862 -4.316532666893743 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357410_0.png resize: (118, 180) 1361135864 -4.865509996270138 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357436_0.png resize: (288, 218) 1361135865 -3.9415329610870358 treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357440_0.png resize: (296, 271) 1361135867 -3.556771735905044 treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357380_0.png resize: (243, 229) 1361135892 -4.236556065431416 treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357413_0.png resize: (297, 631) 1361135894 -4.843317487839945 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 131 time used for this insertion : 0.01947498321533203 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 131 time used for this insertion : 0.03964877128601074 save missing photos in datou_result : time spend for datou_step_exec : 47.62628984451294 time spend to save output : 0.06485629081726074 total time spend for step 6 : 47.6911461353302 step7:brightness Mon May 26 18:56:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb.jpg treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57.jpg treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28.jpg treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502.jpg treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa.jpg treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8.jpg treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4.jpg treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9.jpg treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407.jpg treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11.jpg treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357326_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357327_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357328_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357330_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357331_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357332_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357333_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357334_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357336_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357340_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357342_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357344_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357346_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357349_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357350_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357353_0.png treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357361_0.png treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357365_0.png treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357366_0.png treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357367_0.png treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357368_0.png treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357369_0.png treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357372_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357373_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357374_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357375_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357376_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357377_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357381_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357382_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357387_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357388_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357396_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357398_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357400_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357401_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357405_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357407_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357409_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357412_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357414_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357415_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357416_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357425_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357427_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357428_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357429_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357431_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357432_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357435_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357446_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357329_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357335_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357337_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357341_0.png treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357359_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357386_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357390_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357391_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357393_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357394_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357395_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357399_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357404_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357433_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357434_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357441_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357338_0.png treat image : temp/1748278229_987158_1361115333_afbbf55266b6c4ff2240963996e610cb_rle_crop_3813357339_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357345_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357347_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357348_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357354_0.png treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357360_0.png treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357363_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357379_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357384_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357402_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357403_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357418_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357422_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357438_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357445_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357343_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357351_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357355_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357356_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357357_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357358_0.png treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357362_0.png treat image : temp/1748278229_987158_1361115317_b73e2b83f86b7ca40518c264fee0af28_rle_crop_3813357364_0.png treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357371_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357378_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357383_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357385_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357389_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357392_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357406_0.png treat image : temp/1748278229_987158_1361115291_fe42c7bff1af49987365ac53319bf7f4_rle_crop_3813357408_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357411_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357417_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357419_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357420_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357421_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357423_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357424_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357426_0.png treat image : temp/1748278229_987158_1361115287_6fb77138859c77d19b40a479ce5fe407_rle_crop_3813357430_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357437_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357439_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357442_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357443_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357444_0.png treat image : temp/1748278229_987158_1361115322_9d2bd5337b8eb42fa3592aa9ec139a57_rle_crop_3813357352_0.png treat image : temp/1748278229_987158_1361115311_756289fefecb5614816d085386a9e502_rle_crop_3813357370_0.png treat image : temp/1748278229_987158_1361115293_99fb59b28d6964194aa2808710ff6fc8_rle_crop_3813357397_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357410_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357436_0.png treat image : temp/1748278229_987158_1361115283_d8b03bacba7f05a3e64234479de79e11_rle_crop_3813357440_0.png treat image : temp/1748278229_987158_1361115297_38cd4cf785f6bf760fe16303962fe1aa_rle_crop_3813357380_0.png treat image : temp/1748278229_987158_1361115289_3d543a68732939d5ed42ea306e63cff9_rle_crop_3813357413_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 131 time used for this insertion : 0.021152019500732422 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 131 time used for this insertion : 0.030518531799316406 save missing photos in datou_result : time spend for datou_step_exec : 12.510993242263794 time spend to save output : 0.056539297103881836 total time spend for step 7 : 12.567532539367676 step8:velours_tree Mon May 26 18:56:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.38777995109558105 time spend to save output : 5.030632019042969e-05 total time spend for step 8 : 0.3878302574157715 step9:send_mail_cod Mon May 26 18:56:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23351468_26-05-2025_18_56_54.pdf 23352449 change filename to text .change filename to text .imagette233524491748278614 23352450 imagette233524501748278614 23352451 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233524511748278614 23352453 imagette233524531748278616 23352454 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233524541748278616 23352455 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233524551748278617 23352456 imagette233524561748278619 23352457 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233524571748278619 23352458 imagette233524581748278620 23352459 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233524591748278620 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23351468 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23352449,23352450,23352451,23352452,23352453,23352454,23352455,23352456,23352457,23352458,23352459?tags=pet_fonce,background,papier,environnement,flou,pet_clair,carton,pehd,metal,mal_croppe,autre args[1361115333] : ((1361115333, -6.527532542105707, 492609224), (1361115333, 0.4224522879895359, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115322] : ((1361115322, -6.517740495882392, 492609224), (1361115322, 0.2497883832420215, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115317] : ((1361115317, -6.590517344490121, 492609224), (1361115317, 0.304048567404182, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115311] : ((1361115311, -6.5532604203913, 492609224), (1361115311, 0.303638885184783, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115297] : ((1361115297, -6.4285781046241794, 492609224), (1361115297, 0.3950493652814664, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115293] : ((1361115293, -6.448266728241706, 492609224), (1361115293, 0.3405547686867474, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115291] : ((1361115291, -6.360194203773563, 492609224), (1361115291, 0.3525129860087977, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115289] : ((1361115289, -5.978236471705415, 492609224), (1361115289, 0.06724945202306272, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115287] : ((1361115287, -5.713304278418469, 492609224), (1361115287, -0.0060920664490276945, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com args[1361115283] : ((1361115283, -5.845892503643994, 492609224), (1361115283, 0.2922711859467875, 2107752395), '0.0918675491898148') We are sending mail with results at report@fotonower.com refus_total : 0.0918675491898148 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23351468 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23351468_26-05-2025_18_56_54.pdf results_Auto_P23351468_26-05-2025_18_56_54.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23351468_26-05-2025_18_56_54.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23351468','results_Auto_P23351468_26-05-2025_18_56_54.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23351468_26-05-2025_18_56_54.pdf','pdf','','1.06','0.0918675491898148') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23351468

https://www.fotonower.com/image?json=false&list_photos_id=1361115333
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115322
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115317
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115311
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115297
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115293
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115291
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115289
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115287
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361115283
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.19%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23352449?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23352451?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23352454?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23352455?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23352457?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23352459?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23351468_26-05-2025_18_56_54.pdf.

Lien vers velours :https://www.fotonower.com/velours/23352449,23352450,23352451,23352452,23352453,23352454,23352455,23352456,23352457,23352458,23352459?tags=pet_fonce,background,papier,environnement,flou,pet_clair,carton,pehd,metal,mal_croppe,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 16:57:04 GMT Content-Length: 0 Connection: close X-Message-Id: GvSgd4PFTTGJSRIJHuG3UQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361115333, 1361115322, 1361115317, 1361115311, 1361115297, 1361115293, 1361115291, 1361115289, 1361115287, 1361115283] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115333', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115322', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115317', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115311', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115297', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115293', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115291', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115289', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115287', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115283', None, None, None, None, None, '2957324') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01496744155883789 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.27614450454712 time spend to save output : 0.01517486572265625 total time spend for step 9 : 10.291319370269775 step10:split_time_score Mon May 26 18:57:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26052025 23351468 Nombre de photos uploadées : 10 / 23040 (0%) 26052025 23351468 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 26052025 23351468 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.001188039779663086 elapsed_time : insert_dashboard_record_day_entry 0.031130552291870117 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.10042625385802464 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344668_26-05-2025_17_49_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344668 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344668 AND mptpi.`type`=3594 To do Qualite : 0.10631123107156629 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331064_26-05-2025_13_10_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331064 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331064 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331066 order by id desc limit 1 Qualite : 0.09622099389524323 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331105_26-05-2025_15_13_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331105 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328666 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328671 order by id desc limit 1 Qualite : 0.1437267627398686 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339058_26-05-2025_18_20_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339058 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339058 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339060 order by id desc limit 1 Qualite : 0.10856602044753087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339062_26-05-2025_15_34_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339062 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339062 AND mptpi.`type`=3594 To do Qualite : 0.12075810185185182 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339075 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339075 AND mptpi.`type`=3594 To do Qualite : 0.11833079346707819 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339078_26-05-2025_15_20_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339078 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339078 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339082 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339099 order by id desc limit 1 Qualite : 0.1057252148705418 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342743_26-05-2025_16_36_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342743 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342743 AND mptpi.`type`=3594 To do Qualite : 0.0907608212234225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342745_26-05-2025_17_46_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342745 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342745 AND mptpi.`type`=3594 To do Qualite : 0.11492990451388885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342759_26-05-2025_16_32_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342759 AND mptpi.`type`=3594 To do Qualite : 0.19915349847822353 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344670_26-05-2025_17_19_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344670 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344670 AND mptpi.`type`=3594 To do Qualite : 0.11846868333560273 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344672_26-05-2025_17_11_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344672 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344672 AND mptpi.`type`=3594 To do Qualite : 0.1291854573137125 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344698_26-05-2025_16_54_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344698 AND mptpi.`type`=3594 To do Qualite : 0.10039044013631691 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23344701_26-05-2025_16_50_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344701 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23344701 AND mptpi.`type`=3594 To do Qualite : 0.0918675491898148 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23351468_26-05-2025_18_56_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23351468 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23351468 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23351470 order by id desc limit 1 Qualite : 0.09541643307532796 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23351475_26-05-2025_18_50_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23351475 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23351475 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26052025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361115333, 1361115322, 1361115317, 1361115311, 1361115297, 1361115293, 1361115291, 1361115289, 1361115287, 1361115283] Looping around the photos to save general results len do output : 1 /23351468Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115333', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115322', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115317', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115311', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115297', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115293', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115291', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115289', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115287', None, None, None, None, None, '2957324') ('3318', None, None, None, None, None, None, None, '2957324') ('3318', '23351468', '1361115283', None, None, None, None, None, '2957324') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01782083511352539 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.128037691116333 time spend to save output : 0.01811051368713379 total time spend for step 10 : 7.146148204803467 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 154.66user 201.48system 6:46.50elapsed 87%CPU (0avgtext+0avgdata 5446084maxresident)k 905592inputs+165704outputs (26299major+15875807minor)pagefaults 0swaps