python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2057576 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2755470'] with mtr_portfolio_ids : ['22366522'] and first list_photo_ids : [] new path : /proc/2057576/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.5704963207244873 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Apr 24 04:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-24 04:40:35.480177: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-24 04:40:35.511136: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-24 04:40:35.513082: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efd90000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-24 04:40:35.513141: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-24 04:40:35.516766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-24 04:40:35.776803: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3cdc1110 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-24 04:40:35.776860: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-24 04:40:35.777725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-24 04:40:35.778301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-24 04:40:35.781787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 04:40:35.795497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-24 04:40:35.795962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-24 04:40:35.807534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-24 04:40:35.809584: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-24 04:40:35.857371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-24 04:40:35.859049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-24 04:40:35.859159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-24 04:40:35.860031: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-24 04:40:35.860047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-24 04:40:35.860059: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-24 04:40:35.861780: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-24 04:40:36.167313: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-24 04:40:36.167455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-24 04:40:36.168054: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 04:40:36.168088: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-24 04:40:36.168120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-24 04:40:36.168153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-24 04:40:36.168182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-24 04:40:36.168215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-24 04:40:36.169680: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-24 04:40:36.170991: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-24 04:40:36.171033: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-24 04:40:36.171049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 04:40:36.171064: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-24 04:40:36.171077: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-24 04:40:36.171091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-24 04:40:36.171105: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-24 04:40:36.171120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-24 04:40:36.172439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-24 04:40:36.172470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-24 04:40:36.172479: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-24 04:40:36.172486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-24 04:40:36.173883: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-24 04:40:49.528969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-24 04:40:49.726525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 Detection mask done ! Trying to reset tf kernel 2058395 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.005803108215332031 nb_pixel_total : 140445 time to create 1 rle with old method : 0.16688227653503418 length of segment : 574 time for calcul the mask position with numpy : 0.0002646446228027344 nb_pixel_total : 8921 time to create 1 rle with old method : 0.01107645034790039 length of segment : 90 time for calcul the mask position with numpy : 0.0026924610137939453 nb_pixel_total : 89087 time to create 1 rle with old method : 0.1562519073486328 length of segment : 548 time for calcul the mask position with numpy : 0.0033702850341796875 nb_pixel_total : 127929 time to create 1 rle with old method : 0.1701805591583252 length of segment : 512 time for calcul the mask position with numpy : 0.00045037269592285156 nb_pixel_total : 12395 time to create 1 rle with old method : 0.016719818115234375 length of segment : 134 time for calcul the mask position with numpy : 0.001573324203491211 nb_pixel_total : 33998 time to create 1 rle with old method : 0.04312920570373535 length of segment : 228 time for calcul the mask position with numpy : 0.001672983169555664 nb_pixel_total : 55992 time to create 1 rle with old method : 0.07953476905822754 length of segment : 244 time for calcul the mask position with numpy : 0.0029981136322021484 nb_pixel_total : 68780 time to create 1 rle with old method : 0.08767890930175781 length of segment : 435 time for calcul the mask position with numpy : 0.00040435791015625 nb_pixel_total : 13610 time to create 1 rle with old method : 0.018581390380859375 length of segment : 121 time for calcul the mask position with numpy : 0.0005366802215576172 nb_pixel_total : 25333 time to create 1 rle with old method : 0.033507347106933594 length of segment : 231 time for calcul the mask position with numpy : 0.00249481201171875 nb_pixel_total : 91893 time to create 1 rle with old method : 0.11728191375732422 length of segment : 274 time for calcul the mask position with numpy : 0.0008602142333984375 nb_pixel_total : 29026 time to create 1 rle with old method : 0.03587794303894043 length of segment : 270 time for calcul the mask position with numpy : 0.002880096435546875 nb_pixel_total : 72885 time to create 1 rle with old method : 0.09009194374084473 length of segment : 387 time for calcul the mask position with numpy : 0.0014598369598388672 nb_pixel_total : 94148 time to create 1 rle with old method : 0.11764812469482422 length of segment : 602 time for calcul the mask position with numpy : 0.004592180252075195 nb_pixel_total : 157415 time to create 1 rle with new method : 0.01263737678527832 length of segment : 752 time for calcul the mask position with numpy : 0.0020754337310791016 nb_pixel_total : 114483 time to create 1 rle with old method : 0.14280915260314941 length of segment : 695 time for calcul the mask position with numpy : 0.0009624958038330078 nb_pixel_total : 34042 time to create 1 rle with old method : 0.059780120849609375 length of segment : 332 time for calcul the mask position with numpy : 0.0006706714630126953 nb_pixel_total : 26093 time to create 1 rle with old method : 0.03145480155944824 length of segment : 284 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 4051 time to create 1 rle with old method : 0.010746240615844727 length of segment : 60 time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 34702 time to create 1 rle with old method : 0.04289960861206055 length of segment : 193 time for calcul the mask position with numpy : 0.00029349327087402344 nb_pixel_total : 14143 time to create 1 rle with old method : 0.017464876174926758 length of segment : 136 time for calcul the mask position with numpy : 0.0006902217864990234 nb_pixel_total : 18450 time to create 1 rle with old method : 0.02658367156982422 length of segment : 154 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 11183 time to create 1 rle with old method : 0.015969514846801758 length of segment : 82 time for calcul the mask position with numpy : 0.0007722377777099609 nb_pixel_total : 5683 time to create 1 rle with old method : 0.0071408748626708984 length of segment : 267 time for calcul the mask position with numpy : 0.0012662410736083984 nb_pixel_total : 30479 time to create 1 rle with old method : 0.04110240936279297 length of segment : 154 time for calcul the mask position with numpy : 0.0038704872131347656 nb_pixel_total : 78759 time to create 1 rle with old method : 0.09289860725402832 length of segment : 404 time for calcul the mask position with numpy : 0.0008833408355712891 nb_pixel_total : 17956 time to create 1 rle with old method : 0.02180004119873047 length of segment : 135 time for calcul the mask position with numpy : 0.0037131309509277344 nb_pixel_total : 87552 time to create 1 rle with old method : 0.10417795181274414 length of segment : 632 time for calcul the mask position with numpy : 0.0011951923370361328 nb_pixel_total : 31945 time to create 1 rle with old method : 0.038156986236572266 length of segment : 214 time for calcul the mask position with numpy : 0.0015034675598144531 nb_pixel_total : 29662 time to create 1 rle with old method : 0.03542375564575195 length of segment : 285 time for calcul the mask position with numpy : 0.0028214454650878906 nb_pixel_total : 43692 time to create 1 rle with old method : 0.051407814025878906 length of segment : 232 time for calcul the mask position with numpy : 0.0019731521606445312 nb_pixel_total : 44696 time to create 1 rle with old method : 0.05260825157165527 length of segment : 275 time for calcul the mask position with numpy : 0.0011720657348632812 nb_pixel_total : 28958 time to create 1 rle with old method : 0.035016536712646484 length of segment : 154 time for calcul the mask position with numpy : 0.008237600326538086 nb_pixel_total : 187300 time to create 1 rle with new method : 0.01443934440612793 length of segment : 462 time for calcul the mask position with numpy : 0.0002994537353515625 nb_pixel_total : 4009 time to create 1 rle with old method : 0.005509138107299805 length of segment : 82 time for calcul the mask position with numpy : 0.004439353942871094 nb_pixel_total : 83722 time to create 1 rle with old method : 0.10029339790344238 length of segment : 586 time for calcul the mask position with numpy : 0.002148151397705078 nb_pixel_total : 45791 time to create 1 rle with old method : 0.055474281311035156 length of segment : 226 time for calcul the mask position with numpy : 0.004830837249755859 nb_pixel_total : 87384 time to create 1 rle with old method : 0.11998271942138672 length of segment : 379 time for calcul the mask position with numpy : 0.002550363540649414 nb_pixel_total : 45905 time to create 1 rle with old method : 0.05799698829650879 length of segment : 563 time for calcul the mask position with numpy : 0.002933979034423828 nb_pixel_total : 71627 time to create 1 rle with old method : 0.0911712646484375 length of segment : 306 time for calcul the mask position with numpy : 0.0009174346923828125 nb_pixel_total : 21802 time to create 1 rle with old method : 0.026326656341552734 length of segment : 179 time for calcul the mask position with numpy : 0.0020401477813720703 nb_pixel_total : 49765 time to create 1 rle with old method : 0.06199479103088379 length of segment : 341 time for calcul the mask position with numpy : 0.0013341903686523438 nb_pixel_total : 28527 time to create 1 rle with old method : 0.03452491760253906 length of segment : 207 time for calcul the mask position with numpy : 0.0022072792053222656 nb_pixel_total : 53607 time to create 1 rle with old method : 0.06991291046142578 length of segment : 311 time for calcul the mask position with numpy : 0.0013670921325683594 nb_pixel_total : 27812 time to create 1 rle with old method : 0.03611302375793457 length of segment : 225 time for calcul the mask position with numpy : 0.0024149417877197266 nb_pixel_total : 51239 time to create 1 rle with old method : 0.06819987297058105 length of segment : 419 time for calcul the mask position with numpy : 0.0006701946258544922 nb_pixel_total : 13617 time to create 1 rle with old method : 0.016623973846435547 length of segment : 145 time for calcul the mask position with numpy : 0.0052280426025390625 nb_pixel_total : 124320 time to create 1 rle with old method : 0.1497056484222412 length of segment : 680 time for calcul the mask position with numpy : 0.0013456344604492188 nb_pixel_total : 22106 time to create 1 rle with old method : 0.026494741439819336 length of segment : 198 time for calcul the mask position with numpy : 0.005279541015625 nb_pixel_total : 143496 time to create 1 rle with old method : 0.17514252662658691 length of segment : 583 time for calcul the mask position with numpy : 0.003616809844970703 nb_pixel_total : 83305 time to create 1 rle with old method : 0.10496783256530762 length of segment : 500 time for calcul the mask position with numpy : 0.0007607936859130859 nb_pixel_total : 19482 time to create 1 rle with old method : 0.023953914642333984 length of segment : 147 time for calcul the mask position with numpy : 0.0007092952728271484 nb_pixel_total : 13373 time to create 1 rle with old method : 0.016139984130859375 length of segment : 131 time for calcul the mask position with numpy : 0.00048351287841796875 nb_pixel_total : 12416 time to create 1 rle with old method : 0.014902591705322266 length of segment : 164 time for calcul the mask position with numpy : 0.0010616779327392578 nb_pixel_total : 19893 time to create 1 rle with old method : 0.024104833602905273 length of segment : 264 time for calcul the mask position with numpy : 0.00028443336486816406 nb_pixel_total : 5997 time to create 1 rle with old method : 0.011482477188110352 length of segment : 76 time for calcul the mask position with numpy : 0.0006539821624755859 nb_pixel_total : 16591 time to create 1 rle with old method : 0.020821332931518555 length of segment : 141 time for calcul the mask position with numpy : 0.006261587142944336 nb_pixel_total : 194546 time to create 1 rle with new method : 0.011647462844848633 length of segment : 737 time for calcul the mask position with numpy : 0.0004394054412841797 nb_pixel_total : 7344 time to create 1 rle with old method : 0.008812665939331055 length of segment : 91 time for calcul the mask position with numpy : 0.002033233642578125 nb_pixel_total : 46019 time to create 1 rle with old method : 0.055184364318847656 length of segment : 255 time for calcul the mask position with numpy : 0.0013473033905029297 nb_pixel_total : 50582 time to create 1 rle with old method : 0.0609898567199707 length of segment : 334 time for calcul the mask position with numpy : 0.020136117935180664 nb_pixel_total : 350591 time to create 1 rle with new method : 0.019659042358398438 length of segment : 867 time for calcul the mask position with numpy : 0.0014984607696533203 nb_pixel_total : 31125 time to create 1 rle with old method : 0.037394046783447266 length of segment : 363 time for calcul the mask position with numpy : 0.001134634017944336 nb_pixel_total : 33522 time to create 1 rle with old method : 0.04114866256713867 length of segment : 171 time for calcul the mask position with numpy : 0.0011739730834960938 nb_pixel_total : 20643 time to create 1 rle with old method : 0.026166439056396484 length of segment : 143 time for calcul the mask position with numpy : 0.007108449935913086 nb_pixel_total : 160196 time to create 1 rle with new method : 0.013430595397949219 length of segment : 486 time for calcul the mask position with numpy : 0.0014564990997314453 nb_pixel_total : 25085 time to create 1 rle with old method : 0.03312540054321289 length of segment : 214 time for calcul the mask position with numpy : 0.0033304691314697266 nb_pixel_total : 72892 time to create 1 rle with old method : 0.09874391555786133 length of segment : 301 time for calcul the mask position with numpy : 0.0008215904235839844 nb_pixel_total : 6351 time to create 1 rle with old method : 0.007899284362792969 length of segment : 160 time for calcul the mask position with numpy : 0.0020487308502197266 nb_pixel_total : 33586 time to create 1 rle with old method : 0.041735172271728516 length of segment : 272 time for calcul the mask position with numpy : 0.0009927749633789062 nb_pixel_total : 9890 time to create 1 rle with old method : 0.012022256851196289 length of segment : 121 time for calcul the mask position with numpy : 0.0056781768798828125 nb_pixel_total : 127096 time to create 1 rle with old method : 0.15234947204589844 length of segment : 599 time for calcul the mask position with numpy : 0.002668142318725586 nb_pixel_total : 60506 time to create 1 rle with old method : 0.07088398933410645 length of segment : 449 time for calcul the mask position with numpy : 0.006858110427856445 nb_pixel_total : 178475 time to create 1 rle with new method : 0.012563228607177734 length of segment : 665 time for calcul the mask position with numpy : 0.0006856918334960938 nb_pixel_total : 9757 time to create 1 rle with old method : 0.011751890182495117 length of segment : 125 time for calcul the mask position with numpy : 0.00410008430480957 nb_pixel_total : 75138 time to create 1 rle with old method : 0.09827542304992676 length of segment : 451 time for calcul the mask position with numpy : 0.0004942417144775391 nb_pixel_total : 9051 time to create 1 rle with old method : 0.011821746826171875 length of segment : 87 time for calcul the mask position with numpy : 0.0013229846954345703 nb_pixel_total : 19882 time to create 1 rle with old method : 0.02527475357055664 length of segment : 139 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 5414 time to create 1 rle with old method : 0.006860256195068359 length of segment : 65 time for calcul the mask position with numpy : 0.01465296745300293 nb_pixel_total : 287676 time to create 1 rle with new method : 0.023410320281982422 length of segment : 513 time for calcul the mask position with numpy : 0.0008854866027832031 nb_pixel_total : 18992 time to create 1 rle with old method : 0.02241802215576172 length of segment : 147 time for calcul the mask position with numpy : 0.00382232666015625 nb_pixel_total : 79243 time to create 1 rle with old method : 0.09406828880310059 length of segment : 280 time for calcul the mask position with numpy : 0.0015521049499511719 nb_pixel_total : 34813 time to create 1 rle with old method : 0.041689395904541016 length of segment : 213 time for calcul the mask position with numpy : 0.0018262863159179688 nb_pixel_total : 30323 time to create 1 rle with old method : 0.04878568649291992 length of segment : 218 time for calcul the mask position with numpy : 0.0019989013671875 nb_pixel_total : 36490 time to create 1 rle with old method : 0.043729305267333984 length of segment : 362 time for calcul the mask position with numpy : 0.0006120204925537109 nb_pixel_total : 9018 time to create 1 rle with old method : 0.011241674423217773 length of segment : 89 time for calcul the mask position with numpy : 0.0003905296325683594 nb_pixel_total : 7101 time to create 1 rle with old method : 0.008894920349121094 length of segment : 76 time for calcul the mask position with numpy : 0.0005309581756591797 nb_pixel_total : 6884 time to create 1 rle with old method : 0.008651971817016602 length of segment : 114 time for calcul the mask position with numpy : 0.0007183551788330078 nb_pixel_total : 12763 time to create 1 rle with old method : 0.015471696853637695 length of segment : 132 time for calcul the mask position with numpy : 0.002543210983276367 nb_pixel_total : 81786 time to create 1 rle with old method : 0.0963895320892334 length of segment : 252 time for calcul the mask position with numpy : 0.003805398941040039 nb_pixel_total : 82909 time to create 1 rle with old method : 0.0996389389038086 length of segment : 338 time for calcul the mask position with numpy : 0.0003230571746826172 nb_pixel_total : 7680 time to create 1 rle with old method : 0.00945901870727539 length of segment : 110 time for calcul the mask position with numpy : 0.0006148815155029297 nb_pixel_total : 11468 time to create 1 rle with old method : 0.014042139053344727 length of segment : 157 time for calcul the mask position with numpy : 0.0008723735809326172 nb_pixel_total : 16242 time to create 1 rle with old method : 0.019315481185913086 length of segment : 131 time for calcul the mask position with numpy : 0.0033309459686279297 nb_pixel_total : 79288 time to create 1 rle with old method : 0.09130263328552246 length of segment : 319 time for calcul the mask position with numpy : 0.0009362697601318359 nb_pixel_total : 18314 time to create 1 rle with old method : 0.022866010665893555 length of segment : 191 time for calcul the mask position with numpy : 0.0017230510711669922 nb_pixel_total : 55203 time to create 1 rle with old method : 0.06169295310974121 length of segment : 304 time for calcul the mask position with numpy : 0.0004937648773193359 nb_pixel_total : 12192 time to create 1 rle with old method : 0.014604330062866211 length of segment : 93 time for calcul the mask position with numpy : 0.003221273422241211 nb_pixel_total : 94338 time to create 1 rle with old method : 0.11183786392211914 length of segment : 345 time for calcul the mask position with numpy : 0.001247406005859375 nb_pixel_total : 28305 time to create 1 rle with old method : 0.03349709510803223 length of segment : 212 time for calcul the mask position with numpy : 0.0007643699645996094 nb_pixel_total : 15465 time to create 1 rle with old method : 0.018558263778686523 length of segment : 147 time for calcul the mask position with numpy : 0.003684520721435547 nb_pixel_total : 86221 time to create 1 rle with old method : 0.10086488723754883 length of segment : 257 time for calcul the mask position with numpy : 0.0010859966278076172 nb_pixel_total : 20702 time to create 1 rle with old method : 0.02637004852294922 length of segment : 358 time for calcul the mask position with numpy : 0.0009615421295166016 nb_pixel_total : 24594 time to create 1 rle with old method : 0.02923750877380371 length of segment : 187 time for calcul the mask position with numpy : 0.00018906593322753906 nb_pixel_total : 5042 time to create 1 rle with old method : 0.005859375 length of segment : 85 time for calcul the mask position with numpy : 0.0016231536865234375 nb_pixel_total : 45199 time to create 1 rle with old method : 0.05326032638549805 length of segment : 213 time for calcul the mask position with numpy : 0.05041670799255371 nb_pixel_total : 613678 time to create 1 rle with new method : 0.060242414474487305 length of segment : 995 time for calcul the mask position with numpy : 0.0026710033416748047 nb_pixel_total : 54592 time to create 1 rle with old method : 0.06357932090759277 length of segment : 293 time for calcul the mask position with numpy : 0.011337757110595703 nb_pixel_total : 323818 time to create 1 rle with new method : 0.030042409896850586 length of segment : 1236 time for calcul the mask position with numpy : 0.00044846534729003906 nb_pixel_total : 12904 time to create 1 rle with old method : 0.014615774154663086 length of segment : 109 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 13472 time to create 1 rle with old method : 0.015881776809692383 length of segment : 115 time for calcul the mask position with numpy : 0.0015234947204589844 nb_pixel_total : 49449 time to create 1 rle with old method : 0.05622529983520508 length of segment : 291 time for calcul the mask position with numpy : 0.0007853507995605469 nb_pixel_total : 23803 time to create 1 rle with old method : 0.02823781967163086 length of segment : 187 time for calcul the mask position with numpy : 0.0006337165832519531 nb_pixel_total : 25539 time to create 1 rle with old method : 0.0296480655670166 length of segment : 145 time for calcul the mask position with numpy : 0.0012755393981933594 nb_pixel_total : 41907 time to create 1 rle with old method : 0.04857039451599121 length of segment : 386 time for calcul the mask position with numpy : 0.0006177425384521484 nb_pixel_total : 15957 time to create 1 rle with old method : 0.019218921661376953 length of segment : 146 time for calcul the mask position with numpy : 0.0002288818359375 nb_pixel_total : 4677 time to create 1 rle with old method : 0.005881309509277344 length of segment : 79 time for calcul the mask position with numpy : 0.0031104087829589844 nb_pixel_total : 125006 time to create 1 rle with old method : 0.14466094970703125 length of segment : 381 time for calcul the mask position with numpy : 0.0008878707885742188 nb_pixel_total : 31121 time to create 1 rle with old method : 0.03590059280395508 length of segment : 225 time for calcul the mask position with numpy : 0.0002105236053466797 nb_pixel_total : 5768 time to create 1 rle with old method : 0.007038593292236328 length of segment : 116 time for calcul the mask position with numpy : 0.00025653839111328125 nb_pixel_total : 5753 time to create 1 rle with old method : 0.0071544647216796875 length of segment : 100 time for calcul the mask position with numpy : 0.002963542938232422 nb_pixel_total : 129663 time to create 1 rle with old method : 0.15410280227661133 length of segment : 497 time for calcul the mask position with numpy : 0.00042510032653808594 nb_pixel_total : 8059 time to create 1 rle with old method : 0.009840011596679688 length of segment : 128 time for calcul the mask position with numpy : 0.004389286041259766 nb_pixel_total : 166704 time to create 1 rle with new method : 0.008049249649047852 length of segment : 506 time for calcul the mask position with numpy : 0.0006642341613769531 nb_pixel_total : 21745 time to create 1 rle with old method : 0.026551246643066406 length of segment : 166 time for calcul the mask position with numpy : 0.0024487972259521484 nb_pixel_total : 73780 time to create 1 rle with old method : 0.08726119995117188 length of segment : 379 time for calcul the mask position with numpy : 0.0010080337524414062 nb_pixel_total : 24882 time to create 1 rle with old method : 0.03297924995422363 length of segment : 196 time for calcul the mask position with numpy : 0.0007123947143554688 nb_pixel_total : 20797 time to create 1 rle with old method : 0.02482008934020996 length of segment : 216 time for calcul the mask position with numpy : 0.0036537647247314453 nb_pixel_total : 105229 time to create 1 rle with old method : 0.1378481388092041 length of segment : 437 time for calcul the mask position with numpy : 0.0006215572357177734 nb_pixel_total : 10348 time to create 1 rle with old method : 0.01213836669921875 length of segment : 229 time for calcul the mask position with numpy : 0.000926971435546875 nb_pixel_total : 32455 time to create 1 rle with old method : 0.03911924362182617 length of segment : 182 time for calcul the mask position with numpy : 0.0007331371307373047 nb_pixel_total : 24572 time to create 1 rle with old method : 0.0381317138671875 length of segment : 165 time for calcul the mask position with numpy : 0.0004553794860839844 nb_pixel_total : 7941 time to create 1 rle with old method : 0.010029077529907227 length of segment : 102 time for calcul the mask position with numpy : 0.0028722286224365234 nb_pixel_total : 99398 time to create 1 rle with old method : 0.13603854179382324 length of segment : 347 time for calcul the mask position with numpy : 0.002814054489135742 nb_pixel_total : 53722 time to create 1 rle with old method : 0.06435966491699219 length of segment : 402 time for calcul the mask position with numpy : 0.0007004737854003906 nb_pixel_total : 15920 time to create 1 rle with old method : 0.019382715225219727 length of segment : 132 time for calcul the mask position with numpy : 0.0010874271392822266 nb_pixel_total : 27154 time to create 1 rle with old method : 0.03249502182006836 length of segment : 207 time for calcul the mask position with numpy : 0.0007119178771972656 nb_pixel_total : 12604 time to create 1 rle with old method : 0.01531982421875 length of segment : 173 time for calcul the mask position with numpy : 0.0008859634399414062 nb_pixel_total : 6518 time to create 1 rle with old method : 0.008025884628295898 length of segment : 196 time for calcul the mask position with numpy : 0.001810312271118164 nb_pixel_total : 44909 time to create 1 rle with old method : 0.0537111759185791 length of segment : 226 time for calcul the mask position with numpy : 0.0004646778106689453 nb_pixel_total : 10817 time to create 1 rle with old method : 0.013409614562988281 length of segment : 94 time for calcul the mask position with numpy : 0.0008678436279296875 nb_pixel_total : 18776 time to create 1 rle with old method : 0.023221731185913086 length of segment : 123 time for calcul the mask position with numpy : 0.0016167163848876953 nb_pixel_total : 37754 time to create 1 rle with old method : 0.044855356216430664 length of segment : 515 time for calcul the mask position with numpy : 0.0017063617706298828 nb_pixel_total : 41350 time to create 1 rle with old method : 0.04992842674255371 length of segment : 291 time for calcul the mask position with numpy : 0.0017936229705810547 nb_pixel_total : 49907 time to create 1 rle with old method : 0.05923891067504883 length of segment : 430 time for calcul the mask position with numpy : 0.00057220458984375 nb_pixel_total : 13137 time to create 1 rle with old method : 0.01601099967956543 length of segment : 131 time for calcul the mask position with numpy : 0.001569509506225586 nb_pixel_total : 40475 time to create 1 rle with old method : 0.050687313079833984 length of segment : 227 time for calcul the mask position with numpy : 0.000507354736328125 nb_pixel_total : 13431 time to create 1 rle with old method : 0.015619277954101562 length of segment : 90 time for calcul the mask position with numpy : 0.001007080078125 nb_pixel_total : 25211 time to create 1 rle with old method : 0.029451370239257812 length of segment : 235 time for calcul the mask position with numpy : 0.0003814697265625 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0017499923706054688 length of segment : 100 time for calcul the mask position with numpy : 0.0046918392181396484 nb_pixel_total : 126365 time to create 1 rle with old method : 0.14804482460021973 length of segment : 441 time for calcul the mask position with numpy : 0.00037860870361328125 nb_pixel_total : 7838 time to create 1 rle with old method : 0.00964045524597168 length of segment : 86 time for calcul the mask position with numpy : 0.0035245418548583984 nb_pixel_total : 79429 time to create 1 rle with old method : 0.09464597702026367 length of segment : 369 time for calcul the mask position with numpy : 0.0044803619384765625 nb_pixel_total : 74869 time to create 1 rle with old method : 0.08664441108703613 length of segment : 594 time for calcul the mask position with numpy : 0.0036191940307617188 nb_pixel_total : 92379 time to create 1 rle with old method : 0.10797381401062012 length of segment : 252 time for calcul the mask position with numpy : 0.0004909038543701172 nb_pixel_total : 12263 time to create 1 rle with old method : 0.014382600784301758 length of segment : 117 time for calcul the mask position with numpy : 0.0006935596466064453 nb_pixel_total : 17518 time to create 1 rle with old method : 0.02052783966064453 length of segment : 322 time for calcul the mask position with numpy : 0.00026869773864746094 nb_pixel_total : 14001 time to create 1 rle with old method : 0.016892433166503906 length of segment : 135 time for calcul the mask position with numpy : 0.0006494522094726562 nb_pixel_total : 11703 time to create 1 rle with old method : 0.014605998992919922 length of segment : 76 time spent for convertir_results : 14.277737855911255 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 159 chid ids of type : 3594 Number RLEs to save : 44661 save missing photos in datou_result : time spend for datou_step_exec : 86.38796496391296 time spend to save output : 2.9522228240966797 total time spend for step 1 : 89.34018778800964 step2:crop_condition Thu Apr 24 04:42:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 159 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 89 About to insert : list_path_to_insert length 89 new photo from crops ! About to upload 89 photos upload in portfolio : 3736932 init cache_photo without model_param we have 89 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745462541_2057576 we have uploaded 89 photos in the portfolio 3736932 time of upload the photos Elapsed time : 32.43934679031372 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745462578_2057576 we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.169622898101807 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3736932 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745462602_2057576 we have uploaded 40 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.643558025360107 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745462616_2057576 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.6831958293914795 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745462620_2057576 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5962042808532715 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745462622_2057576 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6843628883361816 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1353176303, 1353176145, 1353176140, 1353176137, 1352947225, 1352947220, 1352947217, 1352947084] Looping around the photos to save general results len do output : 159 /1353264444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353264695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176303', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176145', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176140', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176137', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947225', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947220', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947217', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947084', None, None, None, None, None, '2755470') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 485 time used for this insertion : 0.033843994140625 save_final save missing photos in datou_result : time spend for datou_step_exec : 101.45821928977966 time spend to save output : 0.0385737419128418 total time spend for step 2 : 101.4967930316925 step3:rle_unique_nms_with_priority Thu Apr 24 04:43:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 159 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 6.168069839477539 time for calcul the mask position with numpy : 0.601248025894165 nb_pixel_total : 6116552 time to create 1 rle with new method : 0.5417397022247314 time for calcul the mask position with numpy : 0.03670930862426758 nb_pixel_total : 157415 time to create 1 rle with new method : 0.6812458038330078 time for calcul the mask position with numpy : 0.02867293357849121 nb_pixel_total : 9738 time to create 1 rle with old method : 0.012068510055541992 time for calcul the mask position with numpy : 0.024523258209228516 nb_pixel_total : 69736 time to create 1 rle with old method : 0.08347058296203613 time for calcul the mask position with numpy : 0.021645784378051758 nb_pixel_total : 29026 time to create 1 rle with old method : 0.03416585922241211 time for calcul the mask position with numpy : 0.023636579513549805 nb_pixel_total : 91893 time to create 1 rle with old method : 0.1091909408569336 time for calcul the mask position with numpy : 0.021251678466796875 nb_pixel_total : 24723 time to create 1 rle with old method : 0.028649330139160156 time for calcul the mask position with numpy : 0.02259087562561035 nb_pixel_total : 13610 time to create 1 rle with old method : 0.016662120819091797 time for calcul the mask position with numpy : 0.02357769012451172 nb_pixel_total : 68780 time to create 1 rle with old method : 0.07902956008911133 time for calcul the mask position with numpy : 0.022137880325317383 nb_pixel_total : 55992 time to create 1 rle with old method : 0.06382083892822266 time for calcul the mask position with numpy : 0.020785093307495117 nb_pixel_total : 33998 time to create 1 rle with old method : 0.037485361099243164 time for calcul the mask position with numpy : 0.02602839469909668 nb_pixel_total : 12395 time to create 1 rle with old method : 0.013906002044677734 time for calcul the mask position with numpy : 0.02303481101989746 nb_pixel_total : 127929 time to create 1 rle with old method : 0.14571189880371094 time for calcul the mask position with numpy : 0.02341747283935547 nb_pixel_total : 89087 time to create 1 rle with old method : 0.10045814514160156 time for calcul the mask position with numpy : 0.02691650390625 nb_pixel_total : 8921 time to create 1 rle with old method : 0.010232686996459961 time for calcul the mask position with numpy : 0.0232694149017334 nb_pixel_total : 140445 time to create 1 rle with old method : 0.16070771217346191 create new chi : 3.1488208770751953 time to delete rle : 0.01878976821899414 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12205 TO DO : save crop sub photo not yet done ! save time : 0.8808174133300781 nb_obj : 25 nb_hashtags : 4 time to prepare the origin masks : 9.986113786697388 time for calcul the mask position with numpy : 0.44058990478515625 nb_pixel_total : 5868302 time to create 1 rle with new method : 0.9543285369873047 time for calcul the mask position with numpy : 0.023868322372436523 nb_pixel_total : 71627 time to create 1 rle with old method : 0.09408068656921387 time for calcul the mask position with numpy : 0.0295259952545166 nb_pixel_total : 45905 time to create 1 rle with old method : 0.07011675834655762 time for calcul the mask position with numpy : 0.025064945220947266 nb_pixel_total : 87384 time to create 1 rle with old method : 0.12857770919799805 time for calcul the mask position with numpy : 0.023908376693725586 nb_pixel_total : 45791 time to create 1 rle with old method : 0.05531764030456543 time for calcul the mask position with numpy : 0.02445077896118164 nb_pixel_total : 83722 time to create 1 rle with old method : 0.12345147132873535 time for calcul the mask position with numpy : 0.024394989013671875 nb_pixel_total : 4009 time to create 1 rle with old method : 0.004804372787475586 time for calcul the mask position with numpy : 0.02289748191833496 nb_pixel_total : 186971 time to create 1 rle with new method : 0.8135280609130859 time for calcul the mask position with numpy : 0.022599220275878906 nb_pixel_total : 28958 time to create 1 rle with old method : 0.03426241874694824 time for calcul the mask position with numpy : 0.024212121963500977 nb_pixel_total : 44696 time to create 1 rle with old method : 0.0530543327331543 time for calcul the mask position with numpy : 0.024243593215942383 nb_pixel_total : 43692 time to create 1 rle with old method : 0.05089545249938965 time for calcul the mask position with numpy : 0.023175477981567383 nb_pixel_total : 29662 time to create 1 rle with old method : 0.0349583625793457 time for calcul the mask position with numpy : 0.02330303192138672 nb_pixel_total : 31945 time to create 1 rle with old method : 0.03786134719848633 time for calcul the mask position with numpy : 0.023817062377929688 nb_pixel_total : 87552 time to create 1 rle with old method : 0.10260224342346191 time for calcul the mask position with numpy : 0.022423267364501953 nb_pixel_total : 17956 time to create 1 rle with old method : 0.021161556243896484 time for calcul the mask position with numpy : 0.023632049560546875 nb_pixel_total : 78759 time to create 1 rle with old method : 0.09329962730407715 time for calcul the mask position with numpy : 0.022371768951416016 nb_pixel_total : 30479 time to create 1 rle with old method : 0.03589439392089844 time for calcul the mask position with numpy : 0.023407697677612305 nb_pixel_total : 5683 time to create 1 rle with old method : 0.006840229034423828 time for calcul the mask position with numpy : 0.023996353149414062 nb_pixel_total : 11183 time to create 1 rle with old method : 0.01310110092163086 time for calcul the mask position with numpy : 0.02303600311279297 nb_pixel_total : 18450 time to create 1 rle with old method : 0.021718502044677734 time for calcul the mask position with numpy : 0.022451162338256836 nb_pixel_total : 14143 time to create 1 rle with old method : 0.01636362075805664 time for calcul the mask position with numpy : 0.02123570442199707 nb_pixel_total : 34702 time to create 1 rle with old method : 0.04009509086608887 time for calcul the mask position with numpy : 0.022547245025634766 nb_pixel_total : 4051 time to create 1 rle with old method : 0.0048139095306396484 time for calcul the mask position with numpy : 0.02241826057434082 nb_pixel_total : 26093 time to create 1 rle with old method : 0.030458688735961914 time for calcul the mask position with numpy : 0.023751258850097656 nb_pixel_total : 34042 time to create 1 rle with old method : 0.040018558502197266 time for calcul the mask position with numpy : 0.026486873626708984 nb_pixel_total : 114483 time to create 1 rle with old method : 0.1391897201538086 create new chi : 4.124589443206787 time to delete rle : 0.0025801658630371094 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16694 TO DO : save crop sub photo not yet done ! save time : 1.0620067119598389 nb_obj : 24 nb_hashtags : 3 time to prepare the origin masks : 8.450808763504028 time for calcul the mask position with numpy : 0.534860372543335 nb_pixel_total : 5673083 time to create 1 rle with new method : 0.4525928497314453 time for calcul the mask position with numpy : 0.02069854736328125 nb_pixel_total : 33522 time to create 1 rle with old method : 0.038865089416503906 time for calcul the mask position with numpy : 0.027310609817504883 nb_pixel_total : 31125 time to create 1 rle with old method : 0.03512167930603027 time for calcul the mask position with numpy : 0.030951976776123047 nb_pixel_total : 350591 time to create 1 rle with new method : 0.735558271408081 time for calcul the mask position with numpy : 0.020661354064941406 nb_pixel_total : 6662 time to create 1 rle with old method : 0.007750988006591797 time for calcul the mask position with numpy : 0.0207822322845459 nb_pixel_total : 46019 time to create 1 rle with old method : 0.05714607238769531 time for calcul the mask position with numpy : 0.024215221405029297 nb_pixel_total : 7344 time to create 1 rle with old method : 0.008249998092651367 time for calcul the mask position with numpy : 0.021975278854370117 nb_pixel_total : 194546 time to create 1 rle with new method : 1.089961290359497 time for calcul the mask position with numpy : 0.021692752838134766 nb_pixel_total : 16591 time to create 1 rle with old method : 0.018726110458374023 time for calcul the mask position with numpy : 0.020601987838745117 nb_pixel_total : 5997 time to create 1 rle with old method : 0.006703853607177734 time for calcul the mask position with numpy : 0.01990652084350586 nb_pixel_total : 19893 time to create 1 rle with old method : 0.02194666862487793 time for calcul the mask position with numpy : 0.020279407501220703 nb_pixel_total : 12416 time to create 1 rle with old method : 0.013701915740966797 time for calcul the mask position with numpy : 0.020011425018310547 nb_pixel_total : 13373 time to create 1 rle with old method : 0.014423131942749023 time for calcul the mask position with numpy : 0.020015239715576172 nb_pixel_total : 19482 time to create 1 rle with old method : 0.02099013328552246 time for calcul the mask position with numpy : 0.02132272720336914 nb_pixel_total : 83305 time to create 1 rle with old method : 0.09070992469787598 time for calcul the mask position with numpy : 0.020751476287841797 nb_pixel_total : 143496 time to create 1 rle with old method : 0.15774178504943848 time for calcul the mask position with numpy : 0.02114081382751465 nb_pixel_total : 22106 time to create 1 rle with old method : 0.024479389190673828 time for calcul the mask position with numpy : 0.023119688034057617 nb_pixel_total : 124320 time to create 1 rle with old method : 0.14188098907470703 time for calcul the mask position with numpy : 0.021509408950805664 nb_pixel_total : 13617 time to create 1 rle with old method : 0.015335559844970703 time for calcul the mask position with numpy : 0.02088451385498047 nb_pixel_total : 51239 time to create 1 rle with old method : 0.05800437927246094 time for calcul the mask position with numpy : 0.021409273147583008 nb_pixel_total : 27812 time to create 1 rle with old method : 0.03148984909057617 time for calcul the mask position with numpy : 0.020682811737060547 nb_pixel_total : 53607 time to create 1 rle with old method : 0.06255912780761719 time for calcul the mask position with numpy : 0.022815465927124023 nb_pixel_total : 28527 time to create 1 rle with old method : 0.033360958099365234 time for calcul the mask position with numpy : 0.022275209426879883 nb_pixel_total : 49765 time to create 1 rle with old method : 0.0579991340637207 time for calcul the mask position with numpy : 0.022161006927490234 nb_pixel_total : 21802 time to create 1 rle with old method : 0.025387048721313477 create new chi : 4.3651533126831055 time to delete rle : 0.0022373199462890625 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 16987 TO DO : save crop sub photo not yet done ! save time : 1.1537177562713623 nb_obj : 28 nb_hashtags : 4 time to prepare the origin masks : 4.580214023590088 time for calcul the mask position with numpy : 0.8479499816894531 nb_pixel_total : 5540722 time to create 1 rle with new method : 1.0051488876342773 time for calcul the mask position with numpy : 0.029698610305786133 nb_pixel_total : 18992 time to create 1 rle with old method : 0.02225971221923828 time for calcul the mask position with numpy : 0.029329776763916016 nb_pixel_total : 20643 time to create 1 rle with old method : 0.0258486270904541 time for calcul the mask position with numpy : 0.029191970825195312 nb_pixel_total : 72892 time to create 1 rle with old method : 0.08851146697998047 time for calcul the mask position with numpy : 0.028872966766357422 nb_pixel_total : 33586 time to create 1 rle with old method : 0.03912091255187988 time for calcul the mask position with numpy : 0.029572010040283203 nb_pixel_total : 127096 time to create 1 rle with old method : 0.14810633659362793 time for calcul the mask position with numpy : 0.03027033805847168 nb_pixel_total : 178353 time to create 1 rle with new method : 0.5785543918609619 time for calcul the mask position with numpy : 0.028140544891357422 nb_pixel_total : 19882 time to create 1 rle with old method : 0.022891521453857422 time for calcul the mask position with numpy : 0.029142141342163086 nb_pixel_total : 160196 time to create 1 rle with new method : 0.5565624237060547 time for calcul the mask position with numpy : 0.028070688247680664 nb_pixel_total : 7101 time to create 1 rle with old method : 0.008202314376831055 time for calcul the mask position with numpy : 0.02768564224243164 nb_pixel_total : 6351 time to create 1 rle with old method : 0.009022712707519531 time for calcul the mask position with numpy : 0.027739763259887695 nb_pixel_total : 34813 time to create 1 rle with old method : 0.038819313049316406 time for calcul the mask position with numpy : 0.02805781364440918 nb_pixel_total : 82909 time to create 1 rle with old method : 0.09262609481811523 time for calcul the mask position with numpy : 0.027780771255493164 nb_pixel_total : 60506 time to create 1 rle with old method : 0.06755781173706055 time for calcul the mask position with numpy : 0.0279388427734375 nb_pixel_total : 7680 time to create 1 rle with old method : 0.008874177932739258 time for calcul the mask position with numpy : 0.027668237686157227 nb_pixel_total : 79243 time to create 1 rle with old method : 0.09058427810668945 time for calcul the mask position with numpy : 0.029107332229614258 nb_pixel_total : 9051 time to create 1 rle with old method : 0.01061868667602539 time for calcul the mask position with numpy : 0.02870011329650879 nb_pixel_total : 30323 time to create 1 rle with old method : 0.03522944450378418 time for calcul the mask position with numpy : 0.02881598472595215 nb_pixel_total : 9018 time to create 1 rle with old method : 0.010574817657470703 time for calcul the mask position with numpy : 0.028354883193969727 nb_pixel_total : 36490 time to create 1 rle with old method : 0.04164719581604004 time for calcul the mask position with numpy : 0.028419971466064453 nb_pixel_total : 9890 time to create 1 rle with old method : 0.011239290237426758 time for calcul the mask position with numpy : 0.028621673583984375 nb_pixel_total : 81786 time to create 1 rle with old method : 0.09553050994873047 time for calcul the mask position with numpy : 0.034026384353637695 nb_pixel_total : 75138 time to create 1 rle with old method : 0.10330533981323242 time for calcul the mask position with numpy : 0.031981706619262695 nb_pixel_total : 287676 time to create 1 rle with new method : 0.5799601078033447 time for calcul the mask position with numpy : 0.0282900333404541 nb_pixel_total : 9757 time to create 1 rle with old method : 0.011246681213378906 time for calcul the mask position with numpy : 0.02815723419189453 nb_pixel_total : 12763 time to create 1 rle with old method : 0.014662981033325195 time for calcul the mask position with numpy : 0.028167009353637695 nb_pixel_total : 6884 time to create 1 rle with old method : 0.007880926132202148 time for calcul the mask position with numpy : 0.02756786346435547 nb_pixel_total : 25085 time to create 1 rle with old method : 0.028775930404663086 time for calcul the mask position with numpy : 0.027927398681640625 nb_pixel_total : 5414 time to create 1 rle with old method : 0.006165027618408203 create new chi : 5.53069806098938 time to delete rle : 0.0024285316467285156 batch 1 Loaded 57 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 16380 TO DO : save crop sub photo not yet done ! save time : 1.0674238204956055 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 5.6328325271606445 time for calcul the mask position with numpy : 0.3251218795776367 nb_pixel_total : 5545579 time to create 1 rle with new method : 0.9242420196533203 time for calcul the mask position with numpy : 0.022176265716552734 nb_pixel_total : 323818 time to create 1 rle with new method : 0.7246999740600586 time for calcul the mask position with numpy : 0.021500110626220703 nb_pixel_total : 54592 time to create 1 rle with old method : 0.06241178512573242 time for calcul the mask position with numpy : 0.025979042053222656 nb_pixel_total : 613678 time to create 1 rle with new method : 0.9456772804260254 time for calcul the mask position with numpy : 0.021820783615112305 nb_pixel_total : 45199 time to create 1 rle with old method : 0.0519099235534668 time for calcul the mask position with numpy : 0.024621248245239258 nb_pixel_total : 5042 time to create 1 rle with old method : 0.0056722164154052734 time for calcul the mask position with numpy : 0.021150588989257812 nb_pixel_total : 24594 time to create 1 rle with old method : 0.029262065887451172 time for calcul the mask position with numpy : 0.022252559661865234 nb_pixel_total : 20702 time to create 1 rle with old method : 0.024100065231323242 time for calcul the mask position with numpy : 0.022250652313232422 nb_pixel_total : 86221 time to create 1 rle with old method : 0.09660816192626953 time for calcul the mask position with numpy : 0.02202129364013672 nb_pixel_total : 15465 time to create 1 rle with old method : 0.017611980438232422 time for calcul the mask position with numpy : 0.020476579666137695 nb_pixel_total : 28305 time to create 1 rle with old method : 0.032636165618896484 time for calcul the mask position with numpy : 0.020348072052001953 nb_pixel_total : 94338 time to create 1 rle with old method : 0.10504603385925293 time for calcul the mask position with numpy : 0.020826101303100586 nb_pixel_total : 12192 time to create 1 rle with old method : 0.013791561126708984 time for calcul the mask position with numpy : 0.02120351791381836 nb_pixel_total : 55203 time to create 1 rle with old method : 0.06268095970153809 time for calcul the mask position with numpy : 0.020137786865234375 nb_pixel_total : 18314 time to create 1 rle with old method : 0.021048784255981445 time for calcul the mask position with numpy : 0.022003650665283203 nb_pixel_total : 79288 time to create 1 rle with old method : 0.09002542495727539 time for calcul the mask position with numpy : 0.021317481994628906 nb_pixel_total : 16242 time to create 1 rle with old method : 0.01822829246520996 time for calcul the mask position with numpy : 0.021538496017456055 nb_pixel_total : 11468 time to create 1 rle with old method : 0.018775463104248047 create new chi : 4.016113996505737 time to delete rle : 0.0021724700927734375 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 13206 TO DO : save crop sub photo not yet done ! save time : 0.7676920890808105 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.131208658218384 time for calcul the mask position with numpy : 0.5308856964111328 nb_pixel_total : 6558379 time to create 1 rle with new method : 1.0513744354248047 time for calcul the mask position with numpy : 0.03618979454040527 nb_pixel_total : 8059 time to create 1 rle with old method : 0.013640403747558594 time for calcul the mask position with numpy : 0.0409696102142334 nb_pixel_total : 128446 time to create 1 rle with old method : 0.15234088897705078 time for calcul the mask position with numpy : 0.03400087356567383 nb_pixel_total : 5753 time to create 1 rle with old method : 0.0066547393798828125 time for calcul the mask position with numpy : 0.03534746170043945 nb_pixel_total : 5768 time to create 1 rle with old method : 0.006812334060668945 time for calcul the mask position with numpy : 0.034197092056274414 nb_pixel_total : 31121 time to create 1 rle with old method : 0.03726005554199219 time for calcul the mask position with numpy : 0.0319216251373291 nb_pixel_total : 125006 time to create 1 rle with old method : 0.14385604858398438 time for calcul the mask position with numpy : 0.0304718017578125 nb_pixel_total : 4677 time to create 1 rle with old method : 0.005540132522583008 time for calcul the mask position with numpy : 0.034500837326049805 nb_pixel_total : 15957 time to create 1 rle with old method : 0.018414974212646484 time for calcul the mask position with numpy : 0.033829450607299805 nb_pixel_total : 41907 time to create 1 rle with old method : 0.046952247619628906 time for calcul the mask position with numpy : 0.03312253952026367 nb_pixel_total : 25539 time to create 1 rle with old method : 0.028724193572998047 time for calcul the mask position with numpy : 0.03345966339111328 nb_pixel_total : 23803 time to create 1 rle with old method : 0.030729055404663086 time for calcul the mask position with numpy : 0.03366732597351074 nb_pixel_total : 49449 time to create 1 rle with old method : 0.05765056610107422 time for calcul the mask position with numpy : 0.0340428352355957 nb_pixel_total : 13472 time to create 1 rle with old method : 0.015459299087524414 time for calcul the mask position with numpy : 0.03335857391357422 nb_pixel_total : 12904 time to create 1 rle with old method : 0.014492511749267578 create new chi : 2.6779704093933105 time to delete rle : 0.0011754035949707031 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 7917 TO DO : save crop sub photo not yet done ! save time : 0.49852824211120605 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 3.7867350578308105 time for calcul the mask position with numpy : 0.4835326671600342 nb_pixel_total : 6462389 time to create 1 rle with new method : 0.9157702922821045 time for calcul the mask position with numpy : 0.0221865177154541 nb_pixel_total : 99398 time to create 1 rle with old method : 0.11170458793640137 time for calcul the mask position with numpy : 0.019710063934326172 nb_pixel_total : 7941 time to create 1 rle with old method : 0.009254932403564453 time for calcul the mask position with numpy : 0.02097344398498535 nb_pixel_total : 24572 time to create 1 rle with old method : 0.0270230770111084 time for calcul the mask position with numpy : 0.028172016143798828 nb_pixel_total : 32455 time to create 1 rle with old method : 0.035726070404052734 time for calcul the mask position with numpy : 0.03230929374694824 nb_pixel_total : 10348 time to create 1 rle with old method : 0.011536598205566406 time for calcul the mask position with numpy : 0.03159952163696289 nb_pixel_total : 105229 time to create 1 rle with old method : 0.12145400047302246 time for calcul the mask position with numpy : 0.02798604965209961 nb_pixel_total : 20797 time to create 1 rle with old method : 0.023404598236083984 time for calcul the mask position with numpy : 0.022487878799438477 nb_pixel_total : 24882 time to create 1 rle with old method : 0.027622461318969727 time for calcul the mask position with numpy : 0.021579980850219727 nb_pixel_total : 73780 time to create 1 rle with old method : 0.07945489883422852 time for calcul the mask position with numpy : 0.020603418350219727 nb_pixel_total : 21745 time to create 1 rle with old method : 0.0231320858001709 time for calcul the mask position with numpy : 0.020994186401367188 nb_pixel_total : 166704 time to create 1 rle with new method : 0.8116471767425537 create new chi : 3.018775463104248 time to delete rle : 0.0012791156768798828 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8010 TO DO : save crop sub photo not yet done ! save time : 0.5758540630340576 nb_obj : 25 nb_hashtags : 4 time to prepare the origin masks : 8.344390153884888 time for calcul the mask position with numpy : 0.6226472854614258 nb_pixel_total : 6214918 time to create 1 rle with new method : 1.070516586303711 time for calcul the mask position with numpy : 0.022840023040771484 nb_pixel_total : 11703 time to create 1 rle with old method : 0.013380289077758789 time for calcul the mask position with numpy : 0.023751258850097656 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003521442413330078 time for calcul the mask position with numpy : 0.022165298461914062 nb_pixel_total : 17518 time to create 1 rle with old method : 0.020074844360351562 time for calcul the mask position with numpy : 0.03452730178833008 nb_pixel_total : 12263 time to create 1 rle with old method : 0.014017581939697266 time for calcul the mask position with numpy : 0.035872697830200195 nb_pixel_total : 92379 time to create 1 rle with old method : 0.11375141143798828 time for calcul the mask position with numpy : 0.033742666244506836 nb_pixel_total : 74869 time to create 1 rle with old method : 0.08443331718444824 time for calcul the mask position with numpy : 0.03310680389404297 nb_pixel_total : 79429 time to create 1 rle with old method : 0.09012246131896973 time for calcul the mask position with numpy : 0.033153533935546875 nb_pixel_total : 7838 time to create 1 rle with old method : 0.008935213088989258 time for calcul the mask position with numpy : 0.0334470272064209 nb_pixel_total : 126365 time to create 1 rle with old method : 0.14803290367126465 time for calcul the mask position with numpy : 0.03287172317504883 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0011959075927734375 time for calcul the mask position with numpy : 0.02123093605041504 nb_pixel_total : 25211 time to create 1 rle with old method : 0.028651714324951172 time for calcul the mask position with numpy : 0.022412776947021484 nb_pixel_total : 13431 time to create 1 rle with old method : 0.01494598388671875 time for calcul the mask position with numpy : 0.021722078323364258 nb_pixel_total : 40475 time to create 1 rle with old method : 0.04468679428100586 time for calcul the mask position with numpy : 0.021745681762695312 nb_pixel_total : 13137 time to create 1 rle with old method : 0.015283346176147461 time for calcul the mask position with numpy : 0.021650314331054688 nb_pixel_total : 49899 time to create 1 rle with old method : 0.05722165107727051 time for calcul the mask position with numpy : 0.02146172523498535 nb_pixel_total : 41350 time to create 1 rle with old method : 0.045458316802978516 time for calcul the mask position with numpy : 0.021391630172729492 nb_pixel_total : 37754 time to create 1 rle with old method : 0.04082822799682617 time for calcul the mask position with numpy : 0.020719528198242188 nb_pixel_total : 18776 time to create 1 rle with old method : 0.020803213119506836 time for calcul the mask position with numpy : 0.020493030548095703 nb_pixel_total : 10817 time to create 1 rle with old method : 0.012467622756958008 time for calcul the mask position with numpy : 0.021064281463623047 nb_pixel_total : 44909 time to create 1 rle with old method : 0.04948544502258301 time for calcul the mask position with numpy : 0.020481586456298828 nb_pixel_total : 6518 time to create 1 rle with old method : 0.007224082946777344 time for calcul the mask position with numpy : 0.02118992805480957 nb_pixel_total : 12604 time to create 1 rle with old method : 0.013857126235961914 time for calcul the mask position with numpy : 0.020635604858398438 nb_pixel_total : 27154 time to create 1 rle with old method : 0.029317855834960938 time for calcul the mask position with numpy : 0.02014636993408203 nb_pixel_total : 15920 time to create 1 rle with old method : 0.017829179763793945 time for calcul the mask position with numpy : 0.020991802215576172 nb_pixel_total : 53722 time to create 1 rle with old method : 0.06560993194580078 create new chi : 3.3128890991210938 time to delete rle : 0.002332448959350586 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 13850 TO DO : save crop sub photo not yet done ! save time : 0.8318109512329102 map_output_result : {1353176303: (0.0, 'Should be the crop_list due to order', 0), 1353176145: (0.0, 'Should be the crop_list due to order', 0), 1353176140: (0.0, 'Should be the crop_list due to order', 0), 1353176137: (0.0, 'Should be the crop_list due to order', 0), 1352947225: (0.0, 'Should be the crop_list due to order', 0), 1352947220: (0.0, 'Should be the crop_list due to order', 0), 1352947217: (0.0, 'Should be the crop_list due to order', 0), 1352947084: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1353176303, 1353176145, 1353176140, 1353176137, 1352947225, 1352947220, 1352947217, 1352947084] Looping around the photos to save general results len do output : 8 /1353176303.Didn't retrieve data . /1353176145.Didn't retrieve data . /1353176140.Didn't retrieve data . /1353176137.Didn't retrieve data . /1352947225.Didn't retrieve data . /1352947220.Didn't retrieve data . /1352947217.Didn't retrieve data . /1352947084.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176303', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176145', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176140', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176137', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947225', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947220', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947217', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947084', None, None, None, None, None, '2755470') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.014456033706665039 save_final save missing photos in datou_result : time spend for datou_step_exec : 90.3976936340332 time spend to save output : 0.014887571334838867 total time spend for step 3 : 90.41258120536804 step4:ventilate_hashtags_in_portfolio Thu Apr 24 04:45:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22366522 get user id for portfolio 22366522 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366522 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','pet_clair','environnement','flou','carton','pehd','background','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366522 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','pet_clair','environnement','flou','carton','pehd','background','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366522 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','pet_clair','environnement','flou','carton','pehd','background','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22367276,22367277,22367278,22367279,22367280,22367281,22367282,22367283,22367284,22367285,22367286?tags=pet_fonce,papier,pet_clair,environnement,flou,carton,pehd,background,autre,metal,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1353176303, 1353176145, 1353176140, 1353176137, 1352947225, 1352947220, 1352947217, 1352947084] Looping around the photos to save general results len do output : 1 /22366522. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176303', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176145', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176140', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176137', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947225', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947220', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947217', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947084', None, None, None, None, None, '2755470') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013937711715698242 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5413167476654053 time spend to save output : 0.014148235321044922 total time spend for step 4 : 1.5554649829864502 step5:final Thu Apr 24 04:45:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1353176303: ('0.14932108694172114',), 1353176145: ('0.14932108694172114',), 1353176140: ('0.14932108694172114',), 1353176137: ('0.14932108694172114',), 1352947225: ('0.14932108694172114',), 1352947220: ('0.14932108694172114',), 1352947217: ('0.14932108694172114',), 1352947084: ('0.14932108694172114',)} new output for save of step final : {1353176303: ('0.14932108694172114',), 1353176145: ('0.14932108694172114',), 1353176140: ('0.14932108694172114',), 1353176137: ('0.14932108694172114',), 1352947225: ('0.14932108694172114',), 1352947220: ('0.14932108694172114',), 1352947217: ('0.14932108694172114',), 1352947084: ('0.14932108694172114',)} [1353176303, 1353176145, 1353176140, 1353176137, 1352947225, 1352947220, 1352947217, 1352947084] Looping around the photos to save general results len do output : 8 /1353176303.Didn't retrieve data . /1353176145.Didn't retrieve data . /1353176140.Didn't retrieve data . /1353176137.Didn't retrieve data . /1352947225.Didn't retrieve data . /1352947220.Didn't retrieve data . /1352947217.Didn't retrieve data . /1352947084.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176303', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176145', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176140', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176137', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947225', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947220', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947217', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947084', None, None, None, None, None, '2755470') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012432336807250977 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1117243766784668 time spend to save output : 0.012886524200439453 total time spend for step 5 : 0.12461090087890625 step6:blur_detection Thu Apr 24 04:45:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a.jpg resize: (2160, 3264) 1353176303 -2.460978378182155 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373.jpg resize: (2160, 3264) 1353176145 -1.7559173911505963 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b.jpg resize: (2160, 3264) 1353176140 -1.1542961196245167 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be.jpg resize: (2160, 3264) 1353176137 -2.8438922480065703 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a.jpg resize: (2160, 3264) 1352947225 -2.7950920288694205 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2.jpg resize: (2160, 3264) 1352947220 -2.4876244826255958 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0.jpg resize: (2160, 3264) 1352947217 -0.5731242649313524 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e.jpg resize: (2160, 3264) 1352947084 -2.2799647762467394 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886156_0.png resize: (574, 346) 1353264444 -0.6855065410460113 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886169_0.png resize: (561, 254) 1353264445 -1.8862752647135246 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886165_0.png resize: (230, 181) 1353264446 -1.6713276263948327 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886160_0.png resize: (134, 132) 1353264447 -1.7719012211786824 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886170_0.png resize: (613, 439) 1353264448 -1.935210866689162 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886176_0.png resize: (135, 135) 1353264449 -0.8274339433426325 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886180_0.png resize: (151, 281) 1353264450 -0.8939929479089841 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886173_0.png resize: (232, 202) 1353264451 -1.2903584886158368 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886185_0.png resize: (224, 238) 1353264452 -1.057871235888096 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886174_0.png resize: (59, 84) 1353264453 1.2727226621774492 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886186_0.png resize: (226, 321) 1353264454 -1.6377816143565846 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886195_0.png resize: (246, 426) 1353264455 -1.7320578251774796 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886171_0.png resize: (482, 323) 1353264457 -1.2077441908641195 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886181_0.png resize: (344, 463) 1353264458 -0.9714688651078297 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886191_0.png resize: (581, 255) 1353264459 -1.4302148678156437 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886190_0.png resize: (76, 79) 1353264460 -1.5908648479907086 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886178_0.png resize: (82, 186) 1353264461 -1.587948468866547 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886179_0.png resize: (199, 108) 1353264462 -1.3606254184803486 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886215_0.png resize: (224, 294) 1353264463 -1.7132969192813332 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886218_0.png resize: (329, 158) 1353264464 -1.9188570168649401 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886217_0.png resize: (863, 574) 1353264465 -1.6582970910528014 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886203_0.png resize: (680, 252) 1353264466 -0.42174487206717265 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886198_0.png resize: (180, 224) 1353264467 0.6284681141440347 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886209_0.png resize: (160, 104) 1353264468 -1.8428658874511528 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886200_0.png resize: (174, 250) 1353264469 -1.691579540158896 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886205_0.png resize: (472, 494) 1353264470 -0.47853202696093844 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886208_0.png resize: (131, 167) 1353264471 -1.0783155203279073 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886204_0.png resize: (197, 196) 1353264472 -2.8059772211233676 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886207_0.png resize: (147, 182) 1353264474 -2.537204251061825 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886206_0.png resize: (486, 367) 1353264475 -0.6765117097030353 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886196_0.png resize: (176, 157) 1353264476 -0.21294756194269146 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886214_0.png resize: (90, 122) 1353264477 -0.6625231884632442 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886202_0.png resize: (141, 155) 1353264478 -0.4807239459334074 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886211_0.png resize: (76, 92) 1353264479 2.8511593455444917 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886219_0.png resize: (158, 296) 1353264480 -1.1858661456803012 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886210_0.png resize: (264, 146) 1353264481 -1.116814662098076 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886227_0.png resize: (596, 276) 1353264482 -1.1262744681859393 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886241_0.png resize: (87, 148) 1353264483 -1.718303416252895 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886223_0.png resize: (300, 349) 1353264484 -0.6571731435767507 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886222_0.png resize: (202, 184) 1353264485 -1.5917521378693307 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886232_0.png resize: (83, 147) 1353264486 -2.146823476910444 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886240_0.png resize: (248, 266) 1353264487 -2.2480165882819434 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886239_0.png resize: (217, 182) 1353264488 -2.0992738664123447 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886226_0.png resize: (119, 121) 1353264489 -0.9954023959487281 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886234_0.png resize: (60, 111) 1353264490 1.7461355153948799 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886238_0.png resize: (213, 228) 1353264491 0.42673570672336814 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886230_0.png resize: (125, 107) 1353264492 -2.1304411835103463 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886244_0.png resize: (132, 147) 1353264493 -2.2437656247060693 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886220_0.png resize: (143, 252) 1353264494 -2.7117045188250732 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886243_0.png resize: (114, 106) 1353264495 -2.488400560583662 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886225_0.png resize: (272, 207) 1353264496 -0.2684660108442568 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886235_0.png resize: (503, 845) 1353264497 -0.5072899327881464 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886224_0.png resize: (136, 106) 1353264498 -1.8072118200448404 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886229_0.png resize: (657, 382) 1353264499 -0.9088258897084492 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886249_0.png resize: (113, 231) 1353264500 -2.0445106723297815 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886256_0.png resize: (147, 161) 1353264501 -1.2828550367180136 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886260_0.png resize: (85, 81) 1353264502 0.09534994245091095 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886255_0.png resize: (212, 223) 1353264503 -0.8709329401442361 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886258_0.png resize: (171, 236) 1353264504 -2.2174451303428633 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886259_0.png resize: (167, 251) 1353264505 -3.02432672054792 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886251_0.png resize: (162, 222) 1353264506 -2.7080239030109565 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886261_0.png resize: (205, 346) 1353264507 -2.650520190025179 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886248_0.png resize: (157, 87) 1353264508 -2.045713005556419 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886277_0.png resize: (494, 342) 1353264509 -0.141094490084688 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886267_0.png resize: (289, 285) 1353264510 -1.3129926918071162 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886272_0.png resize: (77, 89) 1353264511 -1.3626894701216221 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886266_0.png resize: (115, 151) 1353264512 -0.8377049505908548 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886270_0.png resize: (368, 145) 1353264513 -1.4589080693134557 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886275_0.png resize: (116, 63) 1353264514 0.0028925579048872927 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886278_0.png resize: (127, 99) 1353264515 -0.07152073495611443 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886281_0.png resize: (378, 278) 1353264516 -1.192030392083776 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886283_0.png resize: (185, 150) 1353264517 -0.8267723032101516 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886286_0.png resize: (182, 260) 1353264518 -1.0133738956705378 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886309_0.png resize: (589, 175) 1353264519 -1.997489332229097 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886290_0.png resize: (425, 226) 1353264520 -1.3468992723108504 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886300_0.png resize: (290, 263) 1353264521 -2.19368793526922 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886312_0.png resize: (242, 127) 1353264522 -2.8217726805883214 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886291_0.png resize: (130, 173) 1353264523 -0.5898625950823762 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886311_0.png resize: (115, 131) 1353264524 0.8506007350275454 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886299_0.png resize: (290, 184) 1353264525 -2.1088339723072522 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886302_0.png resize: (188, 331) 1353264526 -1.1973923326659661 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886307_0.png resize: (86, 120) 1353264527 1.1113664650010924 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886303_0.png resize: (87, 179) 1353264528 1.130896325856105 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886301_0.png resize: (131, 135) 1353264529 -1.4043251783484985 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886292_0.png resize: (207, 192) 1353264530 -0.35908282284962606 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886293_0.png resize: (173, 110) 1353264531 -1.044328998556972 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886295_0.png resize: (199, 367) 1353264532 -1.3124517513780087 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886304_0.png resize: (226, 153) 1353264533 -1.2216981311195005 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886298_0.png resize: (430, 115) 1353264534 -0.734126419850804 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886158_0.png resize: (548, 274) 1353264560 -1.6448725695723174 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886167_0.png resize: (202, 201) 1353264561 -3.4675329128623242 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886177_0.png resize: (153, 231) 1353264562 -0.9949880894570063 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886194_0.png resize: (410, 204) 1353264563 -1.8659617078772412 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886216_0.png resize: (273, 303) 1353264564 -1.899310033760193 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886242_0.png resize: (76, 110) 1353264565 -1.9798719307021062 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886245_0.png resize: (234, 424) 1353264566 -3.124573501782432 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886221_0.png resize: (474, 472) 1353264567 -1.46766421761279 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886233_0.png resize: (138, 228) 1353264568 -0.5979308466744239 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886257_0.png resize: (255, 560) 1353264569 -2.3537323423624334 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886263_0.png resize: (259, 460) 1353264570 -1.8716904584680742 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886265_0.png resize: (109, 150) 1353264571 -0.7573137372655738 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886271_0.png resize: (146, 174) 1353264572 -0.8918391522492617 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886268_0.png resize: (187, 191) 1353264573 -0.7481661624733237 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886285_0.png resize: (228, 90) 1353264574 -2.837318959898554 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886288_0.png resize: (102, 184) 1353264575 -1.7283680130810442 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886282_0.png resize: (187, 200) 1353264576 -1.5743167361264248 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886280_0.png resize: (125, 279) 1353264577 -2.0996494618575916 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886297_0.png resize: (123, 198) 1353264578 -1.3038534294887913 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886294_0.png resize: (188, 66) 1353264579 -2.3989336131956316 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886305_0.png resize: (120, 93) 1353264580 -0.6874123160816042 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886296_0.png resize: (94, 144) 1353264581 0.7841500539743808 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886314_0.png resize: (76, 239) 1353264582 -1.5212116851419497 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886166_0.png resize: (235, 514) 1353264617 -1.8559635598654143 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886168_0.png resize: (390, 434) 1353264618 -1.7553118751227177 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886157_0.png resize: (78, 179) 1353264619 -2.420736661059662 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886159_0.png resize: (507, 396) 1353264620 -1.500704202151584 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886162_0.png resize: (244, 339) 1353264622 -2.939210862328849 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886163_0.png resize: (392, 307) 1353264623 -0.7162917022444047 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886161_0.png resize: (226, 232) 1353264624 -1.8808556447419071 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886188_0.png resize: (124, 314) 1353264625 -2.391907904734879 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886192_0.png resize: (223, 352) 1353264627 -1.5760448494183126 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886182_0.png resize: (134, 210) 1353264628 -1.3080923343262423 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886189_0.png resize: (460, 654) 1353264629 -1.4434080028521792 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886193_0.png resize: (363, 422) 1353264631 -1.4153930349735504 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886172_0.png resize: (320, 139) 1353264632 -0.521940680832216 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886184_0.png resize: (182, 208) 1353264633 -2.053152520476111 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886183_0.png resize: (627, 194) 1353264635 -1.3595990352265346 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886199_0.png resize: (305, 235) 1353264636 -1.1452463234046606 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886212_0.png resize: (140, 142) 1353264637 -2.1185093951391845 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886197_0.png resize: (339, 193) 1353264638 -1.004867373007501 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886213_0.png resize: (737, 353) 1353264639 -1.9775735896603777 treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886201_0.png resize: (401, 174) 1353264640 -1.143251382622836 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886246_0.png resize: (282, 394) 1353264641 -3.493806492802135 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886236_0.png resize: (147, 158) 1353264642 -2.8910339604053017 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886237_0.png resize: (248, 415) 1353264643 -3.096604126516301 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886228_0.png resize: (389, 250) 1353264644 -2.8992227166929854 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886231_0.png resize: (271, 437) 1353264645 -1.650168483844078 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886262_0.png resize: (897, 1038) 1353264646 -2.31695699282918 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886264_0.png resize: (757, 764) 1353264647 -1.617248338051395 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886250_0.png resize: (278, 478) 1353264648 -2.0096836858738794 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886254_0.png resize: (312, 450) 1353264649 -2.203848964579526 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886253_0.png resize: (91, 185) 1353264651 -2.6499742877900205 treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886252_0.png resize: (293, 265) 1353264652 -2.2657150626524634 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886269_0.png resize: (145, 228) 1353264653 -1.5473779804589496 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886273_0.png resize: (379, 469) 1353264654 -0.6753953060652753 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886274_0.png resize: (214, 190) 1353264655 -3.0177061769370392 treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886276_0.png resize: (99, 68) 1353264656 0.1939421224051444 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886279_0.png resize: (490, 445) 1353264657 -1.1035114713591845 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886287_0.png resize: (145, 257) 1353264658 -1.531645568302429 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886284_0.png resize: (437, 320) 1353264659 -1.811486866139097 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886310_0.png resize: (217, 633) 1353264660 -2.3935722444233773 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886308_0.png resize: (367, 342) 1353264661 -1.3325478081656261 treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886164_0.png resize: (121, 138) 1353264675 -0.04716628001777488 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886175_0.png resize: (193, 242) 1353264676 -2.2880225906495446 treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886187_0.png resize: (271, 242) 1353264677 -0.9609978312475305 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886306_0.png resize: (441, 414) 1353264678 -0.33170495212781115 treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886313_0.png resize: (134, 124) 1353264679 0.3323313098923125 treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886289_0.png resize: (347, 387) 1353264682 -1.243602361149726 treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886247_0.png resize: (107, 87) 1353264695 -1.310064369724187 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 167 time used for this insertion : 0.019915103912353516 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 167 time used for this insertion : 0.030643463134765625 save missing photos in datou_result : time spend for datou_step_exec : 29.147521018981934 time spend to save output : 0.055870771408081055 total time spend for step 6 : 29.203391790390015 step7:brightness Thu Apr 24 04:45:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a.jpg treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373.jpg treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b.jpg treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be.jpg treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a.jpg treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2.jpg treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0.jpg treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e.jpg treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886156_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886169_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886165_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886160_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886170_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886176_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886180_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886173_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886185_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886174_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886186_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886195_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886171_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886181_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886191_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886190_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886178_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886179_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886215_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886218_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886217_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886203_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886198_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886209_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886200_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886205_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886208_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886204_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886207_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886206_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886196_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886214_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886202_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886211_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886219_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886210_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886227_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886241_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886223_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886222_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886232_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886240_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886239_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886226_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886234_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886238_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886230_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886244_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886220_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886243_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886225_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886235_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886224_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886229_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886249_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886256_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886260_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886255_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886258_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886259_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886251_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886261_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886248_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886277_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886267_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886272_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886266_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886270_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886275_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886278_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886281_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886283_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886286_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886309_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886290_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886300_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886312_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886291_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886311_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886299_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886302_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886307_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886303_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886301_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886292_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886293_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886295_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886304_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886298_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886158_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886167_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886177_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886194_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886216_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886242_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886245_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886221_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886233_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886257_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886263_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886265_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886271_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886268_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886285_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886288_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886282_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886280_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886297_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886294_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886305_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886296_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886314_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886166_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886168_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886157_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886159_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886162_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886163_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886161_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886188_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886192_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886182_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886189_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886193_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886172_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886184_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886183_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886199_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886212_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886197_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886213_0.png treat image : temp/1745462430_2057576_1353176140_98b7733d73d682c58f35793cf9dedd5b_rle_crop_3766886201_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886246_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886236_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886237_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886228_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886231_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886262_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886264_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886250_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886254_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886253_0.png treat image : temp/1745462430_2057576_1352947225_fa5b16af5cd2ca30e9a909caf0ffb15a_rle_crop_3766886252_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886269_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886273_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886274_0.png treat image : temp/1745462430_2057576_1352947220_dfee7c6909348e9a7fa2c986a34df1f2_rle_crop_3766886276_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886279_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886287_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886284_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886310_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886308_0.png treat image : temp/1745462430_2057576_1353176303_8fadfb8e94aff4ae22bc3dd8050b7d9a_rle_crop_3766886164_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886175_0.png treat image : temp/1745462430_2057576_1353176145_570040952c82a204966731ee8d92b373_rle_crop_3766886187_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886306_0.png treat image : temp/1745462430_2057576_1352947084_6784fe301e45ee64e4e003b9f6c79e8e_rle_crop_3766886313_0.png treat image : temp/1745462430_2057576_1352947217_c390567624ff9f29185139f17d8650d0_rle_crop_3766886289_0.png treat image : temp/1745462430_2057576_1353176137_f57c2ba9e4a896c0cf3c3165d27372be_rle_crop_3766886247_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 167 time used for this insertion : 0.01696157455444336 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 167 time used for this insertion : 0.030939102172851562 save missing photos in datou_result : time spend for datou_step_exec : 7.642683267593384 time spend to save output : 0.053330421447753906 total time spend for step 7 : 7.696013689041138 step8:velours_tree Thu Apr 24 04:45:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.12514615058898926 time spend to save output : 5.936622619628906e-05 total time spend for step 8 : 0.12520551681518555 step9:send_mail_cod Thu Apr 24 04:45:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22366522_24-04-2025_04_45_51.pdf 22367276 change filename to text .imagette223672761745462751 22367277 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223672771745462751 22367278 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223672781745462753 22367280 imagette223672801745462754 22367281 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223672811745462754 22367282 change filename to text .imagette223672821745462756 22367283 imagette223672831745462756 22367284 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223672841745462756 22367285 imagette223672851745462756 22367286 imagette223672861745462756 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22366522 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22367276,22367277,22367278,22367279,22367280,22367281,22367282,22367283,22367284,22367285,22367286?tags=pet_fonce,papier,pet_clair,environnement,flou,carton,pehd,background,autre,metal,mal_croppe args[1353176303] : ((1353176303, -2.460978378182155, 492609224), (1353176303, -0.11107385247924657, 496442774), '0.14932108694172114') We are sending mail with results at report@fotonower.com args[1353176145] : ((1353176145, -1.7559173911505963, 492688767), (1353176145, 0.06981019410957898, 2107752395), '0.14932108694172114') We are sending mail with results at report@fotonower.com args[1353176140] : ((1353176140, -1.1542961196245167, 492688767), (1353176140, -0.2059948639045419, 496442774), '0.14932108694172114') We are sending mail with results at report@fotonower.com args[1353176137] : ((1353176137, -2.8438922480065703, 492609224), (1353176137, 0.08133228407067426, 2107752395), '0.14932108694172114') We are sending mail with results at report@fotonower.com args[1352947225] : ((1352947225, -2.7950920288694205, 492609224), (1352947225, 0.14185257782698169, 2107752395), '0.14932108694172114') We are sending mail with results at report@fotonower.com args[1352947220] : ((1352947220, -2.4876244826255958, 492609224), (1352947220, 0.01923213106137953, 2107752395), '0.14932108694172114') We are sending mail with results at report@fotonower.com args[1352947217] : ((1352947217, -0.5731242649313524, 492688767), (1352947217, -0.23474194205557297, 496442774), '0.14932108694172114') We are sending mail with results at report@fotonower.com args[1352947084] : ((1352947084, -2.2799647762467394, 492609224), (1352947084, -0.07038060406556464, 496442774), '0.14932108694172114') We are sending mail with results at report@fotonower.com refus_total : 0.14932108694172114 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22366522 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366522_24-04-2025_04_45_51.pdf results_Auto_P22366522_24-04-2025_04_45_51.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366522_24-04-2025_04_45_51.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22366522','results_Auto_P22366522_24-04-2025_04_45_51.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366522_24-04-2025_04_45_51.pdf','pdf','','0.72','0.14932108694172114') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22366522

https://www.fotonower.com/image?json=false&list_photos_id=1353176303
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353176145
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353176140
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353176137
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352947225
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352947220
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352947217
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352947084
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.93%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22367276?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22367277?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22367278?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22367281?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22367282?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22367284?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366522_24-04-2025_04_45_51.pdf.

Lien vers velours :https://www.fotonower.com/velours/22367276,22367277,22367278,22367279,22367280,22367281,22367282,22367283,22367284,22367285,22367286?tags=pet_fonce,papier,pet_clair,environnement,flou,carton,pehd,background,autre,metal,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 24 Apr 2025 02:45:59 GMT Content-Length: 0 Connection: close X-Message-Id: Z1L3UTSpQuOrWFn-xTUayw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1353176303, 1353176145, 1353176140, 1353176137, 1352947225, 1352947220, 1352947217, 1352947084] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176303', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176145', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176140', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176137', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947225', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947220', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947217', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947084', None, None, None, None, None, '2755470') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.012930870056152344 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.535256624221802 time spend to save output : 0.013221263885498047 total time spend for step 9 : 7.5484778881073 step10:split_time_score Thu Apr 24 04:45:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 23042025 22366522 Nombre de photos uploadées : 8 / 23040 (0%) 23042025 22366522 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 23042025 22366522 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 7.3909759521484375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0007786750793457031 elapsed_time : insert_dashboard_record_day_entry 0.02238154411315918 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366519 order by id desc limit 1 Qualite : 0.14932108694172114 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366522_24-04-2025_04_45_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366522 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366522 AND mptpi.`type`=3594 To do Qualite : 0.03713156660411815 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366526_24-04-2025_04_43_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366526 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366526 AND mptpi.`type`=3726 To do Qualite : 0.16096212485122655 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366532 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366532 AND mptpi.`type`=3594 To do Qualite : 0.09568537934721211 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366545_24-04-2025_04_32_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366545 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366545 AND mptpi.`type`=3594 To do Qualite : 0.3200109800491196 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22352034_23-04-2025_17_36_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22352034 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22352034 AND mptpi.`type`=3726 To do Qualite : 0.1556769131263616 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22352035_23-04-2025_17_41_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22352035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22352035 AND mptpi.`type`=3594 To do Qualite : 0.1991258217214356 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22358079_23-04-2025_20_30_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22358079 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22358079 AND mptpi.`type`=3594 To do Qualite : 0.1164668720497458 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22353122_23-04-2025_18_16_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22353122 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22353122 AND mptpi.`type`=3594 To do Qualite : 0.04576437746737057 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366552_24-04-2025_04_18_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366552 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366552 AND mptpi.`type`=3726 To do Qualite : 0.12046302285060113 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22366555_24-04-2025_04_16_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22366555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22366555 AND mptpi.`type`=3594 To do Qualite : 0.14075071000622477 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22359946_23-04-2025_22_22_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22359946 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22359946 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'23042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1353176303, 1353176145, 1353176140, 1353176137, 1352947225, 1352947220, 1352947217, 1352947084] Looping around the photos to save general results len do output : 1 /22366522Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176303', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176145', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176140', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1353176137', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947225', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947220', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947217', None, None, None, None, None, '2755470') ('3318', None, None, None, None, None, None, None, '2755470') ('3318', '22366522', '1352947084', None, None, None, None, None, '2755470') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012999773025512695 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4924864768981934 time spend to save output : 0.013277769088745117 total time spend for step 10 : 2.5057642459869385 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 146.12user 119.58system 5:36.51elapsed 78%CPU (0avgtext+0avgdata 5733092maxresident)k 1589816inputs+91912outputs (6638major+13422279minor)pagefaults 0swaps