python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1610384 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3514638'] with mtr_portfolio_ids : ['25921219'] and first list_photo_ids : [] new path : /proc/1610384/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 24 ; length of list_pids : 24 ; length of list_args : 24 time to download the photos : 3.09539794921875 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Aug 12 19:40:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-12 19:40:35.847598: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-12 19:40:35.871333: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-12 19:40:35.873261: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f95b8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-12 19:40:35.873303: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-12 19:40:35.876709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-12 19:40:36.017202: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x597f4d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-12 19:40:36.017245: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-12 19:40:36.018473: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 19:40:36.018836: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 19:40:36.021567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 19:40:36.024033: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 19:40:36.024494: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 19:40:36.027478: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 19:40:36.028930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 19:40:36.032741: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 19:40:36.034190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 19:40:36.034255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 19:40:36.035016: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-12 19:40:36.035031: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-12 19:40:36.035039: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-12 19:40:36.036431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9867 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-12 19:40:36.322634: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 19:40:36.322716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 19:40:36.322737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 19:40:36.322755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 19:40:36.322772: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 19:40:36.322790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 19:40:36.322807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 19:40:36.322825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 19:40:36.324419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 19:40:36.325889: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 19:40:36.325962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 19:40:36.325985: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 19:40:36.326006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 19:40:36.326025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 19:40:36.326045: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 19:40:36.326065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 19:40:36.326085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 19:40:36.327682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 19:40:36.327720: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-12 19:40:36.327732: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-12 19:40:36.327741: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-12 19:40:36.329196: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9867 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-12 19:40:47.573711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 19:40:47.830008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 19:40:49.274701: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.275277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.275860: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.276404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.276954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.277534: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.278053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.278082: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.278611: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.278626: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.284688: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.284711: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.285254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.285268: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.291073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.291103: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.291669: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.291687: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.317441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.317478: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.317999: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.318013: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.323421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.323441: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.323964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.323979: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-12 19:40:49.356322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.356891: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.358511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.359072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.398924: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.401110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.404132: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.405491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.434029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.435474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.438078: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.439591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.446616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.448075: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.451026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.453130: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.460928: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.462297: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.464981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.466565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.494211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.495349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.496338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.496910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.500571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.501158: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.516596: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.517165: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.517722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.518296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.530626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.531236: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.531800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.532358: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.536634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.537196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.541752: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.542313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.554584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.555146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.559401: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.559965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.560522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.561078: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.561812: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.562376: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.573407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.573983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.574559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.575118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.575682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.576242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.576940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.577554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.586899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.587503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.593739: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.594319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.646253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.646864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.655149: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.655759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.671484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.672144: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.672748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.673331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.677590: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.678168: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.678753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.679367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.680430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.680455: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-08-12 19:40:49.690898: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.691516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.700772: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.701385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.702019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.702600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.703183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-12 19:40:49.703753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 24 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 1610929 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1014 tf kernel not reseted sub process len(results) : 24 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 24 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2207 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0027849674224853516 nb_pixel_total : 121807 time to create 1 rle with old method : 0.14239239692687988 length of segment : 562 time for calcul the mask position with numpy : 0.00021028518676757812 nb_pixel_total : 9698 time to create 1 rle with old method : 0.011911869049072266 length of segment : 120 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 18305 time to create 1 rle with old method : 0.022313356399536133 length of segment : 130 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 4105 time to create 1 rle with old method : 0.005344390869140625 length of segment : 90 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 6609 time to create 1 rle with old method : 0.008088111877441406 length of segment : 78 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 5156 time to create 1 rle with old method : 0.006317615509033203 length of segment : 80 time for calcul the mask position with numpy : 0.0002117156982421875 nb_pixel_total : 6065 time to create 1 rle with old method : 0.0074918270111083984 length of segment : 69 time for calcul the mask position with numpy : 0.0029027462005615234 nb_pixel_total : 116404 time to create 1 rle with old method : 0.13445711135864258 length of segment : 550 time for calcul the mask position with numpy : 0.0001366138458251953 nb_pixel_total : 1908 time to create 1 rle with old method : 0.0023648738861083984 length of segment : 59 time for calcul the mask position with numpy : 0.00026106834411621094 nb_pixel_total : 6155 time to create 1 rle with old method : 0.007318258285522461 length of segment : 111 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1246 time to create 1 rle with old method : 0.001569509506225586 length of segment : 35 time for calcul the mask position with numpy : 0.0024437904357910156 nb_pixel_total : 110856 time to create 1 rle with old method : 0.1262674331665039 length of segment : 534 time for calcul the mask position with numpy : 0.0002846717834472656 nb_pixel_total : 6965 time to create 1 rle with old method : 0.008073568344116211 length of segment : 95 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 2630 time to create 1 rle with old method : 0.0031621456146240234 length of segment : 41 time for calcul the mask position with numpy : 0.0016658306121826172 nb_pixel_total : 107007 time to create 1 rle with old method : 0.1222536563873291 length of segment : 499 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 3839 time to create 1 rle with old method : 0.0046389102935791016 length of segment : 49 time for calcul the mask position with numpy : 0.0001590251922607422 nb_pixel_total : 7180 time to create 1 rle with old method : 0.008342504501342773 length of segment : 77 time for calcul the mask position with numpy : 0.0004622936248779297 nb_pixel_total : 19237 time to create 1 rle with old method : 0.02215862274169922 length of segment : 184 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 2671 time to create 1 rle with old method : 0.003222227096557617 length of segment : 54 time for calcul the mask position with numpy : 0.00020456314086914062 nb_pixel_total : 7685 time to create 1 rle with old method : 0.009090662002563477 length of segment : 89 time for calcul the mask position with numpy : 0.0002124309539794922 nb_pixel_total : 6571 time to create 1 rle with old method : 0.0075185298919677734 length of segment : 127 time for calcul the mask position with numpy : 0.0004696846008300781 nb_pixel_total : 11760 time to create 1 rle with old method : 0.013248443603515625 length of segment : 216 time for calcul the mask position with numpy : 0.0002346038818359375 nb_pixel_total : 4678 time to create 1 rle with old method : 0.005442619323730469 length of segment : 87 time for calcul the mask position with numpy : 0.0012507438659667969 nb_pixel_total : 36726 time to create 1 rle with old method : 0.04159212112426758 length of segment : 372 time for calcul the mask position with numpy : 0.027135610580444336 nb_pixel_total : 778478 time to create 1 rle with new method : 0.07772684097290039 length of segment : 1009 time for calcul the mask position with numpy : 0.00019359588623046875 nb_pixel_total : 9053 time to create 1 rle with old method : 0.012843847274780273 length of segment : 119 time for calcul the mask position with numpy : 0.00026488304138183594 nb_pixel_total : 5900 time to create 1 rle with old method : 0.006916522979736328 length of segment : 78 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 3091 time to create 1 rle with old method : 0.0036771297454833984 length of segment : 59 time for calcul the mask position with numpy : 0.0001983642578125 nb_pixel_total : 3568 time to create 1 rle with old method : 0.004343271255493164 length of segment : 56 time for calcul the mask position with numpy : 0.0027189254760742188 nb_pixel_total : 104228 time to create 1 rle with old method : 0.11757707595825195 length of segment : 546 time for calcul the mask position with numpy : 0.00018858909606933594 nb_pixel_total : 4119 time to create 1 rle with old method : 0.00481724739074707 length of segment : 78 time for calcul the mask position with numpy : 0.0003058910369873047 nb_pixel_total : 11535 time to create 1 rle with old method : 0.013288497924804688 length of segment : 176 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 4820 time to create 1 rle with old method : 0.00566554069519043 length of segment : 114 time for calcul the mask position with numpy : 0.00017547607421875 nb_pixel_total : 5705 time to create 1 rle with old method : 0.006860494613647461 length of segment : 58 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 1925 time to create 1 rle with old method : 0.0024001598358154297 length of segment : 39 time for calcul the mask position with numpy : 0.0023050308227539062 nb_pixel_total : 107916 time to create 1 rle with old method : 0.12174654006958008 length of segment : 536 time for calcul the mask position with numpy : 0.0001971721649169922 nb_pixel_total : 3949 time to create 1 rle with old method : 0.004687786102294922 length of segment : 75 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 7693 time to create 1 rle with old method : 0.008730411529541016 length of segment : 158 time for calcul the mask position with numpy : 0.0002224445343017578 nb_pixel_total : 5697 time to create 1 rle with old method : 0.0066111087799072266 length of segment : 116 time for calcul the mask position with numpy : 0.0002124309539794922 nb_pixel_total : 5459 time to create 1 rle with old method : 0.00645136833190918 length of segment : 132 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 1921 time to create 1 rle with old method : 0.002200603485107422 length of segment : 73 time for calcul the mask position with numpy : 0.0019996166229248047 nb_pixel_total : 98468 time to create 1 rle with old method : 0.1112973690032959 length of segment : 526 time for calcul the mask position with numpy : 0.0003962516784667969 nb_pixel_total : 6152 time to create 1 rle with old method : 0.007124900817871094 length of segment : 151 time for calcul the mask position with numpy : 0.0006933212280273438 nb_pixel_total : 13182 time to create 1 rle with old method : 0.018478870391845703 length of segment : 153 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 5279 time to create 1 rle with old method : 0.006403923034667969 length of segment : 101 time for calcul the mask position with numpy : 0.002493619918823242 nb_pixel_total : 101951 time to create 1 rle with old method : 0.12072086334228516 length of segment : 576 time for calcul the mask position with numpy : 0.0008206367492675781 nb_pixel_total : 36900 time to create 1 rle with old method : 0.043218374252319336 length of segment : 179 time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 18300 time to create 1 rle with old method : 0.020900249481201172 length of segment : 146 time for calcul the mask position with numpy : 0.0006215572357177734 nb_pixel_total : 25042 time to create 1 rle with old method : 0.02964162826538086 length of segment : 183 time for calcul the mask position with numpy : 0.00023055076599121094 nb_pixel_total : 5243 time to create 1 rle with old method : 0.006337642669677734 length of segment : 116 time for calcul the mask position with numpy : 0.00020432472229003906 nb_pixel_total : 3838 time to create 1 rle with old method : 0.004895448684692383 length of segment : 79 time for calcul the mask position with numpy : 0.011786460876464844 nb_pixel_total : 776547 time to create 1 rle with new method : 0.021087646484375 length of segment : 993 time for calcul the mask position with numpy : 0.00024509429931640625 nb_pixel_total : 7116 time to create 1 rle with old method : 0.008799314498901367 length of segment : 115 time for calcul the mask position with numpy : 0.015580177307128906 nb_pixel_total : 797420 time to create 1 rle with new method : 0.027971267700195312 length of segment : 1001 time for calcul the mask position with numpy : 0.0023255348205566406 nb_pixel_total : 112925 time to create 1 rle with old method : 0.1330852508544922 length of segment : 579 time for calcul the mask position with numpy : 0.0007791519165039062 nb_pixel_total : 32137 time to create 1 rle with old method : 0.038192033767700195 length of segment : 256 time for calcul the mask position with numpy : 0.013131380081176758 nb_pixel_total : 782796 time to create 1 rle with new method : 0.019455432891845703 length of segment : 996 time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 6352 time to create 1 rle with old method : 0.007573604583740234 length of segment : 104 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 2466 time to create 1 rle with old method : 0.003045797348022461 length of segment : 66 time for calcul the mask position with numpy : 0.016298770904541016 nb_pixel_total : 1081427 time to create 1 rle with new method : 0.05334877967834473 length of segment : 1726 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 4582 time to create 1 rle with old method : 0.005774259567260742 length of segment : 88 time for calcul the mask position with numpy : 0.0022644996643066406 nb_pixel_total : 104680 time to create 1 rle with old method : 0.12414884567260742 length of segment : 548 time for calcul the mask position with numpy : 0.013930320739746094 nb_pixel_total : 862808 time to create 1 rle with new method : 0.026090383529663086 length of segment : 1299 time for calcul the mask position with numpy : 0.00024008750915527344 nb_pixel_total : 3368 time to create 1 rle with old method : 0.0042040348052978516 length of segment : 65 time for calcul the mask position with numpy : 0.0006036758422851562 nb_pixel_total : 13342 time to create 1 rle with old method : 0.016223907470703125 length of segment : 236 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 5269 time to create 1 rle with old method : 0.0065135955810546875 length of segment : 100 time for calcul the mask position with numpy : 0.00045752525329589844 nb_pixel_total : 14490 time to create 1 rle with old method : 0.0175628662109375 length of segment : 192 time for calcul the mask position with numpy : 0.00021147727966308594 nb_pixel_total : 6348 time to create 1 rle with old method : 0.007974863052368164 length of segment : 58 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 4081 time to create 1 rle with old method : 0.0051422119140625 length of segment : 76 time for calcul the mask position with numpy : 0.0007162094116210938 nb_pixel_total : 31209 time to create 1 rle with old method : 0.04004931449890137 length of segment : 268 time for calcul the mask position with numpy : 0.0206606388092041 nb_pixel_total : 1568153 time to create 1 rle with new method : 0.15872859954833984 length of segment : 1290 time for calcul the mask position with numpy : 0.00025773048400878906 nb_pixel_total : 6048 time to create 1 rle with old method : 0.007354736328125 length of segment : 94 time for calcul the mask position with numpy : 0.0002238750457763672 nb_pixel_total : 6840 time to create 1 rle with old method : 0.008523702621459961 length of segment : 219 time for calcul the mask position with numpy : 0.001991748809814453 nb_pixel_total : 88298 time to create 1 rle with old method : 0.1072549819946289 length of segment : 486 time for calcul the mask position with numpy : 0.0002834796905517578 nb_pixel_total : 8021 time to create 1 rle with old method : 0.009663581848144531 length of segment : 105 time for calcul the mask position with numpy : 0.00038313865661621094 nb_pixel_total : 8639 time to create 1 rle with old method : 0.010481595993041992 length of segment : 154 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 4687 time to create 1 rle with old method : 0.005910158157348633 length of segment : 70 time for calcul the mask position with numpy : 0.01266169548034668 nb_pixel_total : 722647 time to create 1 rle with new method : 0.017310619354248047 length of segment : 980 time spent for convertir_results : 5.653299331665039 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 78 chid ids of type : 3594 Number RLEs to save : 22104 save missing photos in datou_result : time spend for datou_step_exec : 37.264750957489014 time spend to save output : 1.2475461959838867 total time spend for step 1 : 38.5122971534729 step2:crop_condition Tue Aug 12 19:41:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 24 ! batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755020473_1610384 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.1660871505737305 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755020479_1610384 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.143139362335205 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755020481_1610384 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9819302558898926 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755020515_1610384 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.729744911193848 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755020524_1610384 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.775861978530884 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755020529_1610384 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5738565921783447 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1376619618, 1376619616, 1376619614, 1376619563, 1376619559, 1376619556, 1376619552, 1376619548, 1376619543, 1376619535, 1376619528, 1376619527, 1376619526, 1376619524, 1376619522, 1376619514, 1376619482, 1376619455, 1376619452, 1376619444, 1376619440, 1376619166, 1376619160, 1376619129] Looping around the photos to save general results len do output : 78 /1376678679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376678789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619618', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619616', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619614', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619563', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619559', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619556', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619552', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619548', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619543', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619535', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619528', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619527', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619526', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619524', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619522', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619514', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619482', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619455', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619452', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619444', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619440', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619166', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619160', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619129', None, None, None, None, None, '3514638') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 258 time used for this insertion : 0.02580404281616211 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.969735622406006 time spend to save output : 0.028660297393798828 total time spend for step 2 : 57.998395919799805 step3:rle_unique_nms_with_priority Tue Aug 12 19:42:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 78 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.7239553928375244 time for calcul the mask position with numpy : 0.1615002155303955 nb_pixel_total : 1907920 time to create 1 rle with new method : 0.09492731094360352 time for calcul the mask position with numpy : 0.00648045539855957 nb_pixel_total : 5156 time to create 1 rle with old method : 0.005745410919189453 time for calcul the mask position with numpy : 0.00586247444152832 nb_pixel_total : 6609 time to create 1 rle with old method : 0.007584571838378906 time for calcul the mask position with numpy : 0.006178855895996094 nb_pixel_total : 4105 time to create 1 rle with old method : 0.004659175872802734 time for calcul the mask position with numpy : 0.005944967269897461 nb_pixel_total : 18305 time to create 1 rle with old method : 0.020471572875976562 time for calcul the mask position with numpy : 0.006603717803955078 nb_pixel_total : 9698 time to create 1 rle with old method : 0.011260032653808594 time for calcul the mask position with numpy : 0.00707554817199707 nb_pixel_total : 121807 time to create 1 rle with old method : 0.13804388046264648 create new chi : 0.4929485321044922 time to delete rle : 0.017744779586791992 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 3200 TO DO : save crop sub photo not yet done ! save time : 0.21980547904968262 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.09104633331298828 time for calcul the mask position with numpy : 0.024679899215698242 nb_pixel_total : 1941822 time to create 1 rle with new method : 0.2957611083984375 time for calcul the mask position with numpy : 0.006425619125366211 nb_pixel_total : 1246 time to create 1 rle with old method : 0.0015306472778320312 time for calcul the mask position with numpy : 0.006217241287231445 nb_pixel_total : 6155 time to create 1 rle with old method : 0.007317543029785156 time for calcul the mask position with numpy : 0.0063779354095458984 nb_pixel_total : 1908 time to create 1 rle with old method : 0.0022242069244384766 time for calcul the mask position with numpy : 0.007021427154541016 nb_pixel_total : 116404 time to create 1 rle with old method : 0.1366896629333496 time for calcul the mask position with numpy : 0.006056547164916992 nb_pixel_total : 6065 time to create 1 rle with old method : 0.007124185562133789 create new chi : 0.5149877071380615 time to delete rle : 0.00033164024353027344 batch 1 Loaded 11 chid ids of type : 3594 ++++++++++Number RLEs to save : 2728 TO DO : save crop sub photo not yet done ! save time : 0.19301986694335938 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.054834604263305664 time for calcul the mask position with numpy : 0.02204751968383789 nb_pixel_total : 1953149 time to create 1 rle with new method : 0.10650324821472168 time for calcul the mask position with numpy : 0.00651860237121582 nb_pixel_total : 2630 time to create 1 rle with old method : 0.004469394683837891 time for calcul the mask position with numpy : 0.00650787353515625 nb_pixel_total : 6965 time to create 1 rle with old method : 0.011750936508178711 time for calcul the mask position with numpy : 0.007283926010131836 nb_pixel_total : 110856 time to create 1 rle with old method : 0.13375544548034668 create new chi : 0.2993917465209961 time to delete rle : 0.00035762786865234375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2420 TO DO : save crop sub photo not yet done ! save time : 0.17000627517700195 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.08817505836486816 time for calcul the mask position with numpy : 0.09724164009094238 nb_pixel_total : 1933666 time to create 1 rle with new method : 0.2550830841064453 time for calcul the mask position with numpy : 0.0059435367584228516 nb_pixel_total : 2671 time to create 1 rle with old method : 0.002948284149169922 time for calcul the mask position with numpy : 0.0067958831787109375 nb_pixel_total : 19237 time to create 1 rle with old method : 0.022307872772216797 time for calcul the mask position with numpy : 0.006243228912353516 nb_pixel_total : 7180 time to create 1 rle with old method : 0.00816488265991211 time for calcul the mask position with numpy : 0.00611424446105957 nb_pixel_total : 3839 time to create 1 rle with old method : 0.004387855529785156 time for calcul the mask position with numpy : 0.0069887638092041016 nb_pixel_total : 107007 time to create 1 rle with old method : 0.12033581733703613 create new chi : 0.5519077777862549 time to delete rle : 0.0004918575286865234 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2806 TO DO : save crop sub photo not yet done ! save time : 0.19425344467163086 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.3798410892486572 time for calcul the mask position with numpy : 0.05479741096496582 nb_pixel_total : 1218649 time to create 1 rle with new method : 0.1497199535369873 time for calcul the mask position with numpy : 0.006178617477416992 nb_pixel_total : 9053 time to create 1 rle with old method : 0.010180473327636719 time for calcul the mask position with numpy : 0.010935306549072266 nb_pixel_total : 778478 time to create 1 rle with new method : 0.09344983100891113 time for calcul the mask position with numpy : 0.006079435348510742 nb_pixel_total : 36726 time to create 1 rle with old method : 0.04188346862792969 time for calcul the mask position with numpy : 0.006398677825927734 nb_pixel_total : 4678 time to create 1 rle with old method : 0.005861043930053711 time for calcul the mask position with numpy : 0.0061643123626708984 nb_pixel_total : 11760 time to create 1 rle with old method : 0.013589143753051758 time for calcul the mask position with numpy : 0.006015300750732422 nb_pixel_total : 6571 time to create 1 rle with old method : 0.007542848587036133 time for calcul the mask position with numpy : 0.006481647491455078 nb_pixel_total : 7685 time to create 1 rle with old method : 0.009076833724975586 create new chi : 0.4439256191253662 time to delete rle : 0.0013592243194580078 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5118 TO DO : save crop sub photo not yet done ! save time : 0.33754920959472656 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.051943063735961914 time for calcul the mask position with numpy : 0.02518916130065918 nb_pixel_total : 2061041 time to create 1 rle with new method : 0.027766942977905273 time for calcul the mask position with numpy : 0.006142139434814453 nb_pixel_total : 3568 time to create 1 rle with old method : 0.004129648208618164 time for calcul the mask position with numpy : 0.005965471267700195 nb_pixel_total : 3091 time to create 1 rle with old method : 0.003492116928100586 time for calcul the mask position with numpy : 0.005836009979248047 nb_pixel_total : 5900 time to create 1 rle with old method : 0.006605625152587891 create new chi : 0.0914762020111084 time to delete rle : 0.0002987384796142578 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1466 TO DO : save crop sub photo not yet done ! save time : 0.12017035484313965 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 0.05207347869873047 time for calcul the mask position with numpy : 0.17158126831054688 nb_pixel_total : 1948898 time to create 1 rle with new method : 0.34688496589660645 time for calcul the mask position with numpy : 0.006167888641357422 nb_pixel_total : 4820 time to create 1 rle with old method : 0.00549626350402832 time for calcul the mask position with numpy : 0.006032466888427734 nb_pixel_total : 11535 time to create 1 rle with old method : 0.013206005096435547 time for calcul the mask position with numpy : 0.006010293960571289 nb_pixel_total : 4119 time to create 1 rle with old method : 0.004734992980957031 time for calcul the mask position with numpy : 0.00678706169128418 nb_pixel_total : 104228 time to create 1 rle with old method : 0.11878800392150879 create new chi : 0.6959447860717773 time to delete rle : 0.0003533363342285156 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2908 TO DO : save crop sub photo not yet done ! save time : 0.1920003890991211 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.11551427841186523 time for calcul the mask position with numpy : 0.07297968864440918 nb_pixel_total : 1940715 time to create 1 rle with new method : 0.1795508861541748 time for calcul the mask position with numpy : 0.006188869476318359 nb_pixel_total : 5697 time to create 1 rle with old method : 0.006541252136230469 time for calcul the mask position with numpy : 0.005982637405395508 nb_pixel_total : 7693 time to create 1 rle with old method : 0.008699893951416016 time for calcul the mask position with numpy : 0.005836963653564453 nb_pixel_total : 3949 time to create 1 rle with old method : 0.0044040679931640625 time for calcul the mask position with numpy : 0.006269216537475586 nb_pixel_total : 107916 time to create 1 rle with old method : 0.11970686912536621 time for calcul the mask position with numpy : 0.006124019622802734 nb_pixel_total : 1925 time to create 1 rle with old method : 0.0022263526916503906 time for calcul the mask position with numpy : 0.005932331085205078 nb_pixel_total : 5705 time to create 1 rle with old method : 0.006535530090332031 create new chi : 0.4476163387298584 time to delete rle : 0.0005443096160888672 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3044 TO DO : save crop sub photo not yet done ! save time : 0.21119260787963867 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04791855812072754 time for calcul the mask position with numpy : 0.017976760864257812 nb_pixel_total : 1967752 time to create 1 rle with new method : 0.28203606605529785 time for calcul the mask position with numpy : 0.006207466125488281 nb_pixel_total : 98468 time to create 1 rle with old method : 0.10845708847045898 time for calcul the mask position with numpy : 0.006093025207519531 nb_pixel_total : 1921 time to create 1 rle with old method : 0.002157926559448242 time for calcul the mask position with numpy : 0.005879640579223633 nb_pixel_total : 5459 time to create 1 rle with old method : 0.006067991256713867 create new chi : 0.43531203269958496 time to delete rle : 0.00041866302490234375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2542 TO DO : save crop sub photo not yet done ! save time : 0.18578815460205078 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.10757565498352051 time for calcul the mask position with numpy : 0.25731968879699707 nb_pixel_total : 2054266 time to create 1 rle with new method : 0.1512455940246582 time for calcul the mask position with numpy : 0.006421804428100586 nb_pixel_total : 13182 time to create 1 rle with old method : 0.014888525009155273 time for calcul the mask position with numpy : 0.006476879119873047 nb_pixel_total : 6152 time to create 1 rle with old method : 0.0070648193359375 create new chi : 0.454348087310791 time to delete rle : 0.0003209114074707031 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1688 TO DO : save crop sub photo not yet done ! save time : 0.13244843482971191 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07954716682434082 time for calcul the mask position with numpy : 0.15981030464172363 nb_pixel_total : 1929470 time to create 1 rle with new method : 0.09552502632141113 time for calcul the mask position with numpy : 0.0065267086029052734 nb_pixel_total : 36900 time to create 1 rle with old method : 0.04255819320678711 time for calcul the mask position with numpy : 0.006458282470703125 nb_pixel_total : 101951 time to create 1 rle with old method : 0.11566352844238281 time for calcul the mask position with numpy : 0.0060117244720458984 nb_pixel_total : 5279 time to create 1 rle with old method : 0.006017923355102539 create new chi : 0.44925713539123535 time to delete rle : 0.0002741813659667969 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2792 TO DO : save crop sub photo not yet done ! save time : 0.19170212745666504 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.17381930351257324 time for calcul the mask position with numpy : 0.07009291648864746 nb_pixel_total : 2021177 time to create 1 rle with new method : 0.24739408493041992 time for calcul the mask position with numpy : 0.006092071533203125 nb_pixel_total : 3838 time to create 1 rle with old method : 0.0046122074127197266 time for calcul the mask position with numpy : 0.00620579719543457 nb_pixel_total : 5243 time to create 1 rle with old method : 0.006071805953979492 time for calcul the mask position with numpy : 0.005965709686279297 nb_pixel_total : 25042 time to create 1 rle with old method : 0.02861189842224121 time for calcul the mask position with numpy : 0.006371259689331055 nb_pixel_total : 18300 time to create 1 rle with old method : 0.020676612854003906 create new chi : 0.412125825881958 time to delete rle : 0.0003566741943359375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2128 TO DO : save crop sub photo not yet done ! save time : 0.16518926620483398 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05057978630065918 time for calcul the mask position with numpy : 0.015873193740844727 nb_pixel_total : 1289937 time to create 1 rle with new method : 0.15715646743774414 time for calcul the mask position with numpy : 0.006184577941894531 nb_pixel_total : 7116 time to create 1 rle with old method : 0.00838470458984375 time for calcul the mask position with numpy : 0.011341333389282227 nb_pixel_total : 776547 time to create 1 rle with new method : 0.028245925903320312 create new chi : 0.22774004936218262 time to delete rle : 0.0005104541778564453 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3296 TO DO : save crop sub photo not yet done ! save time : 0.22059154510498047 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07784748077392578 time for calcul the mask position with numpy : 0.0552825927734375 nb_pixel_total : 1276180 time to create 1 rle with new method : 0.21470069885253906 time for calcul the mask position with numpy : 0.013127803802490234 nb_pixel_total : 797420 time to create 1 rle with new method : 0.18740391731262207 create new chi : 0.4803628921508789 time to delete rle : 0.0003910064697265625 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 3082 TO DO : save crop sub photo not yet done ! save time : 0.20905852317810059 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.27783656120300293 time for calcul the mask position with numpy : 0.04718613624572754 nb_pixel_total : 1145742 time to create 1 rle with new method : 0.25681424140930176 time for calcul the mask position with numpy : 0.011280298233032227 nb_pixel_total : 782796 time to create 1 rle with new method : 0.1659245491027832 time for calcul the mask position with numpy : 0.006169319152832031 nb_pixel_total : 32137 time to create 1 rle with old method : 0.035787343978881836 time for calcul the mask position with numpy : 0.00693511962890625 nb_pixel_total : 112925 time to create 1 rle with old method : 0.12508797645568848 create new chi : 0.6639952659606934 time to delete rle : 0.0008130073547363281 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 4742 TO DO : save crop sub photo not yet done ! save time : 0.2949092388153076 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.11066675186157227 time for calcul the mask position with numpy : 0.10921192169189453 nb_pixel_total : 983355 time to create 1 rle with new method : 0.09337615966796875 time for calcul the mask position with numpy : 0.12032961845397949 nb_pixel_total : 1081427 time to create 1 rle with new method : 0.08856821060180664 time for calcul the mask position with numpy : 0.005979776382446289 nb_pixel_total : 2466 time to create 1 rle with old method : 0.002881765365600586 time for calcul the mask position with numpy : 0.006172895431518555 nb_pixel_total : 6352 time to create 1 rle with old method : 0.007447481155395508 create new chi : 0.4495232105255127 time to delete rle : 0.0007648468017578125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4872 TO DO : save crop sub photo not yet done ! save time : 0.29022955894470215 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05161166191101074 time for calcul the mask position with numpy : 0.013097286224365234 nb_pixel_total : 1101530 time to create 1 rle with new method : 0.17145705223083496 time for calcul the mask position with numpy : 0.012101888656616211 nb_pixel_total : 862808 time to create 1 rle with new method : 0.20502734184265137 time for calcul the mask position with numpy : 0.006451129913330078 nb_pixel_total : 104680 time to create 1 rle with old method : 0.1167452335357666 time for calcul the mask position with numpy : 0.0058481693267822266 nb_pixel_total : 4582 time to create 1 rle with old method : 0.00516963005065918 create new chi : 0.5515170097351074 time to delete rle : 0.0007715225219726562 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4950 TO DO : save crop sub photo not yet done ! save time : 0.2888357639312744 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04747772216796875 time for calcul the mask position with numpy : 0.08737301826477051 nb_pixel_total : 2051621 time to create 1 rle with new method : 0.22634148597717285 time for calcul the mask position with numpy : 0.0063266754150390625 nb_pixel_total : 5269 time to create 1 rle with old method : 0.00626826286315918 time for calcul the mask position with numpy : 0.006847858428955078 nb_pixel_total : 13342 time to create 1 rle with old method : 0.01566791534423828 time for calcul the mask position with numpy : 0.00685572624206543 nb_pixel_total : 3368 time to create 1 rle with old method : 0.0056915283203125 create new chi : 0.3718702793121338 time to delete rle : 0.0004506111145019531 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1882 TO DO : save crop sub photo not yet done ! save time : 0.1414628028869629 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04958939552307129 time for calcul the mask position with numpy : 0.07597470283508301 nb_pixel_total : 2059110 time to create 1 rle with new method : 0.1164555549621582 time for calcul the mask position with numpy : 0.007241487503051758 nb_pixel_total : 14490 time to create 1 rle with old method : 0.0169675350189209 create new chi : 0.22670435905456543 time to delete rle : 0.00030612945556640625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1464 TO DO : save crop sub photo not yet done ! save time : 0.11663174629211426 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04490089416503906 time for calcul the mask position with numpy : 0.1423323154449463 nb_pixel_total : 2067252 time to create 1 rle with new method : 0.3844141960144043 time for calcul the mask position with numpy : 0.007498979568481445 nb_pixel_total : 6348 time to create 1 rle with old method : 0.007729530334472656 create new chi : 0.5526440143585205 time to delete rle : 0.00023365020751953125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1196 TO DO : save crop sub photo not yet done ! save time : 0.11319494247436523 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.6324961185455322 time for calcul the mask position with numpy : 0.009028911590576172 nb_pixel_total : 501549 time to create 1 rle with new method : 0.09752988815307617 time for calcul the mask position with numpy : 0.29151320457458496 nb_pixel_total : 1536761 time to create 1 rle with new method : 0.10513138771057129 time for calcul the mask position with numpy : 0.006361961364746094 nb_pixel_total : 31209 time to create 1 rle with old method : 0.03594017028808594 time for calcul the mask position with numpy : 0.006720304489135742 nb_pixel_total : 4081 time to create 1 rle with old method : 0.004636287689208984 create new chi : 0.5722942352294922 time to delete rle : 0.0007245540618896484 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 4339 TO DO : save crop sub photo not yet done ! save time : 0.2758915424346924 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04251456260681152 time for calcul the mask position with numpy : 0.019526004791259766 nb_pixel_total : 2064968 time to create 1 rle with new method : 0.19331979751586914 time for calcul the mask position with numpy : 0.006677389144897461 nb_pixel_total : 2584 time to create 1 rle with old method : 0.003137350082397461 time for calcul the mask position with numpy : 0.006410837173461914 nb_pixel_total : 6048 time to create 1 rle with old method : 0.00716400146484375 create new chi : 0.2445080280303955 time to delete rle : 0.00029850006103515625 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 1594 TO DO : save crop sub photo not yet done ! save time : 0.13298416137695312 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.10731935501098633 time for calcul the mask position with numpy : 0.24554109573364258 nb_pixel_total : 1968642 time to create 1 rle with new method : 0.23534679412841797 time for calcul the mask position with numpy : 0.006145954132080078 nb_pixel_total : 8639 time to create 1 rle with old method : 0.009958744049072266 time for calcul the mask position with numpy : 0.006071329116821289 nb_pixel_total : 8021 time to create 1 rle with old method : 0.011093854904174805 time for calcul the mask position with numpy : 0.008874654769897461 nb_pixel_total : 88298 time to create 1 rle with old method : 0.1025996208190918 create new chi : 0.6364240646362305 time to delete rle : 0.0004177093505859375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2570 TO DO : save crop sub photo not yet done ! save time : 0.16782426834106445 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04141688346862793 time for calcul the mask position with numpy : 0.02366781234741211 nb_pixel_total : 1346266 time to create 1 rle with new method : 0.09333562850952148 time for calcul the mask position with numpy : 0.011056184768676758 nb_pixel_total : 722647 time to create 1 rle with new method : 0.22759723663330078 time for calcul the mask position with numpy : 0.006064891815185547 nb_pixel_total : 4687 time to create 1 rle with old method : 0.005407094955444336 create new chi : 0.37540555000305176 time to delete rle : 0.0005509853363037109 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3180 TO DO : save crop sub photo not yet done ! save time : 0.2003645896911621 map_output_result : {1376619618: (0.0, 'Should be the crop_list due to order', 0), 1376619616: (0.0, 'Should be the crop_list due to order', 0), 1376619614: (0.0, 'Should be the crop_list due to order', 0), 1376619563: (0.0, 'Should be the crop_list due to order', 0), 1376619559: (0.0, 'Should be the crop_list due to order', 0), 1376619556: (0.0, 'Should be the crop_list due to order', 0), 1376619552: (0.0, 'Should be the crop_list due to order', 0), 1376619548: (0.0, 'Should be the crop_list due to order', 0), 1376619543: (0.0, 'Should be the crop_list due to order', 0), 1376619535: (0.0, 'Should be the crop_list due to order', 0), 1376619528: (0.0, 'Should be the crop_list due to order', 0), 1376619527: (0.0, 'Should be the crop_list due to order', 0), 1376619526: (0.0, 'Should be the crop_list due to order', 0), 1376619524: (0.0, 'Should be the crop_list due to order', 0), 1376619522: (0.0, 'Should be the crop_list due to order', 0), 1376619514: (0.0, 'Should be the crop_list due to order', 0), 1376619482: (0.0, 'Should be the crop_list due to order', 0), 1376619455: (0.0, 'Should be the crop_list due to order', 0), 1376619452: (0.0, 'Should be the crop_list due to order', 0), 1376619444: (0.0, 'Should be the crop_list due to order', 0), 1376619440: (0.0, 'Should be the crop_list due to order', 0), 1376619166: (0.0, 'Should be the crop_list due to order', 0), 1376619160: (0.0, 'Should be the crop_list due to order', 0), 1376619129: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1376619618, 1376619616, 1376619614, 1376619563, 1376619559, 1376619556, 1376619552, 1376619548, 1376619543, 1376619535, 1376619528, 1376619527, 1376619526, 1376619524, 1376619522, 1376619514, 1376619482, 1376619455, 1376619452, 1376619444, 1376619440, 1376619166, 1376619160, 1376619129] Looping around the photos to save general results len do output : 24 /1376619618.Didn't retrieve data . /1376619616.Didn't retrieve data . /1376619614.Didn't retrieve data . /1376619563.Didn't retrieve data . /1376619559.Didn't retrieve data . /1376619556.Didn't retrieve data . /1376619552.Didn't retrieve data . /1376619548.Didn't retrieve data . /1376619543.Didn't retrieve data . /1376619535.Didn't retrieve data . /1376619528.Didn't retrieve data . /1376619527.Didn't retrieve data . /1376619526.Didn't retrieve data . /1376619524.Didn't retrieve data . /1376619522.Didn't retrieve data . /1376619514.Didn't retrieve data . /1376619482.Didn't retrieve data . /1376619455.Didn't retrieve data . /1376619452.Didn't retrieve data . /1376619444.Didn't retrieve data . /1376619440.Didn't retrieve data . /1376619166.Didn't retrieve data . /1376619160.Didn't retrieve data . /1376619129.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619618', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619616', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619614', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619563', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619559', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619556', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619552', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619548', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619543', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619535', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619528', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619527', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619526', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619524', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619522', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619514', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619482', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619455', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619452', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619444', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619440', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619166', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619160', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619129', None, None, None, None, None, '3514638') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.013022184371948242 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.683305740356445 time spend to save output : 0.013915777206420898 total time spend for step 3 : 19.697221517562866 step4:ventilate_hashtags_in_portfolio Tue Aug 12 19:42:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25921219 get user id for portfolio 25921219 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25921219 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','carton','autre','environnement','flou','mal_croppe','pet_fonce','background','pet_clair','papier','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25921219 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','carton','autre','environnement','flou','mal_croppe','pet_fonce','background','pet_clair','papier','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25921219 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','carton','autre','environnement','flou','mal_croppe','pet_fonce','background','pet_clair','papier','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25927310,25927311,25927312,25927313,25927314,25927315,25927316,25927317,25927318,25927319,25927320?tags=metal,carton,autre,environnement,flou,mal_croppe,pet_fonce,background,pet_clair,papier,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1376619618, 1376619616, 1376619614, 1376619563, 1376619559, 1376619556, 1376619552, 1376619548, 1376619543, 1376619535, 1376619528, 1376619527, 1376619526, 1376619524, 1376619522, 1376619514, 1376619482, 1376619455, 1376619452, 1376619444, 1376619440, 1376619166, 1376619160, 1376619129] Looping around the photos to save general results len do output : 1 /25921219. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619618', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619616', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619614', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619563', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619559', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619556', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619552', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619548', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619543', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619535', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619528', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619527', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619526', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619524', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619522', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619514', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619482', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619455', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619452', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619444', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619440', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619166', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619160', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619129', None, None, None, None, None, '3514638') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.015107154846191406 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6233501434326172 time spend to save output : 0.015465974807739258 total time spend for step 4 : 1.6388161182403564 step5:final Tue Aug 12 19:42:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1376619618: ('0.1814823455182612',), 1376619616: ('0.1814823455182612',), 1376619614: ('0.1814823455182612',), 1376619563: ('0.1814823455182612',), 1376619559: ('0.1814823455182612',), 1376619556: ('0.1814823455182612',), 1376619552: ('0.1814823455182612',), 1376619548: ('0.1814823455182612',), 1376619543: ('0.1814823455182612',), 1376619535: ('0.1814823455182612',), 1376619528: ('0.1814823455182612',), 1376619527: ('0.1814823455182612',), 1376619526: ('0.1814823455182612',), 1376619524: ('0.1814823455182612',), 1376619522: ('0.1814823455182612',), 1376619514: ('0.1814823455182612',), 1376619482: ('0.1814823455182612',), 1376619455: ('0.1814823455182612',), 1376619452: ('0.1814823455182612',), 1376619444: ('0.1814823455182612',), 1376619440: ('0.1814823455182612',), 1376619166: ('0.1814823455182612',), 1376619160: ('0.1814823455182612',), 1376619129: ('0.1814823455182612',)} new output for save of step final : {1376619618: ('0.1814823455182612',), 1376619616: ('0.1814823455182612',), 1376619614: ('0.1814823455182612',), 1376619563: ('0.1814823455182612',), 1376619559: ('0.1814823455182612',), 1376619556: ('0.1814823455182612',), 1376619552: ('0.1814823455182612',), 1376619548: ('0.1814823455182612',), 1376619543: ('0.1814823455182612',), 1376619535: ('0.1814823455182612',), 1376619528: ('0.1814823455182612',), 1376619527: ('0.1814823455182612',), 1376619526: ('0.1814823455182612',), 1376619524: ('0.1814823455182612',), 1376619522: ('0.1814823455182612',), 1376619514: ('0.1814823455182612',), 1376619482: ('0.1814823455182612',), 1376619455: ('0.1814823455182612',), 1376619452: ('0.1814823455182612',), 1376619444: ('0.1814823455182612',), 1376619440: ('0.1814823455182612',), 1376619166: ('0.1814823455182612',), 1376619160: ('0.1814823455182612',), 1376619129: ('0.1814823455182612',)} [1376619618, 1376619616, 1376619614, 1376619563, 1376619559, 1376619556, 1376619552, 1376619548, 1376619543, 1376619535, 1376619528, 1376619527, 1376619526, 1376619524, 1376619522, 1376619514, 1376619482, 1376619455, 1376619452, 1376619444, 1376619440, 1376619166, 1376619160, 1376619129] Looping around the photos to save general results len do output : 24 /1376619618.Didn't retrieve data . /1376619616.Didn't retrieve data . /1376619614.Didn't retrieve data . /1376619563.Didn't retrieve data . /1376619559.Didn't retrieve data . /1376619556.Didn't retrieve data . /1376619552.Didn't retrieve data . /1376619548.Didn't retrieve data . /1376619543.Didn't retrieve data . /1376619535.Didn't retrieve data . /1376619528.Didn't retrieve data . /1376619527.Didn't retrieve data . /1376619526.Didn't retrieve data . /1376619524.Didn't retrieve data . /1376619522.Didn't retrieve data . /1376619514.Didn't retrieve data . /1376619482.Didn't retrieve data . /1376619455.Didn't retrieve data . /1376619452.Didn't retrieve data . /1376619444.Didn't retrieve data . /1376619440.Didn't retrieve data . /1376619166.Didn't retrieve data . /1376619160.Didn't retrieve data . /1376619129.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619618', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619616', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619614', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619563', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619559', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619556', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619552', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619548', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619543', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619535', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619528', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619527', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619526', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619524', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619522', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619514', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619482', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619455', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619452', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619444', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619440', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619166', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619160', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619129', None, None, None, None, None, '3514638') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.014189481735229492 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15083527565002441 time spend to save output : 0.015215396881103516 total time spend for step 5 : 0.16605067253112793 step6:blur_detection Tue Aug 12 19:42:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01.jpg resize: (1080, 1920) 1376619618 -3.303545675397168 treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1.jpg resize: (1080, 1920) 1376619616 -0.3999528540212114 treat image : temp/1755020430_1610384_1376619614_ea4d15321557b2dfece4322c77370a06.jpg resize: (1080, 1920) 1376619614 -2.5199999954972823 treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5.jpg resize: (1080, 1920) 1376619563 -1.8625413459403257 treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80.jpg resize: (1080, 1920) 1376619559 -1.5022770383966557 treat image : temp/1755020430_1610384_1376619556_00896700e97194b258fb025839bb2dd3.jpg resize: (1080, 1920) 1376619556 -2.5482343159658263 treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af.jpg resize: (1080, 1920) 1376619552 -2.3761032678284955 treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13.jpg resize: (1080, 1920) 1376619548 -1.8168544762573355 treat image : temp/1755020430_1610384_1376619543_9a12fd39d4e74ffed1af356f14a353ad.jpg resize: (1080, 1920) 1376619543 -0.9156396966335285 treat image : temp/1755020430_1610384_1376619535_8a9df649aab02699240ade6426cb864a.jpg resize: (1080, 1920) 1376619535 -2.348048820722427 treat image : temp/1755020430_1610384_1376619528_261ff471c6939733659e6cf2ff7d4ad3.jpg resize: (1080, 1920) 1376619528 -2.1047267232513382 treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0.jpg resize: (1080, 1920) 1376619527 -1.578384979480084 treat image : temp/1755020430_1610384_1376619526_ca47b3d8dd3cf91d164543522b7ebfe3.jpg resize: (1080, 1920) 1376619526 -1.3963401525741277 treat image : temp/1755020430_1610384_1376619524_46519220b046256f38c41736ba077173.jpg resize: (1080, 1920) 1376619524 -2.1343251727947954 treat image : temp/1755020430_1610384_1376619522_90caa528d7a30d2762e09158ccd3f163.jpg resize: (1080, 1920) 1376619522 -0.7673946482739216 treat image : temp/1755020430_1610384_1376619514_618762478b5b44635f1e9072260df3a0.jpg resize: (1080, 1920) 1376619514 -2.4277099213624753 treat image : temp/1755020430_1610384_1376619482_9f2048c0a7ded6d20fd292cec3026125.jpg resize: (1080, 1920) 1376619482 -1.7531532718028144 treat image : temp/1755020430_1610384_1376619455_d55c1d586a35630d0cfc66e5fc346c85.jpg resize: (1080, 1920) 1376619455 -2.8654849041496337 treat image : temp/1755020430_1610384_1376619452_adb3c8c43f5ab6367e71131335e9ef4b.jpg resize: (1080, 1920) 1376619452 0.1553970244157123 treat image : temp/1755020430_1610384_1376619444_65f683de69e6f481074dbdda3ed2e129.jpg resize: (1080, 1920) 1376619444 -2.413217366727733 treat image : temp/1755020430_1610384_1376619440_d6d07475c37829f93a341113b2f76970.jpg resize: (1080, 1920) 1376619440 -1.8631379311837202 treat image : temp/1755020430_1610384_1376619166_d8af4a5bc40e21916f0e7ec48cc50864.jpg resize: (1080, 1920) 1376619166 1.533435923237426 treat image : temp/1755020430_1610384_1376619160_9c714aac3c3aaac116a865ff17b9c06d.jpg resize: (1080, 1920) 1376619160 -0.8261387246365267 treat image : temp/1755020430_1610384_1376619129_54a9a2df2e8f2defabd074e747f494cf.jpg resize: (1080, 1920) 1376619129 -1.8038055961955066 treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500047_0.png resize: (48, 107) 1376678679 -3.18816093611434 treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500048_0.png resize: (77, 138) 1376678680 -1.3220286056328834 treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500049_0.png resize: (184, 160) 1376678681 -1.2064103749068422 treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500050_0.png resize: (53, 70) 1376678682 0.36768660404832026 treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500051_0.png resize: (89, 107) 1376678683 -0.7956560014699314 treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500052_0.png resize: (127, 61) 1376678684 1.9705015128716719 treat image : temp/1755020430_1610384_1376619556_00896700e97194b258fb025839bb2dd3_rle_crop_3912500058_0.png resize: (78, 112) 1376678685 -0.07988692773394998 treat image : temp/1755020430_1610384_1376619556_00896700e97194b258fb025839bb2dd3_rle_crop_3912500059_0.png resize: (59, 72) 1376678686 -0.872205227312856 treat image : temp/1755020430_1610384_1376619556_00896700e97194b258fb025839bb2dd3_rle_crop_3912500060_0.png resize: (56, 86) 1376678687 -0.6682186930122604 treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500065_0.png resize: (57, 127) 1376678688 -0.9395223121846702 treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500066_0.png resize: (37, 63) 1376678689 2.4045358429594508 treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500070_0.png resize: (116, 72) 1376678690 -1.0011598927714576 treat image : temp/1755020430_1610384_1376619543_9a12fd39d4e74ffed1af356f14a353ad_rle_crop_3912500071_0.png resize: (101, 104) 1376678691 -2.54062655742378 treat image : temp/1755020430_1610384_1376619543_9a12fd39d4e74ffed1af356f14a353ad_rle_crop_3912500072_0.png resize: (73, 38) 1376678692 -1.0593359685493444 treat image : temp/1755020430_1610384_1376619535_8a9df649aab02699240ade6426cb864a_rle_crop_3912500074_0.png resize: (151, 120) 1376678693 -2.3205420466606057 treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0_rle_crop_3912500079_0.png resize: (133, 191) 1376678694 -0.8209771647895993 treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0_rle_crop_3912500081_0.png resize: (116, 88) 1376678695 -1.9892379005002194 treat image : temp/1755020430_1610384_1376619514_618762478b5b44635f1e9072260df3a0_rle_crop_3912500089_0.png resize: (104, 74) 1376678696 0.6065330312099643 treat image : temp/1755020430_1610384_1376619482_9f2048c0a7ded6d20fd292cec3026125_rle_crop_3912500092_0.png resize: (88, 122) 1376678697 -1.396943622395584 treat image : temp/1755020430_1610384_1376619455_d55c1d586a35630d0cfc66e5fc346c85_rle_crop_3912500095_0.png resize: (64, 63) 1376678698 -0.600187798443327 treat image : temp/1755020430_1610384_1376619444_65f683de69e6f481074dbdda3ed2e129_rle_crop_3912500099_0.png resize: (58, 129) 1376678699 -0.550005713391586 treat image : temp/1755020430_1610384_1376619440_d6d07475c37829f93a341113b2f76970_rle_crop_3912500100_0.png resize: (75, 72) 1376678700 -0.4279801866372829 treat image : temp/1755020430_1610384_1376619160_9c714aac3c3aaac116a865ff17b9c06d_rle_crop_3912500107_0.png resize: (153, 104) 1376678701 -1.8193453660163206 treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af_rle_crop_3912500063_0.png resize: (160, 87) 1376678704 0.3818151034063022 treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500069_0.png resize: (158, 69) 1376678705 -1.226929647147431 treat image : temp/1755020430_1610384_1376619522_90caa528d7a30d2762e09158ccd3f163_rle_crop_3912500086_0.png resize: (570, 324) 1376678706 0.19341803717826547 treat image : temp/1755020430_1610384_1376619614_ea4d15321557b2dfece4322c77370a06_rle_crop_3912500044_0.png resize: (95, 100) 1376678707 -1.1416242368862732 treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af_rle_crop_3912500062_0.png resize: (78, 66) 1376678708 1.6528492376903423 treat image : temp/1755020430_1610384_1376619129_54a9a2df2e8f2defabd074e747f494cf_rle_crop_3912500108_0.png resize: (69, 90) 1376678709 -1.7392036789702425 treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500032_0.png resize: (551, 380) 1376678739 0.5292593835296124 treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500034_0.png resize: (130, 188) 1376678740 -2.2644433038206166 treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500039_0.png resize: (550, 358) 1376678741 0.43629935327941827 treat image : temp/1755020430_1610384_1376619614_ea4d15321557b2dfece4322c77370a06_rle_crop_3912500043_0.png resize: (532, 327) 1376678742 0.36789361603813475 treat image : temp/1755020430_1610384_1376619614_ea4d15321557b2dfece4322c77370a06_rle_crop_3912500045_0.png resize: (41, 77) 1376678743 5.494483359645964 treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500046_0.png resize: (499, 337) 1376678744 0.2936734580579019 treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500053_0.png resize: (216, 66) 1376678745 -0.9507091164025704 treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500054_0.png resize: (87, 67) 1376678746 -2.78492478586048 treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500055_0.png resize: (356, 165) 1376678747 -1.92382707622686 treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500056_0.png resize: (1001, 1032) 1376678748 0.24425878790595323 treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500057_0.png resize: (119, 90) 1376678749 0.5360436111539475 treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af_rle_crop_3912500061_0.png resize: (544, 337) 1376678750 -0.1684764727459573 treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500067_0.png resize: (532, 336) 1376678751 0.31992319714392414 treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500068_0.png resize: (75, 69) 1376678752 -1.3374076323871313 treat image : temp/1755020430_1610384_1376619543_9a12fd39d4e74ffed1af356f14a353ad_rle_crop_3912500073_0.png resize: (504, 366) 1376678753 -0.4217548819912062 treat image : temp/1755020430_1610384_1376619528_261ff471c6939733659e6cf2ff7d4ad3_rle_crop_3912500077_0.png resize: (522, 326) 1376678754 -0.1340483919307817 treat image : temp/1755020430_1610384_1376619526_ca47b3d8dd3cf91d164543522b7ebfe3_rle_crop_3912500083_0.png resize: (989, 1091) 1376678755 0.12957887553000844 treat image : temp/1755020430_1610384_1376619526_ca47b3d8dd3cf91d164543522b7ebfe3_rle_crop_3912500084_0.png resize: (115, 88) 1376678756 -3.5794478281087017 treat image : temp/1755020430_1610384_1376619524_46519220b046256f38c41736ba077173_rle_crop_3912500085_0.png resize: (993, 1121) 1376678757 -0.21149018193195243 treat image : temp/1755020430_1610384_1376619522_90caa528d7a30d2762e09158ccd3f163_rle_crop_3912500087_0.png resize: (224, 234) 1376678758 -3.778116653929375 treat image : temp/1755020430_1610384_1376619522_90caa528d7a30d2762e09158ccd3f163_rle_crop_3912500088_0.png resize: (995, 1086) 1376678759 0.042639062714440346 treat image : temp/1755020430_1610384_1376619514_618762478b5b44635f1e9072260df3a0_rle_crop_3912500091_0.png resize: (1010, 1286) 1376678760 -2.227751429745844 treat image : temp/1755020430_1610384_1376619482_9f2048c0a7ded6d20fd292cec3026125_rle_crop_3912500093_0.png resize: (545, 323) 1376678761 0.25115795393499607 treat image : temp/1755020430_1610384_1376619482_9f2048c0a7ded6d20fd292cec3026125_rle_crop_3912500094_0.png resize: (1001, 1204) 1376678762 -0.7620824408219731 treat image : temp/1755020430_1610384_1376619455_d55c1d586a35630d0cfc66e5fc346c85_rle_crop_3912500096_0.png resize: (230, 85) 1376678763 -2.566944416840646 treat image : temp/1755020430_1610384_1376619455_d55c1d586a35630d0cfc66e5fc346c85_rle_crop_3912500097_0.png resize: (98, 72) 1376678764 -3.41506722647319 treat image : temp/1755020430_1610384_1376619440_d6d07475c37829f93a341113b2f76970_rle_crop_3912500102_0.png resize: (1005, 1690) 1376678765 -2.293623110433966 treat image : temp/1755020430_1610384_1376619160_9c714aac3c3aaac116a865ff17b9c06d_rle_crop_3912500105_0.png resize: (477, 330) 1376678766 -0.11963977323169046 treat image : temp/1755020430_1610384_1376619129_54a9a2df2e8f2defabd074e747f494cf_rle_crop_3912500109_0.png resize: (973, 959) 1376678767 0.3991992660932909 treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500033_0.png resize: (120, 118) 1376678769 -2.976066400999125 treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500035_0.png resize: (48, 136) 1376678770 -3.566193063421935 treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500036_0.png resize: (78, 104) 1376678771 -3.2924869999378354 treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500037_0.png resize: (79, 89) 1376678772 -1.552563746769098 treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500038_0.png resize: (69, 100) 1376678773 2.130674469017642 treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500040_0.png resize: (56, 44) 1376678774 1.98064118086753 treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500041_0.png resize: (92, 110) 1376678775 -2.4458478589930484 treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500042_0.png resize: (35, 44) 1376678776 5.931251329948314 treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af_rle_crop_3912500064_0.png resize: (114, 57) 1376678777 -1.993486144473706 treat image : temp/1755020430_1610384_1376619528_261ff471c6939733659e6cf2ff7d4ad3_rle_crop_3912500076_0.png resize: (81, 92) 1376678778 -0.11343246970736284 treat image : temp/1755020430_1610384_1376619528_261ff471c6939733659e6cf2ff7d4ad3_rle_crop_3912500078_0.png resize: (174, 271) 1376678779 -3.9604301082048368 treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0_rle_crop_3912500080_0.png resize: (175, 170) 1376678780 -0.02674247258960704 treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0_rle_crop_3912500082_0.png resize: (78, 87) 1376678782 -2.959055150983199 treat image : temp/1755020430_1610384_1376619514_618762478b5b44635f1e9072260df3a0_rle_crop_3912500090_0.png resize: (66, 45) 1376678783 -2.6566025021773423 treat image : temp/1755020430_1610384_1376619452_adb3c8c43f5ab6367e71131335e9ef4b_rle_crop_3912500098_0.png resize: (177, 125) 1376678784 -1.4800541156667535 treat image : temp/1755020430_1610384_1376619440_d6d07475c37829f93a341113b2f76970_rle_crop_3912500101_0.png resize: (260, 153) 1376678785 -1.1074496624817678 treat image : temp/1755020430_1610384_1376619166_d8af4a5bc40e21916f0e7ec48cc50864_rle_crop_3912500103_0.png resize: (94, 85) 1376678786 -1.485479731184017 treat image : temp/1755020430_1610384_1376619166_d8af4a5bc40e21916f0e7ec48cc50864_rle_crop_3912500104_0.png resize: (117, 126) 1376678787 -2.8652162175205826 treat image : temp/1755020430_1610384_1376619160_9c714aac3c3aaac116a865ff17b9c06d_rle_crop_3912500106_0.png resize: (105, 94) 1376678788 0.6654695180435303 treat image : temp/1755020430_1610384_1376619535_8a9df649aab02699240ade6426cb864a_rle_crop_3912500075_0.png resize: (153, 115) 1376678789 -2.790828088335716 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 102 time used for this insertion : 0.015121221542358398 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 102 time used for this insertion : 0.027013301849365234 save missing photos in datou_result : time spend for datou_step_exec : 22.569180250167847 time spend to save output : 0.04746365547180176 total time spend for step 6 : 22.61664390563965 step7:brightness Tue Aug 12 19:42:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01.jpg treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1.jpg treat image : temp/1755020430_1610384_1376619614_ea4d15321557b2dfece4322c77370a06.jpg treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5.jpg treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80.jpg treat image : temp/1755020430_1610384_1376619556_00896700e97194b258fb025839bb2dd3.jpg treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af.jpg treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13.jpg treat image : temp/1755020430_1610384_1376619543_9a12fd39d4e74ffed1af356f14a353ad.jpg treat image : temp/1755020430_1610384_1376619535_8a9df649aab02699240ade6426cb864a.jpg treat image : temp/1755020430_1610384_1376619528_261ff471c6939733659e6cf2ff7d4ad3.jpg treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0.jpg treat image : temp/1755020430_1610384_1376619526_ca47b3d8dd3cf91d164543522b7ebfe3.jpg treat image : temp/1755020430_1610384_1376619524_46519220b046256f38c41736ba077173.jpg treat image : temp/1755020430_1610384_1376619522_90caa528d7a30d2762e09158ccd3f163.jpg treat image : temp/1755020430_1610384_1376619514_618762478b5b44635f1e9072260df3a0.jpg treat image : temp/1755020430_1610384_1376619482_9f2048c0a7ded6d20fd292cec3026125.jpg treat image : temp/1755020430_1610384_1376619455_d55c1d586a35630d0cfc66e5fc346c85.jpg treat image : temp/1755020430_1610384_1376619452_adb3c8c43f5ab6367e71131335e9ef4b.jpg treat image : temp/1755020430_1610384_1376619444_65f683de69e6f481074dbdda3ed2e129.jpg treat image : temp/1755020430_1610384_1376619440_d6d07475c37829f93a341113b2f76970.jpg treat image : temp/1755020430_1610384_1376619166_d8af4a5bc40e21916f0e7ec48cc50864.jpg treat image : temp/1755020430_1610384_1376619160_9c714aac3c3aaac116a865ff17b9c06d.jpg treat image : temp/1755020430_1610384_1376619129_54a9a2df2e8f2defabd074e747f494cf.jpg treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500047_0.png treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500048_0.png treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500049_0.png treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500050_0.png treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500051_0.png treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500052_0.png treat image : temp/1755020430_1610384_1376619556_00896700e97194b258fb025839bb2dd3_rle_crop_3912500058_0.png treat image : temp/1755020430_1610384_1376619556_00896700e97194b258fb025839bb2dd3_rle_crop_3912500059_0.png treat image : temp/1755020430_1610384_1376619556_00896700e97194b258fb025839bb2dd3_rle_crop_3912500060_0.png treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500065_0.png treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500066_0.png treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500070_0.png treat image : temp/1755020430_1610384_1376619543_9a12fd39d4e74ffed1af356f14a353ad_rle_crop_3912500071_0.png treat image : temp/1755020430_1610384_1376619543_9a12fd39d4e74ffed1af356f14a353ad_rle_crop_3912500072_0.png treat image : temp/1755020430_1610384_1376619535_8a9df649aab02699240ade6426cb864a_rle_crop_3912500074_0.png treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0_rle_crop_3912500079_0.png treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0_rle_crop_3912500081_0.png treat image : temp/1755020430_1610384_1376619514_618762478b5b44635f1e9072260df3a0_rle_crop_3912500089_0.png treat image : temp/1755020430_1610384_1376619482_9f2048c0a7ded6d20fd292cec3026125_rle_crop_3912500092_0.png treat image : temp/1755020430_1610384_1376619455_d55c1d586a35630d0cfc66e5fc346c85_rle_crop_3912500095_0.png treat image : temp/1755020430_1610384_1376619444_65f683de69e6f481074dbdda3ed2e129_rle_crop_3912500099_0.png treat image : temp/1755020430_1610384_1376619440_d6d07475c37829f93a341113b2f76970_rle_crop_3912500100_0.png treat image : temp/1755020430_1610384_1376619160_9c714aac3c3aaac116a865ff17b9c06d_rle_crop_3912500107_0.png treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af_rle_crop_3912500063_0.png treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500069_0.png treat image : temp/1755020430_1610384_1376619522_90caa528d7a30d2762e09158ccd3f163_rle_crop_3912500086_0.png treat image : temp/1755020430_1610384_1376619614_ea4d15321557b2dfece4322c77370a06_rle_crop_3912500044_0.png treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af_rle_crop_3912500062_0.png treat image : temp/1755020430_1610384_1376619129_54a9a2df2e8f2defabd074e747f494cf_rle_crop_3912500108_0.png treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500032_0.png treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500034_0.png treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500039_0.png treat image : temp/1755020430_1610384_1376619614_ea4d15321557b2dfece4322c77370a06_rle_crop_3912500043_0.png treat image : temp/1755020430_1610384_1376619614_ea4d15321557b2dfece4322c77370a06_rle_crop_3912500045_0.png treat image : temp/1755020430_1610384_1376619563_46aad1b8281b13f28bcd17d19d0b6ab5_rle_crop_3912500046_0.png treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500053_0.png treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500054_0.png treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500055_0.png treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500056_0.png treat image : temp/1755020430_1610384_1376619559_1669bfaef8ed8e0c83053322e7e44e80_rle_crop_3912500057_0.png treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af_rle_crop_3912500061_0.png treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500067_0.png treat image : temp/1755020430_1610384_1376619548_0e0a53bf8373a4a07100b034f4725c13_rle_crop_3912500068_0.png treat image : temp/1755020430_1610384_1376619543_9a12fd39d4e74ffed1af356f14a353ad_rle_crop_3912500073_0.png treat image : temp/1755020430_1610384_1376619528_261ff471c6939733659e6cf2ff7d4ad3_rle_crop_3912500077_0.png treat image : temp/1755020430_1610384_1376619526_ca47b3d8dd3cf91d164543522b7ebfe3_rle_crop_3912500083_0.png treat image : temp/1755020430_1610384_1376619526_ca47b3d8dd3cf91d164543522b7ebfe3_rle_crop_3912500084_0.png treat image : temp/1755020430_1610384_1376619524_46519220b046256f38c41736ba077173_rle_crop_3912500085_0.png treat image : temp/1755020430_1610384_1376619522_90caa528d7a30d2762e09158ccd3f163_rle_crop_3912500087_0.png treat image : temp/1755020430_1610384_1376619522_90caa528d7a30d2762e09158ccd3f163_rle_crop_3912500088_0.png treat image : temp/1755020430_1610384_1376619514_618762478b5b44635f1e9072260df3a0_rle_crop_3912500091_0.png treat image : temp/1755020430_1610384_1376619482_9f2048c0a7ded6d20fd292cec3026125_rle_crop_3912500093_0.png treat image : temp/1755020430_1610384_1376619482_9f2048c0a7ded6d20fd292cec3026125_rle_crop_3912500094_0.png treat image : temp/1755020430_1610384_1376619455_d55c1d586a35630d0cfc66e5fc346c85_rle_crop_3912500096_0.png treat image : temp/1755020430_1610384_1376619455_d55c1d586a35630d0cfc66e5fc346c85_rle_crop_3912500097_0.png treat image : temp/1755020430_1610384_1376619440_d6d07475c37829f93a341113b2f76970_rle_crop_3912500102_0.png treat image : temp/1755020430_1610384_1376619160_9c714aac3c3aaac116a865ff17b9c06d_rle_crop_3912500105_0.png treat image : temp/1755020430_1610384_1376619129_54a9a2df2e8f2defabd074e747f494cf_rle_crop_3912500109_0.png treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500033_0.png treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500035_0.png treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500036_0.png treat image : temp/1755020430_1610384_1376619618_1d1c10265ea4b36532cb126be166ca01_rle_crop_3912500037_0.png treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500038_0.png treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500040_0.png treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500041_0.png treat image : temp/1755020430_1610384_1376619616_d264c517599e12af41ed9b16993ef1c1_rle_crop_3912500042_0.png treat image : temp/1755020430_1610384_1376619552_c6ccefb3c3c7e39aba6354717cdf08af_rle_crop_3912500064_0.png treat image : temp/1755020430_1610384_1376619528_261ff471c6939733659e6cf2ff7d4ad3_rle_crop_3912500076_0.png treat image : temp/1755020430_1610384_1376619528_261ff471c6939733659e6cf2ff7d4ad3_rle_crop_3912500078_0.png treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0_rle_crop_3912500080_0.png treat image : temp/1755020430_1610384_1376619527_a9c029d09d23708fcd96772ad52da5c0_rle_crop_3912500082_0.png treat image : temp/1755020430_1610384_1376619514_618762478b5b44635f1e9072260df3a0_rle_crop_3912500090_0.png treat image : temp/1755020430_1610384_1376619452_adb3c8c43f5ab6367e71131335e9ef4b_rle_crop_3912500098_0.png treat image : temp/1755020430_1610384_1376619440_d6d07475c37829f93a341113b2f76970_rle_crop_3912500101_0.png treat image : temp/1755020430_1610384_1376619166_d8af4a5bc40e21916f0e7ec48cc50864_rle_crop_3912500103_0.png treat image : temp/1755020430_1610384_1376619166_d8af4a5bc40e21916f0e7ec48cc50864_rle_crop_3912500104_0.png treat image : temp/1755020430_1610384_1376619160_9c714aac3c3aaac116a865ff17b9c06d_rle_crop_3912500106_0.png treat image : temp/1755020430_1610384_1376619535_8a9df649aab02699240ade6426cb864a_rle_crop_3912500075_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 102 time used for this insertion : 0.015133380889892578 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 102 time used for this insertion : 0.02700066566467285 save missing photos in datou_result : time spend for datou_step_exec : 6.422335863113403 time spend to save output : 0.04767465591430664 total time spend for step 7 : 6.47001051902771 step8:velours_tree Tue Aug 12 19:43:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.0887753963470459 time spend to save output : 4.315376281738281e-05 total time spend for step 8 : 0.08881855010986328 step9:send_mail_cod Tue Aug 12 19:43:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25921219_12-08-2025_19_43_00.pdf 25927310 change filename to text .change filename to text .change filename to text .imagette259273101755020580 25927311 change filename to text .change filename to text .change filename to text .imagette259273111755020580 25927312 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259273121755020580 25927314 imagette259273141755020581 25927315 imagette259273151755020581 25927316 change filename to text .imagette259273161755020581 25927317 imagette259273171755020581 25927318 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259273181755020581 25927319 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259273191755020583 25927320 imagette259273201755020584 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25921219 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25927310,25927311,25927312,25927313,25927314,25927315,25927316,25927317,25927318,25927319,25927320?tags=metal,carton,autre,environnement,flou,mal_croppe,pet_fonce,background,pet_clair,papier,pehd args[1376619618] : ((1376619618, -3.303545675397168, 492609224), (1376619618, 0.44414216728696015, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619616] : ((1376619616, -0.3999528540212114, 492688767), (1376619616, 0.4372043663210844, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619614] : ((1376619614, -2.5199999954972823, 492609224), (1376619614, 0.4414902432186446, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619563] : ((1376619563, -1.8625413459403257, 492688767), (1376619563, 0.44995076296428405, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619559] : ((1376619559, -1.5022770383966557, 492688767), (1376619559, 0.45700551711528337, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619556] : ((1376619556, -2.5482343159658263, 492609224), (1376619556, 0.4555881467112236, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619552] : ((1376619552, -2.3761032678284955, 492609224), (1376619552, 0.2869387819754132, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619548] : ((1376619548, -1.8168544762573355, 492688767), (1376619548, 0.45528132626553935, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619543] : ((1376619543, -0.9156396966335285, 492688767), (1376619543, 0.4343745371511684, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619535] : ((1376619535, -2.348048820722427, 492609224), (1376619535, 0.3837804139839108, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619528] : ((1376619528, -2.1047267232513382, 492609224), (1376619528, 0.38728061806229114, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619527] : ((1376619527, -1.578384979480084, 492688767), (1376619527, 0.5144698340071253, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619526] : ((1376619526, -1.3963401525741277, 492688767), (1376619526, 0.545644467364793, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619524] : ((1376619524, -2.1343251727947954, 492609224), (1376619524, 0.4620171164317456, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619522] : ((1376619522, -0.7673946482739216, 492688767), (1376619522, 0.43848613469037506, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619514] : ((1376619514, -2.4277099213624753, 492609224), (1376619514, 0.41492482498357136, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619482] : ((1376619482, -1.7531532718028144, 492688767), (1376619482, 0.4825372513415059, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619455] : ((1376619455, -2.8654849041496337, 492609224), (1376619455, 0.5339349441483044, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619452] : ((1376619452, 0.1553970244157123, 492688767), (1376619452, 0.49230950514170363, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619444] : ((1376619444, -2.413217366727733, 492609224), (1376619444, 0.5224595814981543, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619440] : ((1376619440, -1.8631379311837202, 492688767), (1376619440, 0.42787689543157625, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619166] : ((1376619166, 1.533435923237426, 492688767), (1376619166, 0.37731442627272316, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619160] : ((1376619160, -0.8261387246365267, 492688767), (1376619160, 0.49915310960560294, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com args[1376619129] : ((1376619129, -1.8038055961955066, 492688767), (1376619129, 0.4556661926904575, 2107752395), '0.1814823455182612') We are sending mail with results at report@fotonower.com refus_total : 0.1814823455182612 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25921219 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921219_12-08-2025_19_43_00.pdf results_Auto_P25921219_12-08-2025_19_43_00.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921219_12-08-2025_19_43_00.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25921219','results_Auto_P25921219_12-08-2025_19_43_00.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921219_12-08-2025_19_43_00.pdf','pdf','','0.95','0.1814823455182612') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25921219

https://www.fotonower.com/image?json=false&list_photos_id=1376619618
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619616
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619614
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619563
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619559
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619556
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619552
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619548
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619543
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619535
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619528
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619527
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619526
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619524
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619522
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619514
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619482
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619455
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619452
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619444
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619440
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619166
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.533435923237426)
https://www.fotonower.com/image?json=false&list_photos_id=1376619160
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376619129
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 18.15%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/25927310?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25927311?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25927312?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/25927316?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25927318?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25927319?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921219_12-08-2025_19_43_00.pdf.

Lien vers velours :https://www.fotonower.com/velours/25927310,25927311,25927312,25927313,25927314,25927315,25927316,25927317,25927318,25927319,25927320?tags=metal,carton,autre,environnement,flou,mal_croppe,pet_fonce,background,pet_clair,papier,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 12 Aug 2025 17:43:07 GMT Content-Length: 0 Connection: close X-Message-Id: wPGzIGu8TYup_Bp4qyVajA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1376619618, 1376619616, 1376619614, 1376619563, 1376619559, 1376619556, 1376619552, 1376619548, 1376619543, 1376619535, 1376619528, 1376619527, 1376619526, 1376619524, 1376619522, 1376619514, 1376619482, 1376619455, 1376619452, 1376619444, 1376619440, 1376619166, 1376619160, 1376619129] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619618', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619616', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619614', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619563', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619559', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619556', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619552', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619548', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619543', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619535', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619528', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619527', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619526', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619524', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619522', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619514', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619482', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619455', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619452', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619444', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619440', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619166', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619160', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619129', None, None, None, None, None, '3514638') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.0161440372467041 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.908631801605225 time spend to save output : 0.016429901123046875 total time spend for step 9 : 6.9250617027282715 step10:split_time_score Tue Aug 12 19:43:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 24),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12082025 25921219 Nombre de photos uploadées : 24 / 23040 (0%) 12082025 25921219 Nombre de photos taguées (types de déchets): 0 / 24 (0%) 12082025 25921219 Nombre de photos taguées (volume) : 0 / 24 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ???????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0010776519775390625 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19938063621520996 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08963755666473765 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907306_12-08-2025_12_02_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907306 AND mptpi.`type`=3594 To do Qualite : 0.2198127786351166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908856_12-08-2025_12_01_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908856 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908856 AND mptpi.`type`=3594 To do Qualite : 0.11567090446566358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908860_12-08-2025_13_02_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908860 AND mptpi.`type`=3594 To do Qualite : 0.03421356577932099 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908864_12-08-2025_11_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908864 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908864 AND mptpi.`type`=3594 To do Qualite : 0.09985528962742503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907315_12-08-2025_12_41_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907315 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907315 AND mptpi.`type`=3594 To do Qualite : 0.24285493827160495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907317_12-08-2025_13_21_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907317 AND mptpi.`type`=3594 To do Qualite : 0.021655971995279587 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907323_12-08-2025_11_22_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907323 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907323 AND mptpi.`type`=3594 To do Qualite : 0.06390883349867725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907331_12-08-2025_12_21_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907331 AND mptpi.`type`=3594 To do Qualite : 0.06239004629629628 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922558_12-08-2025_18_12_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25922558 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25922558 AND mptpi.`type`=3594 To do Qualite : 0.019449749228395066 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915171_12-08-2025_15_11_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915171 AND mptpi.`type`=3594 To do Qualite : 0.0699012163204872 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915172_12-08-2025_15_03_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915172 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915172 AND mptpi.`type`=3594 To do Qualite : 0.15671019000771605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915175_12-08-2025_16_02_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915175 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915175 AND mptpi.`type`=3594 To do Qualite : 0.1134959072181458 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921213_12-08-2025_18_21_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25921213 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25921213 AND mptpi.`type`=3594 To do Qualite : 0.1814823455182612 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921219_12-08-2025_19_43_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25921219 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25921219 AND mptpi.`type`=3594 To do Qualite : 0.1663350080667789 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921229_12-08-2025_17_11_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25921229 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25921229 AND mptpi.`type`=3594 To do Qualite : 0.18296223958333335 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922565_12-08-2025_18_01_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25922565 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25922565 AND mptpi.`type`=3594 To do Qualite : 0.21775671939300406 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922569_12-08-2025_17_52_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25922569 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25922569 AND mptpi.`type`=3594 To do Qualite : 0.0516502700617284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922590_12-08-2025_17_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25922590 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25922590 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12082025': {'nb_upload': 24, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1376619618, 1376619616, 1376619614, 1376619563, 1376619559, 1376619556, 1376619552, 1376619548, 1376619543, 1376619535, 1376619528, 1376619527, 1376619526, 1376619524, 1376619522, 1376619514, 1376619482, 1376619455, 1376619452, 1376619444, 1376619440, 1376619166, 1376619160, 1376619129] Looping around the photos to save general results len do output : 1 /25921219Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619618', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619616', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619614', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619563', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619559', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619556', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619552', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619548', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619543', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619535', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619528', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619527', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619526', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619524', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619522', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619514', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619482', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619455', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619452', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619444', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619440', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619166', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619160', None, None, None, None, None, '3514638') ('3318', None, None, None, None, None, None, None, '3514638') ('3318', '25921219', '1376619129', None, None, None, None, None, '3514638') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.016803264617919922 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.346804141998291 time spend to save output : 0.017098426818847656 total time spend for step 10 : 1.3639025688171387 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 24 set_done_treatment 98.55user 36.41system 2:43.49elapsed 82%CPU (0avgtext+0avgdata 3071976maxresident)k 535976inputs+71808outputs (477major+2562714minor)pagefaults 0swaps