python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 942822 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4057936'] with mtr_portfolio_ids : ['28605915'] and first list_photo_ids : [] new path : /proc/942822/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.5699269771575928 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Nov 17 12:50:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3143 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-17 12:50:32.990648: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-17 12:50:33.022427: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-17 12:50:33.024283: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb3e0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-17 12:50:33.024332: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-17 12:50:33.028762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-17 12:50:33.290927: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1a448290 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-17 12:50:33.290983: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-17 12:50:33.292315: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-17 12:50:33.292965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-17 12:50:33.296670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-17 12:50:33.315719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-17 12:50:33.317125: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-17 12:50:33.348707: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-17 12:50:33.353011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-17 12:50:33.409085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-17 12:50:33.410268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-17 12:50:33.410688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-17 12:50:33.411271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-17 12:50:33.411293: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-17 12:50:33.411302: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-17 12:50:33.412564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2691 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-17 12:50:33.796685: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-17 12:50:33.796759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-17 12:50:33.796775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-17 12:50:33.796790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-17 12:50:33.796805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-17 12:50:33.796819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-17 12:50:33.796833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-17 12:50:33.796848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-17 12:50:33.797687: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-17 12:50:33.798607: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-17 12:50:33.798639: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-17 12:50:33.798654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-17 12:50:33.798668: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-17 12:50:33.798682: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-17 12:50:33.798695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-17 12:50:33.798708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-17 12:50:33.798722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-17 12:50:33.799549: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-17 12:50:33.799576: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-17 12:50:33.799584: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-17 12:50:33.799592: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-17 12:50:33.800466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2691 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-17 12:50:43.036141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-17 12:50:43.223315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-17 12:50:45.012965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.013046: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.013615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.013631: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.020663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.020685: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.021226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.021241: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.027748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.027769: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.028308: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.028323: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.058939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.058962: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.059518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.059532: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.065310: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.065329: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.065866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.065880: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-17 12:50:45.099648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.100203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.102029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.102593: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.148043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.148608: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.179032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.179595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.181282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.181828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.188747: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.189301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.190995: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.191544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.197293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.197841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.199389: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.199938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.226647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.227240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.227781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.228322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.232675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.233223: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.249681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.250234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.250790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.251331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.264107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.264655: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.265192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.265729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.269918: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.270480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.274948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.275494: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.287316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.287877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.291974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.292556: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.293139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.293675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.294389: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.295027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.305643: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.306189: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.306761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.307303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.307845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.308386: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.323141: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.323695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.375510: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.376091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.383908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.384452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.405681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.406531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.407348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.408150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.412515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.413321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.414120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.414944: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.416683: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.416699: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-11-17 12:50:45.426114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.426740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.442438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.443038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.443620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.444156: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.444701: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-17 12:50:45.445326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.13G (2286813184 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 943333 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1950 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3143 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00031828880310058594 nb_pixel_total : 13103 time to create 1 rle with old method : 0.015427350997924805 length of segment : 114 time for calcul the mask position with numpy : 0.00020360946655273438 nb_pixel_total : 12284 time to create 1 rle with old method : 0.01460886001586914 length of segment : 121 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 2128 time to create 1 rle with old method : 0.002599954605102539 length of segment : 40 time for calcul the mask position with numpy : 0.00045871734619140625 nb_pixel_total : 28149 time to create 1 rle with old method : 0.03248429298400879 length of segment : 256 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 5320 time to create 1 rle with old method : 0.006201505661010742 length of segment : 140 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 7598 time to create 1 rle with old method : 0.010821104049682617 length of segment : 136 time for calcul the mask position with numpy : 0.00012135505676269531 nb_pixel_total : 5234 time to create 1 rle with old method : 0.006661891937255859 length of segment : 95 time for calcul the mask position with numpy : 0.00019669532775878906 nb_pixel_total : 10399 time to create 1 rle with old method : 0.012468576431274414 length of segment : 124 time for calcul the mask position with numpy : 0.0001270771026611328 nb_pixel_total : 6701 time to create 1 rle with old method : 0.008164167404174805 length of segment : 145 time for calcul the mask position with numpy : 0.00012111663818359375 nb_pixel_total : 6660 time to create 1 rle with old method : 0.008144855499267578 length of segment : 80 time for calcul the mask position with numpy : 0.00014257431030273438 nb_pixel_total : 6182 time to create 1 rle with old method : 0.007523536682128906 length of segment : 93 time for calcul the mask position with numpy : 0.0001506805419921875 nb_pixel_total : 8801 time to create 1 rle with old method : 0.010448932647705078 length of segment : 119 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 2857 time to create 1 rle with old method : 0.003676176071166992 length of segment : 40 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2799 time to create 1 rle with old method : 0.003411531448364258 length of segment : 75 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 7694 time to create 1 rle with old method : 0.009402036666870117 length of segment : 83 time for calcul the mask position with numpy : 0.00013828277587890625 nb_pixel_total : 5716 time to create 1 rle with old method : 0.006979703903198242 length of segment : 118 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 9429 time to create 1 rle with old method : 0.011235713958740234 length of segment : 123 time for calcul the mask position with numpy : 0.00019407272338867188 nb_pixel_total : 8591 time to create 1 rle with old method : 0.015218734741210938 length of segment : 95 time for calcul the mask position with numpy : 0.00019788742065429688 nb_pixel_total : 9035 time to create 1 rle with old method : 0.015715599060058594 length of segment : 112 time for calcul the mask position with numpy : 0.00023126602172851562 nb_pixel_total : 7581 time to create 1 rle with old method : 0.00948476791381836 length of segment : 198 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 2185 time to create 1 rle with old method : 0.002824544906616211 length of segment : 45 time for calcul the mask position with numpy : 0.0002627372741699219 nb_pixel_total : 13474 time to create 1 rle with old method : 0.016263484954833984 length of segment : 143 time for calcul the mask position with numpy : 0.00015211105346679688 nb_pixel_total : 11031 time to create 1 rle with old method : 0.013645648956298828 length of segment : 83 time for calcul the mask position with numpy : 0.0006577968597412109 nb_pixel_total : 38534 time to create 1 rle with old method : 0.04461264610290527 length of segment : 259 time for calcul the mask position with numpy : 0.0001690387725830078 nb_pixel_total : 8492 time to create 1 rle with old method : 0.010349273681640625 length of segment : 116 time for calcul the mask position with numpy : 0.0003509521484375 nb_pixel_total : 25068 time to create 1 rle with old method : 0.02995157241821289 length of segment : 182 time for calcul the mask position with numpy : 0.00015473365783691406 nb_pixel_total : 7803 time to create 1 rle with old method : 0.009411096572875977 length of segment : 155 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 14525 time to create 1 rle with old method : 0.017172813415527344 length of segment : 190 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 5990 time to create 1 rle with old method : 0.007159709930419922 length of segment : 97 time for calcul the mask position with numpy : 0.000125885009765625 nb_pixel_total : 6619 time to create 1 rle with old method : 0.007833480834960938 length of segment : 132 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 7283 time to create 1 rle with old method : 0.00856637954711914 length of segment : 149 time for calcul the mask position with numpy : 0.00013208389282226562 nb_pixel_total : 4879 time to create 1 rle with old method : 0.006144523620605469 length of segment : 99 time spent for convertir_results : 1.2036795616149902 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 32 chid ids of type : 3594 Number RLEs to save : 3957 save missing photos in datou_result : time spend for datou_step_exec : 26.67858862876892 time spend to save output : 0.30876922607421875 total time spend for step 1 : 26.98735785484314 step2:crop_condition Mon Nov 17 12:50:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 32 chid ids of type : 3594 ++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763380257_942822 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328733_0.png', 0, 187, 113, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328734_0.png', 0, 172, 110, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842925_70198b0cefa93fba3f8e09f2c65ec7a3_rle_crop_4036328738_0.png', 0, 149, 133, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328740_0.png', 0, 138, 119, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328741_0.png', 0, 75, 145, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328745_0.png', 0, 122, 37, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328747_0.png', 0, 123, 83, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328743_0.png', 0, 100, 93, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328744_0.png', 0, 105, 119, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842915_f95e7c41f25835024c2a5dee14cde4d4_rle_crop_4036328749_0.png', 0, 110, 123, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842915_f95e7c41f25835024c2a5dee14cde4d4_rle_crop_4036328748_0.png', 0, 96, 117, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328750_0.png', 0, 189, 70, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328751_0.png', 0, 134, 91, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328753_0.png', 0, 65, 44, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328752_0.png', 0, 141, 198, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328757_0.png', 0, 104, 113, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328759_0.png', 0, 106, 126, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328762_0.png', 0, 66, 129, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380260), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328764_0.png', 0, 115, 99, 0, 1763380260,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.798163890838623 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763380262_942822 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380262), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842932_94b50505896dccce5d87f32b2cb6ef4c_rle_crop_4036328737_0.png', 0, 57, 139, 0, 1763380262,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380262), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328754_0.png', 0, 177, 141, 0, 1763380262,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380262), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842852_0813c8ffaee660b91efc66f88a1bdfe4_rle_crop_4036328761_0.png', 0, 80, 97, 0, 1763380262,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.852799654006958 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763380264_942822 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380265), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328735_0.png', 0, 64, 39, 0, 1763380265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380265), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842932_94b50505896dccce5d87f32b2cb6ef4c_rle_crop_4036328736_0.png', 0, 145, 256, 0, 1763380265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380265), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842925_70198b0cefa93fba3f8e09f2c65ec7a3_rle_crop_4036328739_0.png', 0, 80, 95, 0, 1763380265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380265), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328742_0.png', 0, 103, 78, 0, 1763380265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380265), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842858_7239845fb99c005d7e629851e5f5caed_rle_crop_4036328755_0.png', 0, 159, 83, 0, 1763380265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380265), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842858_7239845fb99c005d7e629851e5f5caed_rle_crop_4036328756_0.png', 0, 244, 232, 0, 1763380265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380265), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328758_0.png', 0, 167, 181, 0, 1763380265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380265), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842852_0813c8ffaee660b91efc66f88a1bdfe4_rle_crop_4036328760_0.png', 0, 111, 189, 0, 1763380265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9430339336395264 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763380266_942822 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380266), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328746_0.png', 0, 48, 75, 0, 1763380266,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763380266), 0.0, 0.0, 14, '', 0, 0, '1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328763_0.png', 0, 56, 149, 0, 1763380266,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8150877952575684 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1394842935, 1394842932, 1394842925, 1394842922, 1394842919, 1394842915, 1394842864, 1394842858, 1394842854, 1394842852, 1394842848] Looping around the photos to save general results len do output : 32 /1394861977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394861998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394862017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842935', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842932', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842925', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842922', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842919', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842915', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842864', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842858', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842854', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842852', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842848', None, None, None, None, None, '4057936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 107 time used for this insertion : 0.01817798614501953 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.001575469970703 time spend to save output : 0.019373416900634766 total time spend for step 2 : 11.020948886871338 step3:rle_unique_nms_with_priority Mon Nov 17 12:51:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 32 chid ids of type : 3594 ++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.6640510559082031 time for calcul the mask position with numpy : 0.058429718017578125 nb_pixel_total : 2046085 time to create 1 rle with new method : 0.576927900314331 time for calcul the mask position with numpy : 0.007213115692138672 nb_pixel_total : 2128 time to create 1 rle with old method : 0.0024895668029785156 time for calcul the mask position with numpy : 0.0060918331146240234 nb_pixel_total : 12284 time to create 1 rle with old method : 0.01433253288269043 time for calcul the mask position with numpy : 0.00608515739440918 nb_pixel_total : 13103 time to create 1 rle with old method : 0.015314817428588867 create new chi : 0.6971642971038818 time to delete rle : 0.025054454803466797 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1630 TO DO : save crop sub photo not yet done ! save time : 0.14964890480041504 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 1.3104827404022217 time for calcul the mask position with numpy : 0.060160160064697266 nb_pixel_total : 2040131 time to create 1 rle with new method : 1.4278538227081299 time for calcul the mask position with numpy : 0.010158777236938477 nb_pixel_total : 5320 time to create 1 rle with old method : 0.0062274932861328125 time for calcul the mask position with numpy : 0.006415367126464844 nb_pixel_total : 28149 time to create 1 rle with old method : 0.03302407264709473 create new chi : 1.553809404373169 time to delete rle : 0.0003376007080078125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1872 TO DO : save crop sub photo not yet done ! save time : 0.16352176666259766 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.052214622497558594 time for calcul the mask position with numpy : 0.064849853515625 nb_pixel_total : 2060768 time to create 1 rle with new method : 0.6446099281311035 time for calcul the mask position with numpy : 0.0060923099517822266 nb_pixel_total : 5234 time to create 1 rle with old method : 0.005915403366088867 time for calcul the mask position with numpy : 0.005937099456787109 nb_pixel_total : 7598 time to create 1 rle with old method : 0.008549928665161133 create new chi : 0.7462751865386963 time to delete rle : 0.00024247169494628906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1542 TO DO : save crop sub photo not yet done ! save time : 0.13583040237426758 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07167530059814453 time for calcul the mask position with numpy : 3.272103786468506 nb_pixel_total : 2049840 time to create 1 rle with new method : 2.1960363388061523 time for calcul the mask position with numpy : 0.007285118103027344 nb_pixel_total : 6660 time to create 1 rle with old method : 0.0076639652252197266 time for calcul the mask position with numpy : 0.006006002426147461 nb_pixel_total : 6701 time to create 1 rle with old method : 0.00762629508972168 time for calcul the mask position with numpy : 0.006517648696899414 nb_pixel_total : 10399 time to create 1 rle with old method : 0.011852264404296875 create new chi : 5.525776147842407 time to delete rle : 0.0002694129943847656 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1778 TO DO : save crop sub photo not yet done ! save time : 0.14912986755371094 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 1.3614928722381592 time for calcul the mask position with numpy : 2.931908130645752 nb_pixel_total : 2045267 time to create 1 rle with new method : 0.07663321495056152 time for calcul the mask position with numpy : 0.006139516830444336 nb_pixel_total : 7694 time to create 1 rle with old method : 0.008914709091186523 time for calcul the mask position with numpy : 0.0062754154205322266 nb_pixel_total : 2799 time to create 1 rle with old method : 0.0033304691314697266 time for calcul the mask position with numpy : 0.005948305130004883 nb_pixel_total : 2857 time to create 1 rle with old method : 0.0032410621643066406 time for calcul the mask position with numpy : 0.006049394607543945 nb_pixel_total : 8801 time to create 1 rle with old method : 0.010426998138427734 time for calcul the mask position with numpy : 0.006224632263183594 nb_pixel_total : 6182 time to create 1 rle with old method : 0.00727081298828125 create new chi : 3.0831191539764404 time to delete rle : 0.00026345252990722656 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 1900 TO DO : save crop sub photo not yet done ! save time : 0.17328715324401855 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.041528940200805664 time for calcul the mask position with numpy : 0.018590211868286133 nb_pixel_total : 2058455 time to create 1 rle with new method : 0.49491405487060547 time for calcul the mask position with numpy : 0.005908966064453125 nb_pixel_total : 9429 time to create 1 rle with old method : 0.010720968246459961 time for calcul the mask position with numpy : 0.006060600280761719 nb_pixel_total : 5716 time to create 1 rle with old method : 0.006632089614868164 create new chi : 0.5430994033813477 time to delete rle : 0.0002391338348388672 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1562 TO DO : save crop sub photo not yet done ! save time : 0.1423487663269043 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.7110321521759033 time for calcul the mask position with numpy : 0.7184123992919922 nb_pixel_total : 2032734 time to create 1 rle with new method : 0.07857155799865723 time for calcul the mask position with numpy : 0.00605010986328125 nb_pixel_total : 13474 time to create 1 rle with old method : 0.015041112899780273 time for calcul the mask position with numpy : 0.010122060775756836 nb_pixel_total : 2185 time to create 1 rle with old method : 0.0026192665100097656 time for calcul the mask position with numpy : 0.006116151809692383 nb_pixel_total : 7581 time to create 1 rle with old method : 0.009140253067016602 time for calcul the mask position with numpy : 0.006179332733154297 nb_pixel_total : 9035 time to create 1 rle with old method : 0.010673999786376953 time for calcul the mask position with numpy : 0.00677180290222168 nb_pixel_total : 8591 time to create 1 rle with old method : 0.011820316314697266 create new chi : 0.8920409679412842 time to delete rle : 0.0003917217254638672 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2266 TO DO : save crop sub photo not yet done ! save time : 0.1749560832977295 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05362081527709961 time for calcul the mask position with numpy : 0.018915891647338867 nb_pixel_total : 2024035 time to create 1 rle with new method : 0.5176112651824951 time for calcul the mask position with numpy : 0.006418943405151367 nb_pixel_total : 38534 time to create 1 rle with old method : 0.045343637466430664 time for calcul the mask position with numpy : 0.006623506546020508 nb_pixel_total : 11031 time to create 1 rle with old method : 0.013056516647338867 create new chi : 0.608302116394043 time to delete rle : 0.00029587745666503906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1764 TO DO : save crop sub photo not yet done ! save time : 0.1442582607269287 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.048790693283081055 time for calcul the mask position with numpy : 0.018905162811279297 nb_pixel_total : 2032237 time to create 1 rle with new method : 1.478926658630371 time for calcul the mask position with numpy : 0.0060918331146240234 nb_pixel_total : 7803 time to create 1 rle with old method : 0.009025812149047852 time for calcul the mask position with numpy : 0.006103992462158203 nb_pixel_total : 25068 time to create 1 rle with old method : 0.028919696807861328 time for calcul the mask position with numpy : 0.005980730056762695 nb_pixel_total : 8492 time to create 1 rle with old method : 0.009669780731201172 create new chi : 1.5729641914367676 time to delete rle : 0.0002796649932861328 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1986 TO DO : save crop sub photo not yet done ! save time : 0.16351079940795898 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.08437061309814453 time for calcul the mask position with numpy : 2.726867437362671 nb_pixel_total : 2053085 time to create 1 rle with new method : 2.1675994396209717 time for calcul the mask position with numpy : 0.01041102409362793 nb_pixel_total : 5990 time to create 1 rle with old method : 0.00683903694152832 time for calcul the mask position with numpy : 0.006066322326660156 nb_pixel_total : 14525 time to create 1 rle with old method : 0.01660943031311035 create new chi : 4.945034027099609 time to delete rle : 0.000286102294921875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1654 TO DO : save crop sub photo not yet done ! save time : 0.13801884651184082 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.11057543754577637 time for calcul the mask position with numpy : 0.2582428455352783 nb_pixel_total : 2054819 time to create 1 rle with new method : 0.9118766784667969 time for calcul the mask position with numpy : 0.0060176849365234375 nb_pixel_total : 4879 time to create 1 rle with old method : 0.00547027587890625 time for calcul the mask position with numpy : 0.005877971649169922 nb_pixel_total : 7283 time to create 1 rle with old method : 0.008258342742919922 time for calcul the mask position with numpy : 0.006010532379150391 nb_pixel_total : 6619 time to create 1 rle with old method : 0.007578372955322266 create new chi : 1.2198641300201416 time to delete rle : 0.00026106834411621094 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1840 TO DO : save crop sub photo not yet done ! save time : 0.1567981243133545 map_output_result : {1394842935: (0.0, 'Should be the crop_list due to order', 0), 1394842932: (0.0, 'Should be the crop_list due to order', 0), 1394842925: (0.0, 'Should be the crop_list due to order', 0), 1394842922: (0.0, 'Should be the crop_list due to order', 0), 1394842919: (0.0, 'Should be the crop_list due to order', 0), 1394842915: (0.0, 'Should be the crop_list due to order', 0), 1394842864: (0.0, 'Should be the crop_list due to order', 0), 1394842858: (0.0, 'Should be the crop_list due to order', 0), 1394842854: (0.0, 'Should be the crop_list due to order', 0), 1394842852: (0.0, 'Should be the crop_list due to order', 0), 1394842848: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1394842935, 1394842932, 1394842925, 1394842922, 1394842919, 1394842915, 1394842864, 1394842858, 1394842854, 1394842852, 1394842848] Looping around the photos to save general results len do output : 11 /1394842935.Didn't retrieve data . /1394842932.Didn't retrieve data . /1394842925.Didn't retrieve data . /1394842922.Didn't retrieve data . /1394842919.Didn't retrieve data . /1394842915.Didn't retrieve data . /1394842864.Didn't retrieve data . /1394842858.Didn't retrieve data . /1394842854.Didn't retrieve data . /1394842852.Didn't retrieve data . /1394842848.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842935', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842932', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842925', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842922', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842919', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842915', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842864', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842858', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842854', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842852', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842848', None, None, None, None, None, '4057936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.014908552169799805 save_final save missing photos in datou_result : time spend for datou_step_exec : 28.997925281524658 time spend to save output : 0.015366554260253906 total time spend for step 3 : 29.013291835784912 step4:ventilate_hashtags_in_portfolio Mon Nov 17 12:51:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28605915 get user id for portfolio 28605915 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28605915 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','background','pehd','pet_fonce','metal','mal_croppe','flou','autre','environnement','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28605915 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','background','pehd','pet_fonce','metal','mal_croppe','flou','autre','environnement','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28605915 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','background','pehd','pet_fonce','metal','mal_croppe','flou','autre','environnement','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28606277,28606278,28606279,28606280,28606281,28606282,28606283,28606284,28606285,28606286,28606287?tags=papier,pet_clair,background,pehd,pet_fonce,metal,mal_croppe,flou,autre,environnement,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1394842935, 1394842932, 1394842925, 1394842922, 1394842919, 1394842915, 1394842864, 1394842858, 1394842854, 1394842852, 1394842848] Looping around the photos to save general results len do output : 1 /28605915. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842935', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842932', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842925', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842922', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842919', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842915', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842864', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842858', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842854', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842852', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842848', None, None, None, None, None, '4057936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01831793785095215 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6618728637695312 time spend to save output : 0.018570423126220703 total time spend for step 4 : 1.680443286895752 step5:final Mon Nov 17 12:51:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1394842935: ('0.013684764309764312',), 1394842932: ('0.013684764309764312',), 1394842925: ('0.013684764309764312',), 1394842922: ('0.013684764309764312',), 1394842919: ('0.013684764309764312',), 1394842915: ('0.013684764309764312',), 1394842864: ('0.013684764309764312',), 1394842858: ('0.013684764309764312',), 1394842854: ('0.013684764309764312',), 1394842852: ('0.013684764309764312',), 1394842848: ('0.013684764309764312',)} new output for save of step final : {1394842935: ('0.013684764309764312',), 1394842932: ('0.013684764309764312',), 1394842925: ('0.013684764309764312',), 1394842922: ('0.013684764309764312',), 1394842919: ('0.013684764309764312',), 1394842915: ('0.013684764309764312',), 1394842864: ('0.013684764309764312',), 1394842858: ('0.013684764309764312',), 1394842854: ('0.013684764309764312',), 1394842852: ('0.013684764309764312',), 1394842848: ('0.013684764309764312',)} [1394842935, 1394842932, 1394842925, 1394842922, 1394842919, 1394842915, 1394842864, 1394842858, 1394842854, 1394842852, 1394842848] Looping around the photos to save general results len do output : 11 /1394842935.Didn't retrieve data . /1394842932.Didn't retrieve data . /1394842925.Didn't retrieve data . /1394842922.Didn't retrieve data . /1394842919.Didn't retrieve data . /1394842915.Didn't retrieve data . /1394842864.Didn't retrieve data . /1394842858.Didn't retrieve data . /1394842854.Didn't retrieve data . /1394842852.Didn't retrieve data . /1394842848.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842935', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842932', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842925', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842922', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842919', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842915', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842864', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842858', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842854', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842852', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842848', None, None, None, None, None, '4057936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01430964469909668 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11824297904968262 time spend to save output : 0.014859914779663086 total time spend for step 5 : 0.1331028938293457 step6:blur_detection Mon Nov 17 12:51:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec.jpg resize: (1080, 1920) 1394842935 0.6535257122386795 treat image : temp/1763380227_942822_1394842932_94b50505896dccce5d87f32b2cb6ef4c.jpg resize: (1080, 1920) 1394842932 0.46581706578910786 treat image : temp/1763380227_942822_1394842925_70198b0cefa93fba3f8e09f2c65ec7a3.jpg resize: (1080, 1920) 1394842925 1.357891139111349 treat image : temp/1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df.jpg resize: (1080, 1920) 1394842922 0.31896590247629714 treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619.jpg resize: (1080, 1920) 1394842919 1.3494312713595429 treat image : temp/1763380227_942822_1394842915_f95e7c41f25835024c2a5dee14cde4d4.jpg resize: (1080, 1920) 1394842915 1.1634623713693242 treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4.jpg resize: (1080, 1920) 1394842864 1.692367742055141 treat image : temp/1763380227_942822_1394842858_7239845fb99c005d7e629851e5f5caed.jpg resize: (1080, 1920) 1394842858 -0.2502965993814889 treat image : temp/1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e.jpg resize: (1080, 1920) 1394842854 0.3484958314934105 treat image : temp/1763380227_942822_1394842852_0813c8ffaee660b91efc66f88a1bdfe4.jpg resize: (1080, 1920) 1394842852 1.7225714735051538 treat image : temp/1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c.jpg resize: (1080, 1920) 1394842848 2.2927951858098905 treat image : temp/1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328733_0.png resize: (113, 187) 1394861977 -0.20538647366328758 treat image : temp/1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328734_0.png resize: (110, 172) 1394861978 -1.5605655024230514 treat image : temp/1763380227_942822_1394842925_70198b0cefa93fba3f8e09f2c65ec7a3_rle_crop_4036328738_0.png resize: (133, 149) 1394861979 -1.4798209227859525 treat image : temp/1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328740_0.png resize: (119, 138) 1394861980 -1.3675727108881335 treat image : temp/1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328741_0.png resize: (145, 75) 1394861981 -1.0145273133264956 treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328745_0.png resize: (37, 122) 1394861982 -1.8834031618471643 treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328747_0.png resize: (83, 123) 1394861983 -1.8965645085281686 treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328743_0.png resize: (93, 100) 1394861984 -1.2870190379783362 treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328744_0.png resize: (119, 105) 1394861985 -1.0678136201430146 treat image : temp/1763380227_942822_1394842915_f95e7c41f25835024c2a5dee14cde4d4_rle_crop_4036328749_0.png resize: (123, 110) 1394861986 -1.4075932242719635 treat image : temp/1763380227_942822_1394842915_f95e7c41f25835024c2a5dee14cde4d4_rle_crop_4036328748_0.png resize: (117, 96) 1394861987 -1.7086019333390352 treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328750_0.png resize: (70, 189) 1394861988 -1.4488376532132456 treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328751_0.png resize: (91, 134) 1394861989 1.080631345357103 treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328753_0.png resize: (44, 65) 1394861990 0.9212133475771873 treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328752_0.png resize: (198, 141) 1394861991 -2.70037606227299 treat image : temp/1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328757_0.png resize: (113, 104) 1394861992 0.41153836583637354 treat image : temp/1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328759_0.png resize: (126, 106) 1394861993 -1.1466002364450938 treat image : temp/1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328762_0.png resize: (129, 66) 1394861994 -0.2704554000601008 treat image : temp/1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328764_0.png resize: (99, 115) 1394861995 -2.302485472796322 treat image : temp/1763380227_942822_1394842932_94b50505896dccce5d87f32b2cb6ef4c_rle_crop_4036328737_0.png resize: (139, 57) 1394861996 -0.9683171450083264 treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328754_0.png resize: (141, 177) 1394861997 -2.06489679320657 treat image : temp/1763380227_942822_1394842852_0813c8ffaee660b91efc66f88a1bdfe4_rle_crop_4036328761_0.png resize: (97, 80) 1394861998 -0.24438821606339192 treat image : temp/1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328735_0.png resize: (39, 64) 1394862004 -0.4072300229951185 treat image : temp/1763380227_942822_1394842932_94b50505896dccce5d87f32b2cb6ef4c_rle_crop_4036328736_0.png resize: (256, 145) 1394862006 -0.5728904705440572 treat image : temp/1763380227_942822_1394842925_70198b0cefa93fba3f8e09f2c65ec7a3_rle_crop_4036328739_0.png resize: (95, 80) 1394862008 -0.7606952830698553 treat image : temp/1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328742_0.png resize: (78, 103) 1394862010 -2.82382858410984 treat image : temp/1763380227_942822_1394842858_7239845fb99c005d7e629851e5f5caed_rle_crop_4036328755_0.png resize: (83, 159) 1394862011 -1.2104325035419774 treat image : temp/1763380227_942822_1394842858_7239845fb99c005d7e629851e5f5caed_rle_crop_4036328756_0.png resize: (232, 244) 1394862012 -0.977685961562346 treat image : temp/1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328758_0.png resize: (181, 167) 1394862013 -0.518032679030201 treat image : temp/1763380227_942822_1394842852_0813c8ffaee660b91efc66f88a1bdfe4_rle_crop_4036328760_0.png resize: (189, 111) 1394862014 -0.40640508315032187 treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328746_0.png resize: (75, 48) 1394862016 -0.6151227193598577 treat image : temp/1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328763_0.png resize: (149, 56) 1394862017 1.6284456587147011 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 43 time used for this insertion : 0.013951301574707031 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 43 time used for this insertion : 0.01594686508178711 save missing photos in datou_result : time spend for datou_step_exec : 8.66943073272705 time spend to save output : 0.03462076187133789 total time spend for step 6 : 8.704051494598389 step7:brightness Mon Nov 17 12:51:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec.jpg treat image : temp/1763380227_942822_1394842932_94b50505896dccce5d87f32b2cb6ef4c.jpg treat image : temp/1763380227_942822_1394842925_70198b0cefa93fba3f8e09f2c65ec7a3.jpg treat image : temp/1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df.jpg treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619.jpg treat image : temp/1763380227_942822_1394842915_f95e7c41f25835024c2a5dee14cde4d4.jpg treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4.jpg treat image : temp/1763380227_942822_1394842858_7239845fb99c005d7e629851e5f5caed.jpg treat image : temp/1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e.jpg treat image : temp/1763380227_942822_1394842852_0813c8ffaee660b91efc66f88a1bdfe4.jpg treat image : temp/1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c.jpg treat image : temp/1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328733_0.png treat image : temp/1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328734_0.png treat image : temp/1763380227_942822_1394842925_70198b0cefa93fba3f8e09f2c65ec7a3_rle_crop_4036328738_0.png treat image : temp/1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328740_0.png treat image : temp/1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328741_0.png treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328745_0.png treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328747_0.png treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328743_0.png treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328744_0.png treat image : temp/1763380227_942822_1394842915_f95e7c41f25835024c2a5dee14cde4d4_rle_crop_4036328749_0.png treat image : temp/1763380227_942822_1394842915_f95e7c41f25835024c2a5dee14cde4d4_rle_crop_4036328748_0.png treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328750_0.png treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328751_0.png treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328753_0.png treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328752_0.png treat image : temp/1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328757_0.png treat image : temp/1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328759_0.png treat image : temp/1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328762_0.png treat image : temp/1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328764_0.png treat image : temp/1763380227_942822_1394842932_94b50505896dccce5d87f32b2cb6ef4c_rle_crop_4036328737_0.png treat image : temp/1763380227_942822_1394842864_8b1237f630a5bd8da398f0b7c68225e4_rle_crop_4036328754_0.png treat image : temp/1763380227_942822_1394842852_0813c8ffaee660b91efc66f88a1bdfe4_rle_crop_4036328761_0.png treat image : temp/1763380227_942822_1394842935_54f7e0eca5362c9d6adeced188eb2bec_rle_crop_4036328735_0.png treat image : temp/1763380227_942822_1394842932_94b50505896dccce5d87f32b2cb6ef4c_rle_crop_4036328736_0.png treat image : temp/1763380227_942822_1394842925_70198b0cefa93fba3f8e09f2c65ec7a3_rle_crop_4036328739_0.png treat image : temp/1763380227_942822_1394842922_e5557b6f1fe8aa424ac385a7b7de47df_rle_crop_4036328742_0.png treat image : temp/1763380227_942822_1394842858_7239845fb99c005d7e629851e5f5caed_rle_crop_4036328755_0.png treat image : temp/1763380227_942822_1394842858_7239845fb99c005d7e629851e5f5caed_rle_crop_4036328756_0.png treat image : temp/1763380227_942822_1394842854_09f5c7bf93f9af2f82ec124755a93f0e_rle_crop_4036328758_0.png treat image : temp/1763380227_942822_1394842852_0813c8ffaee660b91efc66f88a1bdfe4_rle_crop_4036328760_0.png treat image : temp/1763380227_942822_1394842919_0a8d0632a23b12059c3a39088ceaa619_rle_crop_4036328746_0.png treat image : temp/1763380227_942822_1394842848_e919e9ac87c33bc95a88bf360a97268c_rle_crop_4036328763_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 43 time used for this insertion : 0.014113426208496094 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 43 time used for this insertion : 0.01385498046875 save missing photos in datou_result : time spend for datou_step_exec : 2.4614288806915283 time spend to save output : 0.03306388854980469 total time spend for step 7 : 2.494492769241333 step8:velours_tree Mon Nov 17 12:51:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.21132707595825195 time spend to save output : 3.695487976074219e-05 total time spend for step 8 : 0.2113640308380127 step9:send_mail_cod Mon Nov 17 12:51:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28605915_17-11-2025_12_51_49.pdf 28606277 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286062771763380309 28606278 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286062781763380311 28606279 imagette286062791763380312 28606280 imagette286062801763380312 28606281 imagette286062811763380312 28606282 imagette286062821763380312 28606283 imagette286062831763380312 28606284 imagette286062841763380312 28606285 change filename to text .change filename to text .imagette286062851763380312 28606287 change filename to text .change filename to text .change filename to text .imagette286062871763380312 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28605915 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28606277,28606278,28606279,28606280,28606281,28606282,28606283,28606284,28606285,28606286,28606287?tags=papier,pet_clair,background,pehd,pet_fonce,metal,mal_croppe,flou,autre,environnement,carton args[1394842935] : ((1394842935, 0.6535257122386795, 492688767), (1394842935, 0.8814651633774416, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842932] : ((1394842932, 0.46581706578910786, 492688767), (1394842932, 0.9314220121274535, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842925] : ((1394842925, 1.357891139111349, 492688767), (1394842925, 0.78943443670092, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842922] : ((1394842922, 0.31896590247629714, 492688767), (1394842922, 0.5411575624664944, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842919] : ((1394842919, 1.3494312713595429, 492688767), (1394842919, 0.3424652413352404, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842915] : ((1394842915, 1.1634623713693242, 492688767), (1394842915, 0.3251249301790937, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842864] : ((1394842864, 1.692367742055141, 492688767), (1394842864, 0.7485269719570177, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842858] : ((1394842858, -0.2502965993814889, 492688767), (1394842858, 0.5465358819790387, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842854] : ((1394842854, 0.3484958314934105, 492688767), (1394842854, 0.7449204083547757, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842852] : ((1394842852, 1.7225714735051538, 492688767), (1394842852, 0.7103244055652808, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com args[1394842848] : ((1394842848, 2.2927951858098905, 492688767), (1394842848, 0.7953275404601058, 2107752395), '0.013684764309764312') We are sending mail with results at report@fotonower.com refus_total : 0.013684764309764312 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28605915 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28605915_17-11-2025_12_51_49.pdf results_Auto_P28605915_17-11-2025_12_51_49.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28605915_17-11-2025_12_51_49.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28605915','results_Auto_P28605915_17-11-2025_12_51_49.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28605915_17-11-2025_12_51_49.pdf','pdf','','0.15','0.013684764309764312') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28605915

https://www.fotonower.com/image?json=false&list_photos_id=1394842935
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394842932
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394842925
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.357891139111349)
https://www.fotonower.com/image?json=false&list_photos_id=1394842922
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394842919
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3494312713595429)
https://www.fotonower.com/image?json=false&list_photos_id=1394842915
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1634623713693242)
https://www.fotonower.com/image?json=false&list_photos_id=1394842864
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.692367742055141)
https://www.fotonower.com/image?json=false&list_photos_id=1394842858
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394842854
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394842852
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.7225714735051538)
https://www.fotonower.com/image?json=false&list_photos_id=1394842848
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.2927951858098905)

Dans ces conditions,le taux de refus est: 1.37%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28606277?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28606278?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28606285?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28606287?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28605915_17-11-2025_12_51_49.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28606277,28606278,28606279,28606280,28606281,28606282,28606283,28606284,28606285,28606286,28606287?tags=papier,pet_clair,background,pehd,pet_fonce,metal,mal_croppe,flou,autre,environnement,carton.


L'équipe Fotonower 202 b'' Date: Mon, 17 Nov 2025 11:51:54 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: KUWPPqFATI-AjMwzX287cA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1394842935, 1394842932, 1394842925, 1394842922, 1394842919, 1394842915, 1394842864, 1394842858, 1394842854, 1394842852, 1394842848] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842935', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842932', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842925', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842922', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842919', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842915', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842864', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842858', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842854', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842852', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842848', None, None, None, None, None, '4057936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.019632577896118164 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.252218961715698 time spend to save output : 0.019840478897094727 total time spend for step 9 : 5.272059440612793 step10:split_time_score Mon Nov 17 12:51:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17112025 28605915 Nombre de photos uploadées : 11 / 23040 (0%) 17112025 28605915 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 17112025 28605915 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006144046783447266 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20572566986083984 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09082348733281893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28596960_17-11-2025_09_51_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28596960 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28596960 AND mptpi.`type`=3594 To do Qualite : 0.19841861175411526 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28596965_17-11-2025_09_32_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28596965 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28596965 AND mptpi.`type`=3594 To do Qualite : 0.02238912197788066 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28596970_17-11-2025_09_21_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28596970 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28596970 AND mptpi.`type`=3594 To do Qualite : 0.1744553755144033 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28596986_17-11-2025_09_11_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28596986 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28596986 AND mptpi.`type`=3594 To do Qualite : 0.013684764309764312 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28605915_17-11-2025_12_51_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28605915 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28605915 AND mptpi.`type`=3594 To do Qualite : 0.0372693814977258 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28605917_17-11-2025_12_41_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28605917 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28605917 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17112025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1394842935, 1394842932, 1394842925, 1394842922, 1394842919, 1394842915, 1394842864, 1394842858, 1394842854, 1394842852, 1394842848] Looping around the photos to save general results len do output : 1 /28605915Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842935', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842932', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842925', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842922', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842919', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842915', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842864', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842858', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842854', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842852', None, None, None, None, None, '4057936') ('3318', None, None, None, None, None, None, None, '4057936') ('3318', '28605915', '1394842848', None, None, None, None, None, '4057936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01826643943786621 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7423815727233887 time spend to save output : 0.018520355224609375 total time spend for step 10 : 0.760901927947998 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 31.08user 41.11system 1:30.17elapsed 80%CPU (0avgtext+0avgdata 2732476maxresident)k 2033448inputs+9096outputs (7303major+1567926minor)pagefaults 0swaps