python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 242465 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2966047'] with mtr_portfolio_ids : ['23376513'] and first list_photo_ids : [] new path : /proc/242465/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.6119062900543213 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 27 12:50:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1506 wait 20 seconds l 3637 free memory gpu now : 1506 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-27 12:50:50.962254: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-27 12:50:50.995324: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-27 12:50:50.997422: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3518000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-27 12:50:50.997456: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-27 12:50:51.001683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-27 12:50:51.241257: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1eab4d50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-27 12:50:51.241313: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-27 12:50:51.242052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:50:51.242340: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:50:51.244523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:50:51.246648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:50:51.247000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:50:51.249422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:50:51.250524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:50:51.255404: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:50:51.256425: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:50:51.256507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:50:51.257045: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 12:50:51.257060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 12:50:51.257081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 12:50:51.257871: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1129 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-27 12:50:51.516584: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:50:51.516681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:50:51.516710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:50:51.516735: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:50:51.516759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:50:51.516783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:50:51.516808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:50:51.516832: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:50:51.517970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:50:51.519141: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:50:51.519189: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:50:51.519214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:50:51.519237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:50:51.519260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:50:51.519283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:50:51.519306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:50:51.519329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:50:51.520428: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:50:51.520453: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 12:50:51.520461: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 12:50:51.520468: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 12:50:51.521260: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1129 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-27 12:51:00.664087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:51:00.874303: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:51:01.563692: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:01.578100: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:03.172884: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:03.175790: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:04.679088: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:04.680868: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:05.973097: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:05.974433: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:07.397230: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:07.399012: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:09.637883: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:09.639707: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-27 12:51:13.036032: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.036094: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.042544: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.042569: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.049100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.049134: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.049617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.049632: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.079770: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.079803: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.085587: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.085609: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.086102: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.086118: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:51:13.120911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.121378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.194213: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.194723: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.196221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.196731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.203269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.203767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.209295: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.209789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.211276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.211774: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.237713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.238176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.238630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.239090: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.242456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.242941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.258064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.258564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.259060: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.259515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.271604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.272085: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.280250: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.280748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.292441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.292936: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.296908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.297369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.297990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.298488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.309022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.309530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.310038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.310530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.311052: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.311549: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.370404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.371085: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.378993: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.379502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.396266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.396889: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.397507: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.398111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.402271: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.402882: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.403513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.404119: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.405023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.405040: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-27 12:51:13.415338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.415837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.424834: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.425333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.425814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.426301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.426763: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:51:13.427273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1748343026_242465_1361272570_b5f6127c5b07323026003ac404a636fa.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/LoopCond/_22/_118]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1748343026_242465_1361272568_25be7d772eaeb2c111c9d00db2fb3558.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/LoopCond/_22/_118]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1748343026_242465_1361272566_dcac19ad25775dec2e978cccb6173736.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/LoopCond/_22/_118]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1748343026_242465_1361272558_c310ff78fb4929e71368ac3ad2ad15da.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/LoopCond/_22/_118]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1748343026_242465_1361272518_9728dbdc80489158e5b02ff82b58b302.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/LoopCond/_22/_118]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1748343026_242465_1361272502_616335224e859d11a8e9212395fb1ac9.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/LoopCond/_22/_118]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 17 Detection mask done ! Trying to reset tf kernel 243821 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 103 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1506 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004650592803955078 nb_pixel_total : 89646 time to create 1 rle with old method : 0.11875438690185547 length of segment : 251 time for calcul the mask position with numpy : 0.0022487640380859375 nb_pixel_total : 80859 time to create 1 rle with old method : 0.09301400184631348 length of segment : 536 time for calcul the mask position with numpy : 0.0037271976470947266 nb_pixel_total : 93948 time to create 1 rle with old method : 0.10754942893981934 length of segment : 235 time for calcul the mask position with numpy : 0.0040514469146728516 nb_pixel_total : 150093 time to create 1 rle with new method : 0.01085042953491211 length of segment : 455 time for calcul the mask position with numpy : 0.005019187927246094 nb_pixel_total : 154565 time to create 1 rle with new method : 0.011076211929321289 length of segment : 450 time for calcul the mask position with numpy : 0.0004067420959472656 nb_pixel_total : 10990 time to create 1 rle with old method : 0.013209104537963867 length of segment : 140 time for calcul the mask position with numpy : 0.0009737014770507812 nb_pixel_total : 51828 time to create 1 rle with old method : 0.06366109848022461 length of segment : 223 time for calcul the mask position with numpy : 0.0006780624389648438 nb_pixel_total : 38535 time to create 1 rle with old method : 0.04714345932006836 length of segment : 223 time for calcul the mask position with numpy : 0.0008997917175292969 nb_pixel_total : 9890 time to create 1 rle with old method : 0.012395620346069336 length of segment : 304 time for calcul the mask position with numpy : 0.007409572601318359 nb_pixel_total : 208367 time to create 1 rle with new method : 0.014585733413696289 length of segment : 532 time for calcul the mask position with numpy : 0.004874706268310547 nb_pixel_total : 136224 time to create 1 rle with old method : 0.15526819229125977 length of segment : 417 time for calcul the mask position with numpy : 0.0022001266479492188 nb_pixel_total : 33635 time to create 1 rle with old method : 0.039218902587890625 length of segment : 458 time for calcul the mask position with numpy : 0.0025129318237304688 nb_pixel_total : 75578 time to create 1 rle with old method : 0.10590696334838867 length of segment : 321 time for calcul the mask position with numpy : 0.0008707046508789062 nb_pixel_total : 24494 time to create 1 rle with old method : 0.028020620346069336 length of segment : 166 time for calcul the mask position with numpy : 0.0037899017333984375 nb_pixel_total : 130695 time to create 1 rle with old method : 0.1417996883392334 length of segment : 372 time for calcul the mask position with numpy : 0.0009164810180664062 nb_pixel_total : 11027 time to create 1 rle with old method : 0.012809991836547852 length of segment : 135 time for calcul the mask position with numpy : 0.0013899803161621094 nb_pixel_total : 31669 time to create 1 rle with old method : 0.03708338737487793 length of segment : 267 time for calcul the mask position with numpy : 0.0009300708770751953 nb_pixel_total : 26060 time to create 1 rle with old method : 0.03005194664001465 length of segment : 152 time for calcul the mask position with numpy : 0.0004754066467285156 nb_pixel_total : 10549 time to create 1 rle with old method : 0.011833667755126953 length of segment : 181 time for calcul the mask position with numpy : 0.005795001983642578 nb_pixel_total : 130019 time to create 1 rle with old method : 0.14973902702331543 length of segment : 463 time for calcul the mask position with numpy : 0.0034673213958740234 nb_pixel_total : 83652 time to create 1 rle with old method : 0.09418892860412598 length of segment : 351 time for calcul the mask position with numpy : 0.0006682872772216797 nb_pixel_total : 45928 time to create 1 rle with old method : 0.05226874351501465 length of segment : 191 time for calcul the mask position with numpy : 0.0015211105346679688 nb_pixel_total : 90327 time to create 1 rle with old method : 0.1054847240447998 length of segment : 425 time for calcul the mask position with numpy : 0.0013384819030761719 nb_pixel_total : 66723 time to create 1 rle with old method : 0.07629847526550293 length of segment : 327 time for calcul the mask position with numpy : 0.0003883838653564453 nb_pixel_total : 22409 time to create 1 rle with old method : 0.025731563568115234 length of segment : 157 time for calcul the mask position with numpy : 0.0004489421844482422 nb_pixel_total : 24835 time to create 1 rle with old method : 0.028825998306274414 length of segment : 290 time for calcul the mask position with numpy : 0.0011539459228515625 nb_pixel_total : 77181 time to create 1 rle with old method : 0.08710289001464844 length of segment : 245 time for calcul the mask position with numpy : 0.0011970996856689453 nb_pixel_total : 76222 time to create 1 rle with old method : 0.08354926109313965 length of segment : 380 time for calcul the mask position with numpy : 0.0007107257843017578 nb_pixel_total : 36722 time to create 1 rle with old method : 0.04045581817626953 length of segment : 250 time for calcul the mask position with numpy : 0.0009694099426269531 nb_pixel_total : 56530 time to create 1 rle with old method : 0.06490874290466309 length of segment : 432 time for calcul the mask position with numpy : 0.0002269744873046875 nb_pixel_total : 14491 time to create 1 rle with old method : 0.017017126083374023 length of segment : 114 time for calcul the mask position with numpy : 0.0005710124969482422 nb_pixel_total : 33364 time to create 1 rle with old method : 0.037238359451293945 length of segment : 341 time for calcul the mask position with numpy : 0.00030994415283203125 nb_pixel_total : 20445 time to create 1 rle with old method : 0.023907899856567383 length of segment : 165 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 17292 time to create 1 rle with old method : 0.019423723220825195 length of segment : 159 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 8830 time to create 1 rle with old method : 0.009720802307128906 length of segment : 95 time for calcul the mask position with numpy : 0.0006082057952880859 nb_pixel_total : 28933 time to create 1 rle with old method : 0.03161454200744629 length of segment : 131 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 10459 time to create 1 rle with old method : 0.012267827987670898 length of segment : 79 time for calcul the mask position with numpy : 0.0007891654968261719 nb_pixel_total : 26914 time to create 1 rle with old method : 0.031951904296875 length of segment : 211 time for calcul the mask position with numpy : 0.0005364418029785156 nb_pixel_total : 10964 time to create 1 rle with old method : 0.013460159301757812 length of segment : 162 time for calcul the mask position with numpy : 0.0013766288757324219 nb_pixel_total : 36043 time to create 1 rle with old method : 0.0434575080871582 length of segment : 260 time for calcul the mask position with numpy : 0.0013523101806640625 nb_pixel_total : 45177 time to create 1 rle with old method : 0.052808284759521484 length of segment : 246 time for calcul the mask position with numpy : 0.0014216899871826172 nb_pixel_total : 43618 time to create 1 rle with old method : 0.05042243003845215 length of segment : 248 time for calcul the mask position with numpy : 0.0020165443420410156 nb_pixel_total : 77923 time to create 1 rle with old method : 0.09436511993408203 length of segment : 374 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 14342 time to create 1 rle with old method : 0.01633143424987793 length of segment : 167 time for calcul the mask position with numpy : 0.0009424686431884766 nb_pixel_total : 26861 time to create 1 rle with old method : 0.031189441680908203 length of segment : 204 time for calcul the mask position with numpy : 0.0008060932159423828 nb_pixel_total : 24542 time to create 1 rle with old method : 0.028495073318481445 length of segment : 147 time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 21912 time to create 1 rle with old method : 0.025498151779174805 length of segment : 211 time for calcul the mask position with numpy : 0.0005831718444824219 nb_pixel_total : 12470 time to create 1 rle with old method : 0.014961481094360352 length of segment : 168 time for calcul the mask position with numpy : 0.0009098052978515625 nb_pixel_total : 28113 time to create 1 rle with old method : 0.03311491012573242 length of segment : 210 time for calcul the mask position with numpy : 0.002398967742919922 nb_pixel_total : 58469 time to create 1 rle with old method : 0.08984112739562988 length of segment : 306 time for calcul the mask position with numpy : 0.0006988048553466797 nb_pixel_total : 15574 time to create 1 rle with old method : 0.01843738555908203 length of segment : 135 time for calcul the mask position with numpy : 0.0013713836669921875 nb_pixel_total : 42978 time to create 1 rle with old method : 0.049944162368774414 length of segment : 400 time for calcul the mask position with numpy : 0.0006511211395263672 nb_pixel_total : 15637 time to create 1 rle with old method : 0.01875019073486328 length of segment : 156 time for calcul the mask position with numpy : 0.0007476806640625 nb_pixel_total : 16900 time to create 1 rle with old method : 0.020674467086791992 length of segment : 122 time for calcul the mask position with numpy : 0.003863811492919922 nb_pixel_total : 106549 time to create 1 rle with old method : 0.12396025657653809 length of segment : 402 time for calcul the mask position with numpy : 0.006054401397705078 nb_pixel_total : 210448 time to create 1 rle with new method : 0.01385354995727539 length of segment : 699 time for calcul the mask position with numpy : 0.007265567779541016 nb_pixel_total : 179657 time to create 1 rle with new method : 0.016900300979614258 length of segment : 699 time for calcul the mask position with numpy : 0.0003914833068847656 nb_pixel_total : 16803 time to create 1 rle with old method : 0.019526004791259766 length of segment : 151 time for calcul the mask position with numpy : 0.0023996829986572266 nb_pixel_total : 49607 time to create 1 rle with old method : 0.057529449462890625 length of segment : 369 time for calcul the mask position with numpy : 0.002933025360107422 nb_pixel_total : 67796 time to create 1 rle with old method : 0.10157489776611328 length of segment : 418 time for calcul the mask position with numpy : 0.001009225845336914 nb_pixel_total : 29635 time to create 1 rle with old method : 0.033576011657714844 length of segment : 196 time for calcul the mask position with numpy : 0.0008540153503417969 nb_pixel_total : 32173 time to create 1 rle with old method : 0.03927040100097656 length of segment : 288 time for calcul the mask position with numpy : 0.0008258819580078125 nb_pixel_total : 21432 time to create 1 rle with old method : 0.025060653686523438 length of segment : 184 time for calcul the mask position with numpy : 0.0021898746490478516 nb_pixel_total : 44411 time to create 1 rle with old method : 0.062007904052734375 length of segment : 263 time for calcul the mask position with numpy : 0.0020046234130859375 nb_pixel_total : 52212 time to create 1 rle with old method : 0.06016898155212402 length of segment : 388 time for calcul the mask position with numpy : 0.0011410713195800781 nb_pixel_total : 24851 time to create 1 rle with old method : 0.0292205810546875 length of segment : 339 time for calcul the mask position with numpy : 0.0004978179931640625 nb_pixel_total : 15993 time to create 1 rle with old method : 0.018087387084960938 length of segment : 219 time for calcul the mask position with numpy : 0.0031714439392089844 nb_pixel_total : 62985 time to create 1 rle with old method : 0.07238984107971191 length of segment : 354 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 12229 time to create 1 rle with old method : 0.014432907104492188 length of segment : 159 time for calcul the mask position with numpy : 0.0006816387176513672 nb_pixel_total : 7401 time to create 1 rle with old method : 0.008851289749145508 length of segment : 230 time for calcul the mask position with numpy : 0.002134561538696289 nb_pixel_total : 64968 time to create 1 rle with old method : 0.07397603988647461 length of segment : 482 time for calcul the mask position with numpy : 0.0010495185852050781 nb_pixel_total : 29949 time to create 1 rle with old method : 0.034244537353515625 length of segment : 287 time for calcul the mask position with numpy : 0.0006382465362548828 nb_pixel_total : 23539 time to create 1 rle with old method : 0.0274658203125 length of segment : 236 time for calcul the mask position with numpy : 0.0008115768432617188 nb_pixel_total : 18737 time to create 1 rle with old method : 0.02158975601196289 length of segment : 184 time for calcul the mask position with numpy : 0.000766754150390625 nb_pixel_total : 19562 time to create 1 rle with old method : 0.023350238800048828 length of segment : 195 time for calcul the mask position with numpy : 0.0011208057403564453 nb_pixel_total : 48454 time to create 1 rle with old method : 0.05712127685546875 length of segment : 279 time for calcul the mask position with numpy : 0.0009510517120361328 nb_pixel_total : 32123 time to create 1 rle with old method : 0.03793931007385254 length of segment : 274 time for calcul the mask position with numpy : 0.00092315673828125 nb_pixel_total : 27035 time to create 1 rle with old method : 0.033468008041381836 length of segment : 176 time for calcul the mask position with numpy : 0.0010628700256347656 nb_pixel_total : 36795 time to create 1 rle with old method : 0.04101276397705078 length of segment : 292 time for calcul the mask position with numpy : 0.0012543201446533203 nb_pixel_total : 39497 time to create 1 rle with old method : 0.04546380043029785 length of segment : 320 time for calcul the mask position with numpy : 0.002534151077270508 nb_pixel_total : 67336 time to create 1 rle with old method : 0.07872509956359863 length of segment : 340 time for calcul the mask position with numpy : 0.0008361339569091797 nb_pixel_total : 34687 time to create 1 rle with old method : 0.04149818420410156 length of segment : 197 time for calcul the mask position with numpy : 0.0005533695220947266 nb_pixel_total : 31201 time to create 1 rle with old method : 0.039534807205200195 length of segment : 153 time for calcul the mask position with numpy : 0.0009644031524658203 nb_pixel_total : 52119 time to create 1 rle with old method : 0.06018328666687012 length of segment : 237 time for calcul the mask position with numpy : 0.001992940902709961 nb_pixel_total : 67536 time to create 1 rle with old method : 0.07749724388122559 length of segment : 378 time for calcul the mask position with numpy : 0.00038433074951171875 nb_pixel_total : 9283 time to create 1 rle with old method : 0.010961532592773438 length of segment : 146 time for calcul the mask position with numpy : 0.00035262107849121094 nb_pixel_total : 8303 time to create 1 rle with old method : 0.010051727294921875 length of segment : 70 time for calcul the mask position with numpy : 0.0037364959716796875 nb_pixel_total : 171403 time to create 1 rle with new method : 0.007884740829467773 length of segment : 523 time for calcul the mask position with numpy : 0.00025463104248046875 nb_pixel_total : 9687 time to create 1 rle with old method : 0.010864019393920898 length of segment : 113 time spent for convertir_results : 7.726740598678589 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 89 chid ids of type : 3594 Number RLEs to save : 24380 save missing photos in datou_result : time spend for datou_step_exec : 78.34378290176392 time spend to save output : 1.4702415466308594 total time spend for step 1 : 79.81402444839478 step2:crop_condition Tue May 27 12:51:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 89 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 3736932 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748343120_242465 we have uploaded 56 photos in the portfolio 3736932 time of upload the photos Elapsed time : 22.111727237701416 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748343146_242465 we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2272727489471436 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748343158_242465 we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.450934410095215 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361272570, 1361272568, 1361272566, 1361272558, 1361272518, 1361272502, 1361272476, 1361272474, 1361272275, 1361272274, 1361272272] Looping around the photos to save general results len do output : 89 /1361285589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361285701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272570', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272568', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272566', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272558', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272518', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272502', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272476', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272474', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272275', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272274', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272272', None, None, None, None, None, '2966047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 278 time used for this insertion : 0.028416156768798828 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.336565017700195 time spend to save output : 0.031859397888183594 total time spend for step 2 : 57.36842441558838 step3:rle_unique_nms_with_priority Tue May 27 12:52:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 89 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1361272570 No data in photo_id : 1361272568 No data in photo_id : 1361272566 No data in photo_id : 1361272558 No data in photo_id : 1361272518 No data in photo_id : 1361272502 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 19.853189945220947 time for calcul the mask position with numpy : 0.7886848449707031 nb_pixel_total : 5469512 time to create 1 rle with new method : 0.9196748733520508 time for calcul the mask position with numpy : 0.02190113067626953 nb_pixel_total : 83652 time to create 1 rle with old method : 0.09650087356567383 time for calcul the mask position with numpy : 0.021930217742919922 nb_pixel_total : 128590 time to create 1 rle with old method : 0.14216375350952148 time for calcul the mask position with numpy : 0.01966071128845215 nb_pixel_total : 10549 time to create 1 rle with old method : 0.011811256408691406 time for calcul the mask position with numpy : 0.0219573974609375 nb_pixel_total : 26060 time to create 1 rle with old method : 0.02922201156616211 time for calcul the mask position with numpy : 0.020804405212402344 nb_pixel_total : 31669 time to create 1 rle with old method : 0.03563117980957031 time for calcul the mask position with numpy : 0.0204160213470459 nb_pixel_total : 11027 time to create 1 rle with old method : 0.01237630844116211 time for calcul the mask position with numpy : 0.0209810733795166 nb_pixel_total : 130602 time to create 1 rle with old method : 0.16471314430236816 time for calcul the mask position with numpy : 0.023530244827270508 nb_pixel_total : 24494 time to create 1 rle with old method : 0.02805495262145996 time for calcul the mask position with numpy : 0.020648956298828125 nb_pixel_total : 75578 time to create 1 rle with old method : 0.08292102813720703 time for calcul the mask position with numpy : 0.020218610763549805 nb_pixel_total : 33635 time to create 1 rle with old method : 0.03742408752441406 time for calcul the mask position with numpy : 0.020917892456054688 nb_pixel_total : 136224 time to create 1 rle with old method : 0.1501481533050537 time for calcul the mask position with numpy : 0.023092985153198242 nb_pixel_total : 208367 time to create 1 rle with new method : 0.7947947978973389 time for calcul the mask position with numpy : 0.023877620697021484 nb_pixel_total : 9890 time to create 1 rle with old method : 0.011193990707397461 time for calcul the mask position with numpy : 0.020308256149291992 nb_pixel_total : 38535 time to create 1 rle with old method : 0.042452096939086914 time for calcul the mask position with numpy : 0.02184319496154785 nb_pixel_total : 51828 time to create 1 rle with old method : 0.0574796199798584 time for calcul the mask position with numpy : 0.020056486129760742 nb_pixel_total : 10917 time to create 1 rle with old method : 0.011849403381347656 time for calcul the mask position with numpy : 0.020325899124145508 nb_pixel_total : 154565 time to create 1 rle with new method : 0.812366247177124 time for calcul the mask position with numpy : 0.022170543670654297 nb_pixel_total : 150093 time to create 1 rle with new method : 0.9590413570404053 time for calcul the mask position with numpy : 0.020821332931518555 nb_pixel_total : 93948 time to create 1 rle with old method : 0.10837650299072266 time for calcul the mask position with numpy : 0.023556232452392578 nb_pixel_total : 80859 time to create 1 rle with old method : 0.09346771240234375 time for calcul the mask position with numpy : 0.023348569869995117 nb_pixel_total : 89646 time to create 1 rle with old method : 0.12337493896484375 create new chi : 6.063077688217163 time to delete rle : 0.03156733512878418 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 15255 TO DO : save crop sub photo not yet done ! save time : 0.9831020832061768 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 10.254340887069702 time for calcul the mask position with numpy : 0.883375883102417 nb_pixel_total : 6484859 time to create 1 rle with new method : 0.7731819152832031 time for calcul the mask position with numpy : 0.022127866744995117 nb_pixel_total : 8830 time to create 1 rle with old method : 0.010549783706665039 time for calcul the mask position with numpy : 0.02139735221862793 nb_pixel_total : 17292 time to create 1 rle with old method : 0.020169734954833984 time for calcul the mask position with numpy : 0.021189451217651367 nb_pixel_total : 20445 time to create 1 rle with old method : 0.02604079246520996 time for calcul the mask position with numpy : 0.021618366241455078 nb_pixel_total : 7446 time to create 1 rle with old method : 0.009077787399291992 time for calcul the mask position with numpy : 0.022407054901123047 nb_pixel_total : 14491 time to create 1 rle with old method : 0.016974449157714844 time for calcul the mask position with numpy : 0.022924423217773438 nb_pixel_total : 56530 time to create 1 rle with old method : 0.08959507942199707 time for calcul the mask position with numpy : 0.02482891082763672 nb_pixel_total : 36722 time to create 1 rle with old method : 0.04277515411376953 time for calcul the mask position with numpy : 0.021741867065429688 nb_pixel_total : 76222 time to create 1 rle with old method : 0.08817672729492188 time for calcul the mask position with numpy : 0.022121667861938477 nb_pixel_total : 77181 time to create 1 rle with old method : 0.0905153751373291 time for calcul the mask position with numpy : 0.023926734924316406 nb_pixel_total : 24835 time to create 1 rle with old method : 0.03118586540222168 time for calcul the mask position with numpy : 0.020659446716308594 nb_pixel_total : 22409 time to create 1 rle with old method : 0.02597784996032715 time for calcul the mask position with numpy : 0.021388530731201172 nb_pixel_total : 66723 time to create 1 rle with old method : 0.07636165618896484 time for calcul the mask position with numpy : 0.02223825454711914 nb_pixel_total : 90327 time to create 1 rle with old method : 0.10361790657043457 time for calcul the mask position with numpy : 0.022107839584350586 nb_pixel_total : 45928 time to create 1 rle with old method : 0.05347728729248047 create new chi : 2.6923880577087402 time to delete rle : 0.0013890266418457031 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9028 TO DO : save crop sub photo not yet done ! save time : 0.634732723236084 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 15.261826276779175 time for calcul the mask position with numpy : 2.033390998840332 nb_pixel_total : 6641969 time to create 1 rle with new method : 0.8768110275268555 time for calcul the mask position with numpy : 0.02039337158203125 nb_pixel_total : 28113 time to create 1 rle with old method : 0.03184151649475098 time for calcul the mask position with numpy : 0.019910097122192383 nb_pixel_total : 12470 time to create 1 rle with old method : 0.013894081115722656 time for calcul the mask position with numpy : 0.02124190330505371 nb_pixel_total : 21912 time to create 1 rle with old method : 0.025272130966186523 time for calcul the mask position with numpy : 0.021631240844726562 nb_pixel_total : 24542 time to create 1 rle with old method : 0.027784109115600586 time for calcul the mask position with numpy : 0.020410776138305664 nb_pixel_total : 26861 time to create 1 rle with old method : 0.029487133026123047 time for calcul the mask position with numpy : 0.019878864288330078 nb_pixel_total : 14342 time to create 1 rle with old method : 0.01603412628173828 time for calcul the mask position with numpy : 0.0225527286529541 nb_pixel_total : 77923 time to create 1 rle with old method : 0.1089944839477539 time for calcul the mask position with numpy : 0.02142500877380371 nb_pixel_total : 43618 time to create 1 rle with old method : 0.04966139793395996 time for calcul the mask position with numpy : 0.020554065704345703 nb_pixel_total : 45177 time to create 1 rle with old method : 0.05061483383178711 time for calcul the mask position with numpy : 0.021305322647094727 nb_pixel_total : 36043 time to create 1 rle with old method : 0.04113435745239258 time for calcul the mask position with numpy : 0.024251461029052734 nb_pixel_total : 10964 time to create 1 rle with old method : 0.012841463088989258 time for calcul the mask position with numpy : 0.02222895622253418 nb_pixel_total : 26914 time to create 1 rle with old method : 0.03070974349975586 time for calcul the mask position with numpy : 0.02240920066833496 nb_pixel_total : 10459 time to create 1 rle with old method : 0.011842012405395508 time for calcul the mask position with numpy : 0.021065473556518555 nb_pixel_total : 28933 time to create 1 rle with old method : 0.03313422203063965 create new chi : 3.73111629486084 time to delete rle : 0.001035451889038086 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 7796 TO DO : save crop sub photo not yet done ! save time : 0.5199620723724365 nb_obj : 26 nb_hashtags : 3 time to prepare the origin masks : 3.8705570697784424 time for calcul the mask position with numpy : 0.7077562808990479 nb_pixel_total : 5867857 time to create 1 rle with new method : 1.3005993366241455 time for calcul the mask position with numpy : 0.028032779693603516 nb_pixel_total : 64968 time to create 1 rle with old method : 0.07435011863708496 time for calcul the mask position with numpy : 0.028118133544921875 nb_pixel_total : 19562 time to create 1 rle with old method : 0.022131919860839844 time for calcul the mask position with numpy : 0.028162240982055664 nb_pixel_total : 16900 time to create 1 rle with old method : 0.019365787506103516 time for calcul the mask position with numpy : 0.028197288513183594 nb_pixel_total : 15637 time to create 1 rle with old method : 0.018019676208496094 time for calcul the mask position with numpy : 0.027796268463134766 nb_pixel_total : 24851 time to create 1 rle with old method : 0.02795553207397461 time for calcul the mask position with numpy : 0.026771068572998047 nb_pixel_total : 7401 time to create 1 rle with old method : 0.008378744125366211 time for calcul the mask position with numpy : 0.027025938034057617 nb_pixel_total : 29949 time to create 1 rle with old method : 0.03315377235412598 time for calcul the mask position with numpy : 0.026860952377319336 nb_pixel_total : 31622 time to create 1 rle with old method : 0.034485816955566406 time for calcul the mask position with numpy : 0.028272628784179688 nb_pixel_total : 106549 time to create 1 rle with old method : 0.1169583797454834 time for calcul the mask position with numpy : 0.028133153915405273 nb_pixel_total : 67796 time to create 1 rle with old method : 0.07664227485656738 time for calcul the mask position with numpy : 0.02857494354248047 nb_pixel_total : 15073 time to create 1 rle with old method : 0.017631053924560547 time for calcul the mask position with numpy : 0.028713703155517578 nb_pixel_total : 15993 time to create 1 rle with old method : 0.018792390823364258 time for calcul the mask position with numpy : 0.02864360809326172 nb_pixel_total : 131559 time to create 1 rle with old method : 0.14919257164001465 time for calcul the mask position with numpy : 0.028342485427856445 nb_pixel_total : 49607 time to create 1 rle with old method : 0.057219743728637695 time for calcul the mask position with numpy : 0.028386592864990234 nb_pixel_total : 44411 time to create 1 rle with old method : 0.050484418869018555 time for calcul the mask position with numpy : 0.02829122543334961 nb_pixel_total : 21432 time to create 1 rle with old method : 0.024184703826904297 time for calcul the mask position with numpy : 0.02742791175842285 nb_pixel_total : 62985 time to create 1 rle with old method : 0.0714716911315918 time for calcul the mask position with numpy : 0.02830028533935547 nb_pixel_total : 15870 time to create 1 rle with old method : 0.018192052841186523 time for calcul the mask position with numpy : 0.028210163116455078 nb_pixel_total : 58469 time to create 1 rle with old method : 0.06473398208618164 time for calcul the mask position with numpy : 0.028953075408935547 nb_pixel_total : 210384 time to create 1 rle with new method : 0.8079662322998047 time for calcul the mask position with numpy : 0.027706384658813477 nb_pixel_total : 29635 time to create 1 rle with old method : 0.03307056427001953 time for calcul the mask position with numpy : 0.028164386749267578 nb_pixel_total : 42978 time to create 1 rle with old method : 0.04764294624328613 time for calcul the mask position with numpy : 0.0282437801361084 nb_pixel_total : 15574 time to create 1 rle with old method : 0.0181581974029541 time for calcul the mask position with numpy : 0.02805304527282715 nb_pixel_total : 52212 time to create 1 rle with old method : 0.06003856658935547 time for calcul the mask position with numpy : 0.027697086334228516 nb_pixel_total : 18737 time to create 1 rle with old method : 0.02077507972717285 time for calcul the mask position with numpy : 0.027228593826293945 nb_pixel_total : 12229 time to create 1 rle with old method : 0.013597488403320312 create new chi : 4.69784688949585 time to delete rle : 0.001844167709350586 batch 1 Loaded 53 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 17133 TO DO : save crop sub photo not yet done ! save time : 1.0681869983673096 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 8.641713619232178 time for calcul the mask position with numpy : 1.0409443378448486 nb_pixel_total : 6414781 time to create 1 rle with new method : 1.4420058727264404 time for calcul the mask position with numpy : 0.021309852600097656 nb_pixel_total : 9687 time to create 1 rle with old method : 0.011031150817871094 time for calcul the mask position with numpy : 0.031282901763916016 nb_pixel_total : 171403 time to create 1 rle with new method : 1.1389694213867188 time for calcul the mask position with numpy : 0.02126026153564453 nb_pixel_total : 8303 time to create 1 rle with old method : 0.010749101638793945 time for calcul the mask position with numpy : 0.024259328842163086 nb_pixel_total : 9283 time to create 1 rle with old method : 0.015130281448364258 time for calcul the mask position with numpy : 0.025420188903808594 nb_pixel_total : 67536 time to create 1 rle with old method : 0.09469223022460938 time for calcul the mask position with numpy : 0.024456501007080078 nb_pixel_total : 52119 time to create 1 rle with old method : 0.06039619445800781 time for calcul the mask position with numpy : 0.019998550415039062 nb_pixel_total : 31201 time to create 1 rle with old method : 0.034026145935058594 time for calcul the mask position with numpy : 0.01999974250793457 nb_pixel_total : 34687 time to create 1 rle with old method : 0.0380558967590332 time for calcul the mask position with numpy : 0.021240234375 nb_pixel_total : 67336 time to create 1 rle with old method : 0.07406878471374512 time for calcul the mask position with numpy : 0.02068638801574707 nb_pixel_total : 39497 time to create 1 rle with old method : 0.04456067085266113 time for calcul the mask position with numpy : 0.020030736923217773 nb_pixel_total : 36795 time to create 1 rle with old method : 0.04093766212463379 time for calcul the mask position with numpy : 0.02007269859313965 nb_pixel_total : 27035 time to create 1 rle with old method : 0.030582427978515625 time for calcul the mask position with numpy : 0.02081894874572754 nb_pixel_total : 32123 time to create 1 rle with old method : 0.03664112091064453 time for calcul the mask position with numpy : 0.02103877067565918 nb_pixel_total : 48454 time to create 1 rle with old method : 0.054785966873168945 create new chi : 4.535365104675293 time to delete rle : 0.0011816024780273438 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9156 TO DO : save crop sub photo not yet done ! save time : 0.597942590713501 map_output_result : {1361272570: (0.0, 'Should be the crop_list due to order', 0.0), 1361272568: (0.0, 'Should be the crop_list due to order', 0.0), 1361272566: (0.0, 'Should be the crop_list due to order', 0.0), 1361272558: (0.0, 'Should be the crop_list due to order', 0.0), 1361272518: (0.0, 'Should be the crop_list due to order', 0.0), 1361272502: (0.0, 'Should be the crop_list due to order', 0.0), 1361272476: (0.0, 'Should be the crop_list due to order', 0), 1361272474: (0.0, 'Should be the crop_list due to order', 0), 1361272275: (0.0, 'Should be the crop_list due to order', 0), 1361272274: (0.0, 'Should be the crop_list due to order', 0), 1361272272: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361272570, 1361272568, 1361272566, 1361272558, 1361272518, 1361272502, 1361272476, 1361272474, 1361272275, 1361272274, 1361272272] Looping around the photos to save general results len do output : 11 /1361272570.Didn't retrieve data . /1361272568.Didn't retrieve data . /1361272566.Didn't retrieve data . /1361272558.Didn't retrieve data . /1361272518.Didn't retrieve data . /1361272502.Didn't retrieve data . /1361272476.Didn't retrieve data . /1361272474.Didn't retrieve data . /1361272275.Didn't retrieve data . /1361272274.Didn't retrieve data . /1361272272.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272570', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272568', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272566', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272558', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272518', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272502', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272476', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272474', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272275', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272274', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272272', None, None, None, None, None, '2966047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.015552520751953125 save_final save missing photos in datou_result : time spend for datou_step_exec : 84.07947754859924 time spend to save output : 0.016016721725463867 total time spend for step 3 : 84.0954942703247 step4:ventilate_hashtags_in_portfolio Tue May 27 12:54:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23376513 get user id for portfolio 23376513 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23376513 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','mal_croppe','papier','environnement','flou','autre','metal','carton','background','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23376513 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','mal_croppe','papier','environnement','flou','autre','metal','carton','background','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23376513 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','mal_croppe','papier','environnement','flou','autre','metal','carton','background','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23376518,23376519,23376520,23376521,23376522,23376523,23376524,23376525,23376526,23376527,23376528?tags=pet_fonce,mal_croppe,papier,environnement,flou,autre,metal,carton,background,pehd,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361272570, 1361272568, 1361272566, 1361272558, 1361272518, 1361272502, 1361272476, 1361272474, 1361272275, 1361272274, 1361272272] Looping around the photos to save general results len do output : 1 /23376513. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272570', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272568', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272566', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272558', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272518', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272502', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272476', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272474', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272275', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272274', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272272', None, None, None, None, None, '2966047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016373395919799805 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6340208053588867 time spend to save output : 0.01676464080810547 total time spend for step 4 : 1.6507854461669922 step5:final Tue May 27 12:54:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361272570: ('0.05637747470621246',), 1361272568: ('0.05637747470621246',), 1361272566: ('0.05637747470621246',), 1361272558: ('0.05637747470621246',), 1361272518: ('0.05637747470621246',), 1361272502: ('0.05637747470621246',), 1361272476: ('0.05637747470621246',), 1361272474: ('0.05637747470621246',), 1361272275: ('0.05637747470621246',), 1361272274: ('0.05637747470621246',), 1361272272: ('0.05637747470621246',)} new output for save of step final : {1361272570: ('0.05637747470621246',), 1361272568: ('0.05637747470621246',), 1361272566: ('0.05637747470621246',), 1361272558: ('0.05637747470621246',), 1361272518: ('0.05637747470621246',), 1361272502: ('0.05637747470621246',), 1361272476: ('0.05637747470621246',), 1361272474: ('0.05637747470621246',), 1361272275: ('0.05637747470621246',), 1361272274: ('0.05637747470621246',), 1361272272: ('0.05637747470621246',)} [1361272570, 1361272568, 1361272566, 1361272558, 1361272518, 1361272502, 1361272476, 1361272474, 1361272275, 1361272274, 1361272272] Looping around the photos to save general results len do output : 11 /1361272570.Didn't retrieve data . /1361272568.Didn't retrieve data . /1361272566.Didn't retrieve data . /1361272558.Didn't retrieve data . /1361272518.Didn't retrieve data . /1361272502.Didn't retrieve data . /1361272476.Didn't retrieve data . /1361272474.Didn't retrieve data . /1361272275.Didn't retrieve data . /1361272274.Didn't retrieve data . /1361272272.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272570', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272568', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272566', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272558', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272518', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272502', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272476', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272474', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272275', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272274', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272272', None, None, None, None, None, '2966047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.013352632522583008 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11350774765014648 time spend to save output : 0.01388406753540039 total time spend for step 5 : 0.12739181518554688 step6:blur_detection Tue May 27 12:54:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748343026_242465_1361272570_b5f6127c5b07323026003ac404a636fa.jpg resize: (2160, 3264) 1361272570 -3.105176107122928 treat image : temp/1748343026_242465_1361272568_25be7d772eaeb2c111c9d00db2fb3558.jpg resize: (2160, 3264) 1361272568 -0.6139895771228103 treat image : temp/1748343026_242465_1361272566_dcac19ad25775dec2e978cccb6173736.jpg resize: (2160, 3264) 1361272566 -2.594181952083337 treat image : temp/1748343026_242465_1361272558_c310ff78fb4929e71368ac3ad2ad15da.jpg resize: (2160, 3264) 1361272558 -2.3104819091787605 treat image : temp/1748343026_242465_1361272518_9728dbdc80489158e5b02ff82b58b302.jpg resize: (2160, 3264) 1361272518 -0.9062556314256178 treat image : temp/1748343026_242465_1361272502_616335224e859d11a8e9212395fb1ac9.jpg resize: (2160, 3264) 1361272502 -2.7144921376700673 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af.jpg resize: (2160, 3264) 1361272476 -3.0592906061427843 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa.jpg resize: (2160, 3264) 1361272474 -1.8877904382180486 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb.jpg resize: (2160, 3264) 1361272275 0.1969855401747653 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449.jpg resize: (2160, 3264) 1361272274 -1.3835146991675364 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711.jpg resize: (2160, 3264) 1361272272 -2.537421490070184 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044980_0.png resize: (292, 441) 1361285589 -3.0810538826568825 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044984_0.png resize: (140, 117) 1361285590 -1.9560829633950754 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044987_0.png resize: (218, 199) 1361285591 -2.778745301467666 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044990_0.png resize: (255, 354) 1361285592 -2.573108853666234 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044992_0.png resize: (153, 225) 1361285593 -1.9792844661062943 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044994_0.png resize: (135, 132) 1361285594 -0.9848062191749712 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044995_0.png resize: (267, 328) 1361285595 -2.2812451139161287 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044996_0.png resize: (151, 245) 1361285596 -1.2996392752586947 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044997_0.png resize: (180, 82) 1361285597 -2.029348465645483 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045000_0.png resize: (190, 313) 1361285598 -0.8872821531564786 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045001_0.png resize: (309, 507) 1361285599 -0.9813976965697787 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045002_0.png resize: (296, 448) 1361285600 -0.1330136528701532 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045003_0.png resize: (157, 231) 1361285601 1.1137484087978526 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045006_0.png resize: (380, 330) 1361285602 -0.3246459249297537 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045007_0.png resize: (249, 250) 1361285603 -0.8950644186806734 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045008_0.png resize: (280, 341) 1361285604 -1.794318575175727 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045009_0.png resize: (114, 150) 1361285605 1.19044840675541 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045010_0.png resize: (332, 163) 1361285606 -0.8388722590818889 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045011_0.png resize: (154, 200) 1361285607 -0.12231105367831872 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045012_0.png resize: (158, 149) 1361285608 0.044639344843689824 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045013_0.png resize: (94, 122) 1361285609 0.4569551624237769 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045016_0.png resize: (211, 208) 1361285610 -0.5201697191922099 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045017_0.png resize: (146, 137) 1361285611 -1.4728891137667095 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045018_0.png resize: (182, 325) 1361285613 -0.18129917096954845 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045019_0.png resize: (243, 277) 1361285614 -1.8374532623363744 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045022_0.png resize: (167, 108) 1361285615 0.2108281155814136 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045025_0.png resize: (209, 144) 1361285616 0.3625416962439462 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045026_0.png resize: (168, 197) 1361285617 -0.9209151836108725 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045028_0.png resize: (280, 339) 1361285618 -1.0958944911515187 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045029_0.png resize: (133, 179) 1361285619 -1.267532715547118 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045030_0.png resize: (396, 128) 1361285620 0.531892484552334 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045032_0.png resize: (118, 230) 1361285621 -0.1320105761932491 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045033_0.png resize: (365, 469) 1361285622 0.08296651494587648 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045034_0.png resize: (692, 402) 1361285623 -0.6675779246452664 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045035_0.png resize: (688, 480) 1361285624 -1.2648173272242667 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045036_0.png resize: (151, 156) 1361285625 -0.8785339275207682 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045037_0.png resize: (311, 332) 1361285626 -1.298720549003745 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045039_0.png resize: (167, 252) 1361285627 -1.4083855671210241 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045040_0.png resize: (218, 268) 1361285628 -1.6405145181425607 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045043_0.png resize: (238, 341) 1361285629 -1.6751779257645478 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045044_0.png resize: (224, 181) 1361285630 -2.1771703176286237 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045045_0.png resize: (214, 113) 1361285631 -1.0226512064214144 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045047_0.png resize: (159, 163) 1361285632 -2.0442245904607135 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045048_0.png resize: (154, 96) 1361285633 -2.916727644891957 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045050_0.png resize: (282, 147) 1361285634 -0.037821632961527275 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045051_0.png resize: (236, 145) 1361285635 2.9631736534066553 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045052_0.png resize: (180, 134) 1361285636 -0.06302427700936292 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045053_0.png resize: (186, 162) 1361285637 -0.9058113264816636 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045055_0.png resize: (273, 150) 1361285638 -0.6562137806577503 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045057_0.png resize: (292, 193) 1361285639 -0.20756771590391287 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045058_0.png resize: (319, 231) 1361285640 -2.3608767943270124 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045060_0.png resize: (193, 236) 1361285641 -0.5322626226940901 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045062_0.png resize: (236, 317) 1361285642 -1.2512494879030156 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045063_0.png resize: (352, 401) 1361285643 -1.7643332575583515 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045064_0.png resize: (146, 110) 1361285644 -1.4687068944257164 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045067_0.png resize: (112, 127) 1361285645 -1.80948981183013 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045004_0.png resize: (239, 202) 1361285651 -1.8678434485310202 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045015_0.png resize: (79, 157) 1361285652 1.088558759337862 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045020_0.png resize: (238, 266) 1361285653 -0.6164067218804108 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045027_0.png resize: (186, 227) 1361285654 -0.9510394121007378 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045031_0.png resize: (155, 145) 1361285655 -1.3770838230400366 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045041_0.png resize: (184, 180) 1361285656 -0.6568594727800321 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045042_0.png resize: (263, 253) 1361285658 -0.7106944087187448 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045054_0.png resize: (207, 319) 1361285659 -1.6722722544053297 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045056_0.png resize: (165, 256) 1361285660 -0.5093329511933714 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044979_0.png resize: (212, 588) 1361285678 -1.1955649457512298 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044981_0.png resize: (232, 485) 1361285679 -0.9713580296583528 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044982_0.png resize: (447, 615) 1361285680 -1.0411293137078141 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044983_0.png resize: (417, 510) 1361285681 -2.2966537028246297 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044985_0.png resize: (219, 282) 1361285682 -0.8549209987415801 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044986_0.png resize: (223, 249) 1361285683 -2.1985286219092215 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044988_0.png resize: (491, 608) 1361285684 -3.1951823164805275 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044989_0.png resize: (348, 641) 1361285685 -2.913096003166522 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044991_0.png resize: (294, 370) 1361285686 -2.914040845128856 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044993_0.png resize: (366, 519) 1361285687 -3.2356700259393154 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044998_0.png resize: (455, 516) 1361285688 -2.617886021154007 treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044999_0.png resize: (351, 393) 1361285689 -1.181625816016073 treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045005_0.png resize: (237, 458) 1361285690 -1.5638776878817682 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045014_0.png resize: (130, 267) 1361285691 -1.0716424604628152 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045021_0.png resize: (367, 262) 1361285692 -1.06132486203694 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045023_0.png resize: (204, 191) 1361285693 -1.0455099449676222 treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045024_0.png resize: (147, 214) 1361285694 -0.2208404867146148 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045038_0.png resize: (418, 265) 1361285695 -2.3085549592186383 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045046_0.png resize: (354, 296) 1361285696 -0.7613951082066351 treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045049_0.png resize: (349, 278) 1361285697 -2.284651775192839 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045059_0.png resize: (327, 525) 1361285698 -1.0362809988262724 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045061_0.png resize: (151, 242) 1361285699 -2.512494498566189 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045065_0.png resize: (70, 150) 1361285700 0.46938287435958315 treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045066_0.png resize: (523, 447) 1361285701 -0.28455826311233245 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 100 time used for this insertion : 0.0213775634765625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 100 time used for this insertion : 0.018577098846435547 save missing photos in datou_result : time spend for datou_step_exec : 39.54549431800842 time spend to save output : 0.044794321060180664 total time spend for step 6 : 39.5902886390686 step7:brightness Tue May 27 12:54:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748343026_242465_1361272570_b5f6127c5b07323026003ac404a636fa.jpg treat image : temp/1748343026_242465_1361272568_25be7d772eaeb2c111c9d00db2fb3558.jpg treat image : temp/1748343026_242465_1361272566_dcac19ad25775dec2e978cccb6173736.jpg treat image : temp/1748343026_242465_1361272558_c310ff78fb4929e71368ac3ad2ad15da.jpg treat image : temp/1748343026_242465_1361272518_9728dbdc80489158e5b02ff82b58b302.jpg treat image : temp/1748343026_242465_1361272502_616335224e859d11a8e9212395fb1ac9.jpg treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af.jpg treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa.jpg treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb.jpg treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449.jpg treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711.jpg treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044980_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044984_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044987_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044990_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044992_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044994_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044995_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044996_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044997_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045000_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045001_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045002_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045003_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045006_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045007_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045008_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045009_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045010_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045011_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045012_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045013_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045016_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045017_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045018_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045019_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045022_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045025_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045026_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045028_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045029_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045030_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045032_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045033_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045034_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045035_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045036_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045037_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045039_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045040_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045043_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045044_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045045_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045047_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045048_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045050_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045051_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045052_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045053_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045055_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045057_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045058_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045060_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045062_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045063_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045064_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045067_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045004_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045015_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045020_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045027_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045031_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045041_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045042_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045054_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045056_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044979_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044981_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044982_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044983_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044985_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044986_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044988_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044989_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044991_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044993_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044998_0.png treat image : temp/1748343026_242465_1361272476_245cd21aa20cd532e966ca336256e4af_rle_crop_3814044999_0.png treat image : temp/1748343026_242465_1361272474_e56da8a14788077a2d98f7e9daa135aa_rle_crop_3814045005_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045014_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045021_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045023_0.png treat image : temp/1748343026_242465_1361272275_372c8d2d15ac92ce91f9355ad105f5cb_rle_crop_3814045024_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045038_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045046_0.png treat image : temp/1748343026_242465_1361272274_34ea5437f6569fd0456d33fc118f2449_rle_crop_3814045049_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045059_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045061_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045065_0.png treat image : temp/1748343026_242465_1361272272_f87d75e6e6ebcbf15de60e05cd916711_rle_crop_3814045066_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 100 time used for this insertion : 0.019162416458129883 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 100 time used for this insertion : 0.01923823356628418 save missing photos in datou_result : time spend for datou_step_exec : 8.725150346755981 time spend to save output : 0.04380655288696289 total time spend for step 7 : 8.768956899642944 step8:velours_tree Tue May 27 12:54:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.11370658874511719 time spend to save output : 4.100799560546875e-05 total time spend for step 8 : 0.11374759674072266 step9:send_mail_cod Tue May 27 12:54:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23376513_27-05-2025_12_54_59.pdf 23376518 imagette233765181748343299 23376519 imagette233765191748343299 23376520 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233765201748343299 23376522 imagette233765221748343301 23376523 imagette233765231748343301 23376524 imagette233765241748343301 23376525 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233765251748343301 23376526 imagette233765261748343301 23376527 imagette233765271748343301 23376528 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233765281748343301 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23376513 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23376518,23376519,23376520,23376521,23376522,23376523,23376524,23376525,23376526,23376527,23376528?tags=pet_fonce,mal_croppe,papier,environnement,flou,autre,metal,carton,background,pehd,pet_clair args[1361272570] : ((1361272570, -3.105176107122928, 492609224), (1361272570, 0.15328569925080868, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272568] : ((1361272568, -0.6139895771228103, 492688767), (1361272568, 0.04666225413905596, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272566] : ((1361272566, -2.594181952083337, 492609224), (1361272566, 0.30103953274351397, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272558] : ((1361272558, -2.3104819091787605, 492609224), (1361272558, 0.14881596712953085, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272518] : ((1361272518, -0.9062556314256178, 492688767), (1361272518, 0.2717934020987008, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272502] : ((1361272502, -2.7144921376700673, 492609224), (1361272502, -0.015526894166402162, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272476] : ((1361272476, -3.0592906061427843, 492609224), (1361272476, -0.21513805647334158, 496442774), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272474] : ((1361272474, -1.8877904382180486, 492688767), (1361272474, 0.3070945125759642, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272275] : ((1361272275, 0.1969855401747653, 492688767), (1361272275, 0.45063682314272674, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272274] : ((1361272274, -1.3835146991675364, 492688767), (1361272274, 0.26505617528830394, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com args[1361272272] : ((1361272272, -2.537421490070184, 492609224), (1361272272, 0.0669038593314724, 2107752395), '0.05637747470621246') We are sending mail with results at report@fotonower.com refus_total : 0.05637747470621246 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23376513 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23376513_27-05-2025_12_54_59.pdf results_Auto_P23376513_27-05-2025_12_54_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23376513_27-05-2025_12_54_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23376513','results_Auto_P23376513_27-05-2025_12_54_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23376513_27-05-2025_12_54_59.pdf','pdf','','0.61','0.05637747470621246') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23376513

https://www.fotonower.com/image?json=false&list_photos_id=1361272570
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272568
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272566
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272558
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272518
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272502
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272476
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272474
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272275
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272274
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361272272
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.64%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23376520?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23376525?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23376528?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23376513_27-05-2025_12_54_59.pdf.

Lien vers velours :https://www.fotonower.com/velours/23376518,23376519,23376520,23376521,23376522,23376523,23376524,23376525,23376526,23376527,23376528?tags=pet_fonce,mal_croppe,papier,environnement,flou,autre,metal,carton,background,pehd,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 27 May 2025 10:55:05 GMT Content-Length: 0 Connection: close X-Message-Id: NNSomsfWTtusyMGWCOvypw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361272570, 1361272568, 1361272566, 1361272558, 1361272518, 1361272502, 1361272476, 1361272474, 1361272275, 1361272274, 1361272272] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272570', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272568', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272566', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272558', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272518', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272502', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272476', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272474', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272275', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272274', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272272', None, None, None, None, None, '2966047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015633583068847656 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.0938880443573 time spend to save output : 0.01587510108947754 total time spend for step 9 : 6.109763145446777 step10:split_time_score Tue May 27 12:55:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27052025 23376513 Nombre de photos uploadées : 11 / 23040 (0%) 27052025 23376513 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 27052025 23376513 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 3.5762786865234375e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.00034165382385253906 elapsed_time : insert_dashboard_record_day_entry 0.029084444046020508 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07886007284858386 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375190_27-05-2025_12_07_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375190 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375190 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23376491 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23376512 order by id desc limit 1 Qualite : 0.05637747470621246 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23376513_27-05-2025_12_54_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23376513 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23376513 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361272570, 1361272568, 1361272566, 1361272558, 1361272518, 1361272502, 1361272476, 1361272474, 1361272275, 1361272274, 1361272272] Looping around the photos to save general results len do output : 1 /23376513Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272570', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272568', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272566', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272558', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272518', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272502', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272476', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272474', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272275', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272274', None, None, None, None, None, '2966047') ('3318', None, None, None, None, None, None, None, '2966047') ('3318', '23376513', '1361272272', None, None, None, None, None, '2966047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.013637542724609375 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.053542137145996 time spend to save output : 0.01385045051574707 total time spend for step 10 : 2.067392587661743 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 106.02user 117.21system 4:43.27elapsed 78%CPU (0avgtext+0avgdata 4533068maxresident)k 116904inputs+61520outputs (101major+8127335minor)pagefaults 0swaps