python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/prod/datou.py -j batch_current -a 4433' -s traitement_sts -M 0 -S 0 -U 100,80,95 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/home/admin/workarea/git/apy', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 72039 load datou : 4433 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5309, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 16384, 25088, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 5, 10, 19, 20, 46), datetime.datetime(2021, 5, 10, 19, 20, 46)) load thcls load THCL from format json or kwargs add thcl : 2456 in CacheModelConfig load THCL from format json or kwargs add thcl : 2896 in CacheModelConfig load pdts add pdt : 4999 in CacheModelConfig add pdt : 5309 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4433, datou_cur_ids : ['3776893'] with mtr_portfolio_ids : ['27219530'] and first list_photo_ids : [] new path : /proc/72039/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, crop_condition, thcl, tfhub_classification2, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 15 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 15 ; length of list_pids : 15 ; length of list_args : 15 time to download the photos : 5.384649991989136 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 14 step1:mask_detect Fri Sep 26 11:32:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10582 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-26 11:32:19.578159: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-26 11:32:19.612864: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-26 11:32:19.616847: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc20c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-26 11:32:19.616942: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-26 11:32:19.625306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-26 11:32:19.824884: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x36d76fc0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-26 11:32:19.824941: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-26 11:32:19.825947: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-26 11:32:19.827111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-26 11:32:19.832210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-26 11:32:19.847771: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-26 11:32:19.849005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-26 11:32:19.854230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-26 11:32:19.856493: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-26 11:32:19.871296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-26 11:32:19.872792: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-26 11:32:19.873605: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-26 11:32:19.874640: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-26 11:32:19.874657: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-26 11:32:19.874666: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-26 11:32:19.876346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9801 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-26 11:32:20.211748: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-26 11:32:20.211846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-26 11:32:20.211864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-26 11:32:20.211880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-26 11:32:20.211895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-26 11:32:20.211909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-26 11:32:20.211923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-26 11:32:20.211937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-26 11:32:20.213254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-26 11:32:20.214432: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-26 11:32:20.214465: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-26 11:32:20.214481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-26 11:32:20.214495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-26 11:32:20.214508: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-26 11:32:20.214522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-26 11:32:20.214535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-26 11:32:20.214549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-26 11:32:20.215829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-26 11:32:20.215870: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-26 11:32:20.215880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-26 11:32:20.215888: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-26 11:32:20.217257: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9801 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2896 thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5309, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 16384, 25088, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 5, 10, 19, 20, 46), datetime.datetime(2021, 5, 10, 19, 20, 46)) {'thcl': {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'], 'list_hashtags_csv': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'svm_hashtag_type_desc': 5309, 'photo_desc_type': 5309, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_convoyeur_qualipapia_nantes_poly_100521_1 NUM_CLASSES 10 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_convoyeur_qualipapia_nantes_poly_100521_1 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-26 11:32:36.430559: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-26 11:32:36.780616: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_convoyeur_qualipapia_nantes_poly_100521_1 /data/models_weight/learn_convoyeur_qualipapia_nantes_poly_100521_1/mask_model.h5 size_local : 256031040 size in s3 : 256031040 create time local : 2021-08-09 05:45:48 create time in s3 : 2021-08-06 18:59:51 mask_model.h5 already exist and didn't need to update list_images length : 15 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (3040, 4056, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 4056.00000 nb d'objets trouves : 8 Detection mask done ! Trying to reset tf kernel 72138 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5290 tf kernel not reseted sub process len(results) : 15 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 15 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10356 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2896 Catched exception ! Connect or reconnect ! thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] time for calcul the mask position with numpy : 0.519057035446167 nb_pixel_total : 2318145 time to create 1 rle with new method : 0.5126707553863525 length of segment : 3227 time for calcul the mask position with numpy : 0.0021097660064697266 nb_pixel_total : 112530 time to create 1 rle with old method : 0.12002205848693848 length of segment : 443 time for calcul the mask position with numpy : 0.0011096000671386719 nb_pixel_total : 59246 time to create 1 rle with old method : 0.06312918663024902 length of segment : 400 time for calcul the mask position with numpy : 0.00013756752014160156 nb_pixel_total : 4938 time to create 1 rle with old method : 0.0054645538330078125 length of segment : 125 time for calcul the mask position with numpy : 0.0019202232360839844 nb_pixel_total : 128680 time to create 1 rle with old method : 0.14180922508239746 length of segment : 397 time for calcul the mask position with numpy : 0.008136987686157227 nb_pixel_total : 369126 time to create 1 rle with new method : 0.043636322021484375 length of segment : 801 time for calcul the mask position with numpy : 0.0015156269073486328 nb_pixel_total : 99930 time to create 1 rle with old method : 0.10867738723754883 length of segment : 430 time for calcul the mask position with numpy : 0.025203704833984375 nb_pixel_total : 1243869 time to create 1 rle with new method : 0.3944416046142578 length of segment : 2888 time for calcul the mask position with numpy : 0.0004277229309082031 nb_pixel_total : 10995 time to create 1 rle with old method : 0.012523651123046875 length of segment : 198 time for calcul the mask position with numpy : 0.006346464157104492 nb_pixel_total : 353531 time to create 1 rle with new method : 0.02587103843688965 length of segment : 817 time for calcul the mask position with numpy : 0.0008800029754638672 nb_pixel_total : 29923 time to create 1 rle with old method : 0.037986040115356445 length of segment : 180 time for calcul the mask position with numpy : 0.0008933544158935547 nb_pixel_total : 39038 time to create 1 rle with old method : 0.042585134506225586 length of segment : 225 time for calcul the mask position with numpy : 0.0005238056182861328 nb_pixel_total : 29978 time to create 1 rle with old method : 0.03211522102355957 length of segment : 216 time for calcul the mask position with numpy : 0.0027883052825927734 nb_pixel_total : 168025 time to create 1 rle with new method : 0.007306814193725586 length of segment : 619 time for calcul the mask position with numpy : 0.0005939006805419922 nb_pixel_total : 25403 time to create 1 rle with old method : 0.027261018753051758 length of segment : 228 time for calcul the mask position with numpy : 0.0009512901306152344 nb_pixel_total : 51001 time to create 1 rle with old method : 0.06018567085266113 length of segment : 253 time for calcul the mask position with numpy : 0.002509593963623047 nb_pixel_total : 128503 time to create 1 rle with old method : 0.1352400779724121 length of segment : 496 time for calcul the mask position with numpy : 0.0033614635467529297 nb_pixel_total : 174301 time to create 1 rle with new method : 0.00898885726928711 length of segment : 692 time for calcul the mask position with numpy : 0.0032393932342529297 nb_pixel_total : 163723 time to create 1 rle with new method : 0.00780487060546875 length of segment : 497 time for calcul the mask position with numpy : 0.00036525726318359375 nb_pixel_total : 15920 time to create 1 rle with old method : 0.01752328872680664 length of segment : 143 time for calcul the mask position with numpy : 0.004499197006225586 nb_pixel_total : 193850 time to create 1 rle with new method : 0.013834714889526367 length of segment : 761 time for calcul the mask position with numpy : 0.004361391067504883 nb_pixel_total : 195303 time to create 1 rle with new method : 0.013041496276855469 length of segment : 601 time for calcul the mask position with numpy : 0.0004439353942871094 nb_pixel_total : 16593 time to create 1 rle with old method : 0.01768183708190918 length of segment : 138 time for calcul the mask position with numpy : 0.002545595169067383 nb_pixel_total : 168618 time to create 1 rle with new method : 0.007586479187011719 length of segment : 680 time for calcul the mask position with numpy : 0.0022628307342529297 nb_pixel_total : 152245 time to create 1 rle with new method : 0.0063588619232177734 length of segment : 545 time for calcul the mask position with numpy : 0.00037407875061035156 nb_pixel_total : 7502 time to create 1 rle with old method : 0.008284807205200195 length of segment : 119 time for calcul the mask position with numpy : 0.0008165836334228516 nb_pixel_total : 17790 time to create 1 rle with old method : 0.019105911254882812 length of segment : 216 time for calcul the mask position with numpy : 0.49831414222717285 nb_pixel_total : 2336548 time to create 1 rle with new method : 0.4273669719696045 length of segment : 2764 time for calcul the mask position with numpy : 0.002529621124267578 nb_pixel_total : 61275 time to create 1 rle with old method : 0.06993436813354492 length of segment : 468 time for calcul the mask position with numpy : 0.0009050369262695312 nb_pixel_total : 21273 time to create 1 rle with old method : 0.025907278060913086 length of segment : 244 time for calcul the mask position with numpy : 0.04310321807861328 nb_pixel_total : 1585653 time to create 1 rle with new method : 0.3477206230163574 length of segment : 3000 time for calcul the mask position with numpy : 0.0012290477752685547 nb_pixel_total : 31930 time to create 1 rle with old method : 0.03596091270446777 length of segment : 239 time for calcul the mask position with numpy : 0.0005285739898681641 nb_pixel_total : 24092 time to create 1 rle with old method : 0.02825188636779785 length of segment : 95 time for calcul the mask position with numpy : 0.0023703575134277344 nb_pixel_total : 51797 time to create 1 rle with old method : 0.05987119674682617 length of segment : 510 time for calcul the mask position with numpy : 0.0009205341339111328 nb_pixel_total : 37088 time to create 1 rle with old method : 0.04328274726867676 length of segment : 199 time for calcul the mask position with numpy : 0.0003314018249511719 nb_pixel_total : 22769 time to create 1 rle with old method : 0.026858806610107422 length of segment : 98 time for calcul the mask position with numpy : 0.003952503204345703 nb_pixel_total : 149524 time to create 1 rle with old method : 0.17022466659545898 length of segment : 553 time for calcul the mask position with numpy : 0.007063627243041992 nb_pixel_total : 295593 time to create 1 rle with new method : 0.01458740234375 length of segment : 507 time for calcul the mask position with numpy : 0.0007672309875488281 nb_pixel_total : 22126 time to create 1 rle with old method : 0.025019168853759766 length of segment : 179 time for calcul the mask position with numpy : 0.03793525695800781 nb_pixel_total : 1660243 time to create 1 rle with new method : 0.15678095817565918 length of segment : 3019 time for calcul the mask position with numpy : 0.002031087875366211 nb_pixel_total : 132711 time to create 1 rle with old method : 0.14644312858581543 length of segment : 572 time for calcul the mask position with numpy : 0.0016565322875976562 nb_pixel_total : 86685 time to create 1 rle with old method : 0.09812164306640625 length of segment : 487 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 17238 time to create 1 rle with old method : 0.020203828811645508 length of segment : 107 time for calcul the mask position with numpy : 0.023215293884277344 nb_pixel_total : 1171041 time to create 1 rle with new method : 0.11649537086486816 length of segment : 1821 time for calcul the mask position with numpy : 0.0003986358642578125 nb_pixel_total : 6238 time to create 1 rle with old method : 0.007451295852661133 length of segment : 96 time for calcul the mask position with numpy : 0.025668859481811523 nb_pixel_total : 1022722 time to create 1 rle with new method : 0.18195557594299316 length of segment : 1720 time for calcul the mask position with numpy : 0.0010023117065429688 nb_pixel_total : 36510 time to create 1 rle with old method : 0.0410768985748291 length of segment : 248 time for calcul the mask position with numpy : 0.0017542839050292969 nb_pixel_total : 78403 time to create 1 rle with old method : 0.09073400497436523 length of segment : 397 time for calcul the mask position with numpy : 0.006253242492675781 nb_pixel_total : 272336 time to create 1 rle with new method : 0.010583162307739258 length of segment : 525 time for calcul the mask position with numpy : 0.002410888671875 nb_pixel_total : 89778 time to create 1 rle with old method : 0.10168695449829102 length of segment : 409 time for calcul the mask position with numpy : 0.0076143741607666016 nb_pixel_total : 335305 time to create 1 rle with new method : 0.020387649536132812 length of segment : 925 time for calcul the mask position with numpy : 0.0005488395690917969 nb_pixel_total : 13092 time to create 1 rle with old method : 0.015312433242797852 length of segment : 148 time for calcul the mask position with numpy : 0.005048513412475586 nb_pixel_total : 222980 time to create 1 rle with new method : 0.007863283157348633 length of segment : 640 time for calcul the mask position with numpy : 0.0030024051666259766 nb_pixel_total : 171945 time to create 1 rle with new method : 0.0035529136657714844 length of segment : 246 time for calcul the mask position with numpy : 0.004334211349487305 nb_pixel_total : 233800 time to create 1 rle with new method : 0.00595402717590332 length of segment : 391 time for calcul the mask position with numpy : 0.030878543853759766 nb_pixel_total : 333194 time to create 1 rle with new method : 0.2001352310180664 length of segment : 1904 time for calcul the mask position with numpy : 0.002480745315551758 nb_pixel_total : 54791 time to create 1 rle with old method : 0.06430268287658691 length of segment : 524 time for calcul the mask position with numpy : 0.002221345901489258 nb_pixel_total : 134571 time to create 1 rle with old method : 0.15539145469665527 length of segment : 332 time for calcul the mask position with numpy : 0.005026578903198242 nb_pixel_total : 332243 time to create 1 rle with new method : 0.013240575790405273 length of segment : 1221 time for calcul the mask position with numpy : 0.0008451938629150391 nb_pixel_total : 28651 time to create 1 rle with old method : 0.03261756896972656 length of segment : 335 time for calcul the mask position with numpy : 0.0023391246795654297 nb_pixel_total : 102104 time to create 1 rle with old method : 0.11693167686462402 length of segment : 714 time for calcul the mask position with numpy : 0.06428194046020508 nb_pixel_total : 2345551 time to create 1 rle with new method : 0.36477231979370117 length of segment : 3531 time for calcul the mask position with numpy : 0.0050318241119384766 nb_pixel_total : 395569 time to create 1 rle with new method : 0.011532783508300781 length of segment : 878 time for calcul the mask position with numpy : 0.0011105537414550781 nb_pixel_total : 90095 time to create 1 rle with old method : 0.10238480567932129 length of segment : 426 time for calcul the mask position with numpy : 0.03209829330444336 nb_pixel_total : 2263878 time to create 1 rle with new method : 0.1436166763305664 length of segment : 3372 time for calcul the mask position with numpy : 0.0015826225280761719 nb_pixel_total : 94681 time to create 1 rle with old method : 0.10743165016174316 length of segment : 323 time for calcul the mask position with numpy : 0.02132582664489746 nb_pixel_total : 1512923 time to create 1 rle with new method : 0.13649606704711914 length of segment : 2461 time for calcul the mask position with numpy : 0.0026922225952148438 nb_pixel_total : 123344 time to create 1 rle with old method : 0.1452481746673584 length of segment : 416 time for calcul the mask position with numpy : 0.1153113842010498 nb_pixel_total : 2292282 time to create 1 rle with new method : 1.1826121807098389 length of segment : 3960 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 17024 time to create 1 rle with old method : 0.019497156143188477 length of segment : 208 time for calcul the mask position with numpy : 0.0030121803283691406 nb_pixel_total : 180109 time to create 1 rle with new method : 0.0059468746185302734 length of segment : 377 time for calcul the mask position with numpy : 0.0006556510925292969 nb_pixel_total : 10985 time to create 1 rle with old method : 0.01307058334350586 length of segment : 102 time for calcul the mask position with numpy : 0.0017197132110595703 nb_pixel_total : 126752 time to create 1 rle with old method : 0.14312744140625 length of segment : 379 time for calcul the mask position with numpy : 0.0018305778503417969 nb_pixel_total : 53223 time to create 1 rle with old method : 0.060869693756103516 length of segment : 424 time for calcul the mask position with numpy : 0.008268356323242188 nb_pixel_total : 213383 time to create 1 rle with new method : 0.009120702743530273 length of segment : 811 time for calcul the mask position with numpy : 0.005917072296142578 nb_pixel_total : 195869 time to create 1 rle with new method : 0.008292198181152344 length of segment : 731 time for calcul the mask position with numpy : 0.012027502059936523 nb_pixel_total : 152550 time to create 1 rle with new method : 0.007460355758666992 length of segment : 666 time for calcul the mask position with numpy : 0.008197307586669922 nb_pixel_total : 62458 time to create 1 rle with old method : 0.07340049743652344 length of segment : 322 time for calcul the mask position with numpy : 0.06268620491027832 nb_pixel_total : 172978 time to create 1 rle with new method : 0.18124890327453613 length of segment : 1270 time for calcul the mask position with numpy : 0.06511759757995605 nb_pixel_total : 1104124 time to create 1 rle with new method : 0.18236923217773438 length of segment : 2149 time for calcul the mask position with numpy : 0.005994558334350586 nb_pixel_total : 75355 time to create 1 rle with old method : 0.08779215812683105 length of segment : 389 time for calcul the mask position with numpy : 0.00039458274841308594 nb_pixel_total : 18717 time to create 1 rle with old method : 0.021991729736328125 length of segment : 183 time for calcul the mask position with numpy : 0.009811878204345703 nb_pixel_total : 296210 time to create 1 rle with new method : 0.01196432113647461 length of segment : 749 time for calcul the mask position with numpy : 0.0005333423614501953 nb_pixel_total : 20052 time to create 1 rle with old method : 0.02372908592224121 length of segment : 162 time for calcul the mask position with numpy : 0.004284381866455078 nb_pixel_total : 197207 time to create 1 rle with new method : 0.012612581253051758 length of segment : 814 time for calcul the mask position with numpy : 0.07289409637451172 nb_pixel_total : 2418883 time to create 1 rle with new method : 0.48012852668762207 length of segment : 2630 time for calcul the mask position with numpy : 0.36307811737060547 nb_pixel_total : 1085671 time to create 1 rle with new method : 0.17124366760253906 length of segment : 2006 time for calcul the mask position with numpy : 0.0015478134155273438 nb_pixel_total : 47871 time to create 1 rle with old method : 0.05508089065551758 length of segment : 237 time for calcul the mask position with numpy : 0.0014183521270751953 nb_pixel_total : 75048 time to create 1 rle with old method : 0.08656644821166992 length of segment : 527 time for calcul the mask position with numpy : 0.022635698318481445 nb_pixel_total : 11912 time to create 1 rle with old method : 0.017970561981201172 length of segment : 136 time for calcul the mask position with numpy : 0.053859710693359375 nb_pixel_total : 286762 time to create 1 rle with new method : 0.013967275619506836 length of segment : 702 time for calcul the mask position with numpy : 0.001802682876586914 nb_pixel_total : 36874 time to create 1 rle with old method : 0.04159116744995117 length of segment : 251 time for calcul the mask position with numpy : 0.09922575950622559 nb_pixel_total : 158056 time to create 1 rle with new method : 0.008591175079345703 length of segment : 608 time for calcul the mask position with numpy : 0.0005948543548583984 nb_pixel_total : 7769 time to create 1 rle with old method : 0.009162425994873047 length of segment : 166 time for calcul the mask position with numpy : 0.0002639293670654297 nb_pixel_total : 13562 time to create 1 rle with old method : 0.015368223190307617 length of segment : 161 time for calcul the mask position with numpy : 0.0017521381378173828 nb_pixel_total : 114369 time to create 1 rle with old method : 0.13002371788024902 length of segment : 768 time for calcul the mask position with numpy : 0.008292913436889648 nb_pixel_total : 610014 time to create 1 rle with new method : 0.017641782760620117 length of segment : 795 time for calcul the mask position with numpy : 0.008664369583129883 nb_pixel_total : 178203 time to create 1 rle with new method : 0.006795644760131836 length of segment : 322 time for calcul the mask position with numpy : 0.0004885196685791016 nb_pixel_total : 24477 time to create 1 rle with old method : 0.028466463088989258 length of segment : 150 time for calcul the mask position with numpy : 0.009089231491088867 nb_pixel_total : 459710 time to create 1 rle with new method : 0.013472318649291992 length of segment : 794 time for calcul the mask position with numpy : 0.40906262397766113 nb_pixel_total : 6330512 time to create 1 rle with new method : 0.8495638370513916 length of segment : 6325 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 21094 time to create 1 rle with old method : 0.023532390594482422 length of segment : 205 time for calcul the mask position with numpy : 0.012387514114379883 nb_pixel_total : 51124 time to create 1 rle with old method : 0.056731462478637695 length of segment : 351 time for calcul the mask position with numpy : 0.8449573516845703 nb_pixel_total : 1093288 time to create 1 rle with new method : 0.9358034133911133 length of segment : 2522 time for calcul the mask position with numpy : 0.01670384407043457 nb_pixel_total : 97992 time to create 1 rle with old method : 0.11450743675231934 length of segment : 297 time for calcul the mask position with numpy : 0.0003688335418701172 nb_pixel_total : 17256 time to create 1 rle with old method : 0.020209550857543945 length of segment : 125 time for calcul the mask position with numpy : 0.002062559127807617 nb_pixel_total : 140605 time to create 1 rle with old method : 0.15798187255859375 length of segment : 484 time for calcul the mask position with numpy : 0.003860950469970703 nb_pixel_total : 258043 time to create 1 rle with new method : 0.010519266128540039 length of segment : 615 time for calcul the mask position with numpy : 0.2836019992828369 nb_pixel_total : 1174872 time to create 1 rle with new method : 0.09772396087646484 length of segment : 2490 time for calcul the mask position with numpy : 0.18979382514953613 nb_pixel_total : 1660664 time to create 1 rle with new method : 0.16825413703918457 length of segment : 2623 time for calcul the mask position with numpy : 0.0008411407470703125 nb_pixel_total : 58995 time to create 1 rle with old method : 0.06688642501831055 length of segment : 229 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 32365 time to create 1 rle with old method : 0.03692793846130371 length of segment : 219 time for calcul the mask position with numpy : 0.027083396911621094 nb_pixel_total : 1800910 time to create 1 rle with new method : 0.17100977897644043 length of segment : 1822 time for calcul the mask position with numpy : 0.03504514694213867 nb_pixel_total : 1439862 time to create 1 rle with new method : 0.30424928665161133 length of segment : 1841 time for calcul the mask position with numpy : 0.005699634552001953 nb_pixel_total : 46057 time to create 1 rle with old method : 0.055881500244140625 length of segment : 167 time for calcul the mask position with numpy : 0.027614593505859375 nb_pixel_total : 321320 time to create 1 rle with new method : 0.010415077209472656 length of segment : 744 time for calcul the mask position with numpy : 0.006800174713134766 nb_pixel_total : 441224 time to create 1 rle with new method : 0.017821788787841797 length of segment : 903 time for calcul the mask position with numpy : 0.0007691383361816406 nb_pixel_total : 50148 time to create 1 rle with old method : 0.05660223960876465 length of segment : 181 time for calcul the mask position with numpy : 0.07526278495788574 nb_pixel_total : 69256 time to create 1 rle with old method : 0.07954287528991699 length of segment : 378 time for calcul the mask position with numpy : 0.02864241600036621 nb_pixel_total : 84566 time to create 1 rle with old method : 0.09726715087890625 length of segment : 446 time for calcul the mask position with numpy : 0.037932634353637695 nb_pixel_total : 210728 time to create 1 rle with new method : 0.008391618728637695 length of segment : 500 time for calcul the mask position with numpy : 0.13297533988952637 nb_pixel_total : 267724 time to create 1 rle with new method : 0.010442256927490234 length of segment : 677 time for calcul the mask position with numpy : 0.7124426364898682 nb_pixel_total : 807252 time to create 1 rle with new method : 0.22068524360656738 length of segment : 898 time for calcul the mask position with numpy : 0.005907297134399414 nb_pixel_total : 14753 time to create 1 rle with old method : 0.018980979919433594 length of segment : 117 time for calcul the mask position with numpy : 0.037551164627075195 nb_pixel_total : 245667 time to create 1 rle with new method : 0.008863210678100586 length of segment : 473 time for calcul the mask position with numpy : 0.07484006881713867 nb_pixel_total : 899227 time to create 1 rle with new method : 0.05553770065307617 length of segment : 928 time for calcul the mask position with numpy : 0.3249838352203369 nb_pixel_total : 1105741 time to create 1 rle with new method : 0.16951560974121094 length of segment : 2132 time for calcul the mask position with numpy : 0.06751585006713867 nb_pixel_total : 216008 time to create 1 rle with new method : 0.012116432189941406 length of segment : 1001 time for calcul the mask position with numpy : 0.10570955276489258 nb_pixel_total : 1118625 time to create 1 rle with new method : 0.09418702125549316 length of segment : 2388 time for calcul the mask position with numpy : 0.0037467479705810547 nb_pixel_total : 258722 time to create 1 rle with new method : 0.009748697280883789 length of segment : 656 time for calcul the mask position with numpy : 0.0028569698333740234 nb_pixel_total : 216991 time to create 1 rle with new method : 0.006433963775634766 length of segment : 379 time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 14014 time to create 1 rle with old method : 0.023144245147705078 length of segment : 139 time for calcul the mask position with numpy : 0.06149411201477051 nb_pixel_total : 144855 time to create 1 rle with old method : 0.18295073509216309 length of segment : 388 time for calcul the mask position with numpy : 0.008745670318603516 nb_pixel_total : 78252 time to create 1 rle with old method : 0.09406661987304688 length of segment : 240 time for calcul the mask position with numpy : 0.6891758441925049 nb_pixel_total : 1683186 time to create 1 rle with new method : 0.20281028747558594 length of segment : 4056 time for calcul the mask position with numpy : 0.0683588981628418 nb_pixel_total : 109023 time to create 1 rle with old method : 0.12228631973266602 length of segment : 293 time for calcul the mask position with numpy : 0.028027057647705078 nb_pixel_total : 339274 time to create 1 rle with new method : 0.0179901123046875 length of segment : 861 time for calcul the mask position with numpy : 0.047411203384399414 nb_pixel_total : 90813 time to create 1 rle with old method : 0.10634803771972656 length of segment : 510 time for calcul the mask position with numpy : 0.0474855899810791 nb_pixel_total : 121047 time to create 1 rle with old method : 0.16330885887145996 length of segment : 453 time for calcul the mask position with numpy : 0.01808309555053711 nb_pixel_total : 286688 time to create 1 rle with new method : 0.016736268997192383 length of segment : 1022 time for calcul the mask position with numpy : 0.008473873138427734 nb_pixel_total : 333131 time to create 1 rle with new method : 0.015132665634155273 length of segment : 884 time for calcul the mask position with numpy : 1.2739319801330566 nb_pixel_total : 3645555 time to create 1 rle with new method : 0.9745478630065918 length of segment : 5937 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 17902 time to create 1 rle with old method : 0.020312786102294922 length of segment : 184 time for calcul the mask position with numpy : 0.00441431999206543 nb_pixel_total : 13487 time to create 1 rle with old method : 0.01816844940185547 length of segment : 92 time for calcul the mask position with numpy : 0.10719656944274902 nb_pixel_total : 1925100 time to create 1 rle with new method : 0.26145195960998535 length of segment : 2898 time for calcul the mask position with numpy : 0.002683401107788086 nb_pixel_total : 178564 time to create 1 rle with new method : 0.006279706954956055 length of segment : 392 time for calcul the mask position with numpy : 0.02511143684387207 nb_pixel_total : 194115 time to create 1 rle with new method : 0.0075855255126953125 length of segment : 362 time for calcul the mask position with numpy : 0.008064746856689453 nb_pixel_total : 370861 time to create 1 rle with new method : 0.021038532257080078 length of segment : 796 time for calcul the mask position with numpy : 0.0031130313873291016 nb_pixel_total : 189469 time to create 1 rle with new method : 0.0075855255126953125 length of segment : 397 time for calcul the mask position with numpy : 0.43969154357910156 nb_pixel_total : 980422 time to create 1 rle with new method : 0.7438995838165283 length of segment : 3107 time for calcul the mask position with numpy : 0.003828763961791992 nb_pixel_total : 325809 time to create 1 rle with new method : 0.0076923370361328125 length of segment : 448 time for calcul the mask position with numpy : 0.021997928619384766 nb_pixel_total : 94195 time to create 1 rle with old method : 0.12477922439575195 length of segment : 280 time for calcul the mask position with numpy : 0.025476932525634766 nb_pixel_total : 428773 time to create 1 rle with new method : 0.019440412521362305 length of segment : 924 time for calcul the mask position with numpy : 0.04160022735595703 nb_pixel_total : 241853 time to create 1 rle with new method : 0.012423515319824219 length of segment : 660 time for calcul the mask position with numpy : 0.293109655380249 nb_pixel_total : 1621116 time to create 1 rle with new method : 0.33425211906433105 length of segment : 2373 time for calcul the mask position with numpy : 0.05339479446411133 nb_pixel_total : 80554 time to create 1 rle with old method : 0.09939837455749512 length of segment : 358 time for calcul the mask position with numpy : 0.004389047622680664 nb_pixel_total : 256775 time to create 1 rle with new method : 0.012116670608520508 length of segment : 802 time spent for convertir_results : 57.7283661365509 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 157 chid ids of type : 3663 Number RLEs to save : 139300 save missing photos in datou_result : time spend for datou_step_exec : 139.09753680229187 time spend to save output : 8.533313512802124 total time spend for step 1 : 147.630850315094 step2:brightness Fri Sep 26 11:34:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758879130_72039_1385819682_9c5b83f6b8f816d397e571a88a30abd3.jpg treat image : temp/1758879130_72039_1385819680_b7c4ed679f8cde03c6f67c9847a5e8a1.jpg treat image : temp/1758879130_72039_1385819678_050d44c78ff20c215a545347ed42e532.jpg treat image : temp/1758879130_72039_1385818789_0e8dbc79f591faba252bd8f67d7b678e.jpg treat image : temp/1758879130_72039_1385818787_57dda9a038ca81c5ad5a69f23b4bee72.jpg treat image : temp/1758879130_72039_1385818780_878d387ccdb2aea2af9b3c68e0ccbd20.jpg treat image : temp/1758879130_72039_1385818768_79433383dc652af85e230ec32d0628ea.jpg treat image : temp/1758879130_72039_1385818765_a5b5f58b4ada44659d8bac08aa685222.jpg treat image : temp/1758879130_72039_1385818761_9a46591a11828c68d64fcb868b07d331.jpg treat image : temp/1758879130_72039_1385817937_d1bd69264fba98b70c356f2dcbb5d29d.jpg treat image : temp/1758879130_72039_1385817929_2cba99571f3ace03c82e4050a38cdf06.jpg treat image : temp/1758879130_72039_1385817923_98a21761934c312123ce2734af18276c.jpg treat image : temp/1758879130_72039_1385817895_e4d6db9c79e2d0e969abec671adbf058.jpg treat image : temp/1758879130_72039_1385817858_908faa74b54d25c7b0931c98bd39fde8.jpg treat image : temp/1758879130_72039_1385816270_8468404631689f0b384f481bdf715904.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 15 time used for this insertion : 0.013459205627441406 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 15 time used for this insertion : 0.012016057968139648 save missing photos in datou_result : time spend for datou_step_exec : 24.643640279769897 time spend to save output : 0.037627220153808594 total time spend for step 2 : 24.681267499923706 step3:blur_detection Fri Sep 26 11:35:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758879130_72039_1385819682_9c5b83f6b8f816d397e571a88a30abd3.jpg resize: (3040, 4056) 1385819682 -0.5299492678500156 treat image : temp/1758879130_72039_1385819680_b7c4ed679f8cde03c6f67c9847a5e8a1.jpg resize: (3040, 4056) 1385819680 0.37470769015794425 treat image : temp/1758879130_72039_1385819678_050d44c78ff20c215a545347ed42e532.jpg resize: (3040, 4056) 1385819678 0.2702820986615219 treat image : temp/1758879130_72039_1385818789_0e8dbc79f591faba252bd8f67d7b678e.jpg resize: (3040, 4056) 1385818789 -0.04117967503935958 treat image : temp/1758879130_72039_1385818787_57dda9a038ca81c5ad5a69f23b4bee72.jpg resize: (3040, 4056) 1385818787 -0.2029066283001741 treat image : temp/1758879130_72039_1385818780_878d387ccdb2aea2af9b3c68e0ccbd20.jpg resize: (3040, 4056) 1385818780 -0.21111418711751204 treat image : temp/1758879130_72039_1385818768_79433383dc652af85e230ec32d0628ea.jpg resize: (3040, 4056) 1385818768 -0.2280644637816899 treat image : temp/1758879130_72039_1385818765_a5b5f58b4ada44659d8bac08aa685222.jpg resize: (3040, 4056) 1385818765 0.02282969685334949 treat image : temp/1758879130_72039_1385818761_9a46591a11828c68d64fcb868b07d331.jpg resize: (3040, 4056) 1385818761 -0.30303099104444675 treat image : temp/1758879130_72039_1385817937_d1bd69264fba98b70c356f2dcbb5d29d.jpg resize: (3040, 4056) 1385817937 -4.103963769341632 treat image : temp/1758879130_72039_1385817929_2cba99571f3ace03c82e4050a38cdf06.jpg resize: (3040, 4056) 1385817929 -0.18218909479643514 treat image : temp/1758879130_72039_1385817923_98a21761934c312123ce2734af18276c.jpg resize: (3040, 4056) 1385817923 -0.1049280183988547 treat image : temp/1758879130_72039_1385817895_e4d6db9c79e2d0e969abec671adbf058.jpg resize: (3040, 4056) 1385817895 -0.3423309621143214 treat image : temp/1758879130_72039_1385817858_908faa74b54d25c7b0931c98bd39fde8.jpg resize: (3040, 4056) 1385817858 -0.8654203484370747 treat image : temp/1758879130_72039_1385816270_8468404631689f0b384f481bdf715904.jpg resize: (3040, 4056) 1385816270 -0.7862106086730729 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 15 time used for this insertion : 0.014176607131958008 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 15 time used for this insertion : 0.012349605560302734 save missing photos in datou_result : time spend for datou_step_exec : 88.78646421432495 time spend to save output : 0.09065055847167969 total time spend for step 3 : 88.87711477279663 step4:crop_condition Fri Sep 26 11:36:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3663 Loading chi in step crop for list_pids : 15 ! batch 1 Loaded 157 chid ids of type : 3663 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : teint_dans_la_masse param for this class : {'min_score': 0.7} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! we have finished the crop for the class : teint_dans_la_masse begin to crop the class : autre_refus param for this class : {'min_score': 0.5} filtre for class : autre_refus hashtag_id of this class : 2107752406 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! we have finished the crop for the class : autre_refus begin to crop the class : carton_gris param for this class : {'min_score': 0.5} filtre for class : carton_gris hashtag_id of this class : 2107753020 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! we have finished the crop for the class : carton_gris begin to crop the class : cartonnette param for this class : {'min_score': 0.5} filtre for class : cartonnette hashtag_id of this class : 702398920 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! we have finished the crop for the class : cartonnette begin to crop the class : carton_brun param for this class : {'min_score': 0.7} filtre for class : carton_brun hashtag_id of this class : 2107753024 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! we have finished the crop for the class : carton_brun begin to crop the class : plastique param for this class : {'min_score': 0.5} filtre for class : plastique hashtag_id of this class : 492725882 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! we have finished the crop for the class : plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! we have finished the crop for the class : kraft begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1385819682, 1385819680, 1385819678, 1385818789, 1385818787, 1385818780, 1385818768, 1385818765, 1385818761, 1385817937, 1385817929, 1385817923, 1385817895, 1385817858, 1385816270] Looping around the photos to save general results len do output : 109 /-3976654063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3976654170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385819682', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385819680', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385819678', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385818789', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385818787', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385818780', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385818768', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385818765', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385818761', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385817937', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385817929', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385817923', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385817895', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385817858', None, None, None, None, None, '3776893') ('4433', None, None, None, None, None, None, None, '3776893') ('4433', None, '1385816270', None, None, None, None, None, '3776893') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 342 time used for this insertion : 0.04490232467651367 save_final save missing photos in datou_result : time spend for datou_step_exec : 144.26612257957458 time spend to save output : 0.05274844169616699 total time spend for step 4 : 144.31887102127075 step5:thcl Fri Sep 26 11:39:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! nombre de thcls : 1 we are using the classfication for multi_thcl [2456] time to import caffe and check if the image exist : 0.014319419860839844 time to convert the images to numpy array : 0.29637789726257324 time to import caffe and check if the image exist : 0.016794919967651367 time to convert the images to numpy array : 0.6268675327301025 time to import caffe and check if the image exist : 0.01582026481628418 time to convert the images to numpy array : 0.9160070419311523 time to import caffe and check if the image exist : 0.019229888916015625 time to convert the images to numpy array : 1.4442775249481201 time to import caffe and check if the image exist : 0.020685672760009766 time to convert the images to numpy array : 1.445650339126587 time to import caffe and check if the image exist : 0.023487329483032227 time to convert the images to numpy array : 1.4909145832061768 time to import caffe and check if the image exist : 0.011089563369750977 time to convert the images to numpy array : 1.55372953414917 time to import caffe and check if the image exist : 0.021799325942993164 time to convert the images to numpy array : 1.8000726699829102 time to import caffe and check if the image exist : 0.018871545791625977 time to convert the images to numpy array : 2.19938325881958 time to import caffe and check if the image exist : 0.017423391342163086 time to convert the images to numpy array : 2.2330706119537354 total time to convert the images to numpy array : 3.4753434658050537 list photo_ids error: [] list photo_ids correct : [-3976654069, -3976654078, -3976654079, -3976654081, -3976654082, -3976654084, -3976654087, -3976654088, -3976654091, -3976654102, -3976654112, -3976654120, -3976654140, -3976654141, -3976654142, -3976654143, -3976654145, -3976654154, -3976654155, -3976654157, -3976654158, -3976654159, -3976654063, -3976654065, -3976654086, -3976654089, -3976654094, -3976654100, -3976654123, -3976654129, -3976654186, -3976654196, -3976654203, -3976654057, -3976654059, -3976654061, -3976654066, -3976654071, -3976654074, -3976654076, -3976654093, -3976654101, -3976654105, -3976654106, -3976654109, -3976654110, -3976654111, -3976654113, -3976654115, -3976654116, -3976654118, -3976654122, -3976654130, -3976654144, -3976654149, -3976654125, -3976654135, -3976654148, -3976654173, -3976654174, -3976654183, -3976654193, -3976654199, -3976654206, -3976654054, -3976654055, -3976654168, -3976654172, -3976654180, -3976654182, -3976654190, -3976654191, -3976654192, -3976654200, -3976654064, -3976654067, -3976654068, -3976654075, -3976654090, -3976654098, -3976654133, -3976654178, -3976654208, -3976654058, -3976654070, -3976654085, -3976654103, -3976654104, -3976654160, -3976654163, -3976654164, -3976654166, -3976654171, -3976654176, -3976654177, -3976654185, -3976654188, -3976654189, -3976654195, -3976654204, -3976654096, -3976654127, -3976654128, -3976654152, -3976654165, -3976654169, -3976654201, -3976654205, -3976654170] number of photos to traite : 109 try to delete the photos incorrect in DB tagging for thcl : 2456 To do loadFromThcl(), then load ParamDescType : thcl2456 thcls : [{'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'}] thcl {'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'} Update svm_hashtag_type_desc : 4999 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) To loadFromThcl() : net_4999 begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 2500 l 3632 free memory gpu now : 1828 wait 20 seconds l 3637 free memory gpu now : 1828 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_qualipapia_papier_refus_from_vlg_data_aug Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_qualipapia_papier_refus_from_vlg_data_aug model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/caffemodel size_local : 44972172 size in s3 : 44972172 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 caffemodel already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/deploy.prototxt size_local : 17311 size in s3 : 17311 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:51 mean.npy already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/synset_words.txt size_local : 57 size in s3 : 57 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/:/home/admin/workarea/git/apy/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/deploy.prototxt caffemodel_filename : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2802 max_wait_temp : 1 max_wait : 0 dict_keys(['prob']) time used to do the prepocess of the images : 3.782567024230957 time used to do the prediction : 0.2868216037750244 we don't save the descriptors for this thcl 2456 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos test new format of the output of the step_thcl begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 0 time used for this insertion : 3.123283386230469e-05 save missing photos in datou_result : time spend for datou_step_exec : 31.99320888519287 time spend to save output : 0.00037932395935058594 total time spend for step 5 : 31.99358820915222 step6:tfhub_classification2 Fri Sep 26 11:39:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step TFHub with tf2 ! we are using the classfication for only one thcl 3501 begin to check gpu status inside check gpu memory inside check gpu memory inside check gpu memory inside check gpu memory inside check gpu memory inside check gpu memory 2025-09-26 11:39:42.577700: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-26 11:39:42.579384: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-26 11:39:42.579513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-26 11:39:42.579594: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-26 11:39:42.587490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-26 11:39:42.587738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-26 11:39:42.617738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-26 11:39:42.622316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-26 11:39:42.671087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-26 11:39:42.672707: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-26 11:39:42.673266: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-26 11:39:42.704742: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-26 11:39:42.706830: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc0fc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-26 11:39:42.706868: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-26 11:39:42.711565: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x43635ff0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-26 11:39:42.711601: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-26 11:39:42.712660: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-26 11:39:42.712769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-26 11:39:42.712804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-26 11:39:42.712942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-26 11:39:42.712977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-26 11:39:42.713025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-26 11:39:42.713076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-26 11:39:42.713159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-26 11:39:42.714545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-26 11:39:42.715045: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-26 11:39:42.715132: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-26 11:39:42.715151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-26 11:39:42.715166: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-26 11:39:42.716700: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3096 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) l 3637 free memory gpu now : 2800 max_wait_temp : 6 max_wait : 5 1 Physical GPUs, 1 Logical GPUs tagging for thcl : 3501 To do loadFromThcl(), then load ParamDescType : thcl3501 thcls : [{'id': 3501, 'mtr_user_id': 31, 'name': 'learn_papier_mixte_centre_tf_b4_220223_3', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '9087724,9087727,9087725,9087729,9087726,9087723,9087722,9087720,9087721,9087728', 'photo_hashtag_type': 4539, 'photo_desc_type': 5759, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'}] thcl {'id': 3501, 'mtr_user_id': 31, 'name': 'learn_papier_mixte_centre_tf_b4_220223_3', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '9087724,9087727,9087725,9087729,9087726,9087723,9087722,9087720,9087721,9087728', 'photo_hashtag_type': 4539, 'photo_desc_type': 5759, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'} Update svm_hashtag_type_desc : 5759 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5759, 'learn_papier_mixte_centre_tf_b4_220223_3', 1792, 1792, 'learn_papier_mixte_centre_tf_b4_220223_3', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2023, 2, 22, 13, 54, 32), datetime.datetime(2023, 2, 22, 13, 54, 32)) model_name : learn_papier_mixte_centre_tf_b4_220223_3 model_param file didn't exist model_name : learn_papier_mixte_centre_tf_b4_220223_3 model_type : tf_classification2 list file need : ['Confusion_Matrix.png', 'Precision_Recall_Carton_brun.jpg', 'Precision_Recall_Carton_gris.jpg', 'Precision_Recall_Teint_Dans_La_Masse.jpg', 'Precision_Recall_autre_refus.jpg', 'Precision_Recall_cartonnette.jpg', 'Precision_Recall_environnement.jpg', 'Precision_Recall_kraft.jpg', 'Precision_Recall_metal.jpg', 'Precision_Recall_papier.jpg', 'Precision_Recall_plastique.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file exist in s3 : ['Confusion_Matrix.png', 'Precision_Recall_Carton_brun.jpg', 'Precision_Recall_Carton_gris.jpg', 'Precision_Recall_Teint_Dans_La_Masse.jpg', 'Precision_Recall_autre_refus.jpg', 'Precision_Recall_cartonnette.jpg', 'Precision_Recall_environnement.jpg', 'Precision_Recall_kraft.jpg', 'Precision_Recall_metal.jpg', 'Precision_Recall_papier.jpg', 'Precision_Recall_plastique.jpg', 'Result_Summary.txt', 'checkpoint', 'model_checkpoint.ckpt.data-00000-of-00002', 'model_checkpoint.ckpt.data-00001-of-00002', 'model_checkpoint.ckpt.index', 'model_weights.h5'] file manque in s3 : [] 2025-09-26 11:39:56.346404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.02G (3246391296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3 /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Confusion_Matrix.png size_local : 121269 size in s3 : 121269 create time local : 2023-03-03 12:26:14 create time in s3 : 2023-02-22 12:54:17 Confusion_Matrix.png already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_Carton_brun.jpg size_local : 76104 size in s3 : 76104 create time local : 2023-03-03 12:26:14 create time in s3 : 2023-02-22 12:54:31 Precision_Recall_Carton_brun.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_Carton_gris.jpg size_local : 82912 size in s3 : 82912 create time local : 2023-03-03 12:26:14 create time in s3 : 2023-02-22 12:54:31 Precision_Recall_Carton_gris.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_Teint_Dans_La_Masse.jpg size_local : 75423 size in s3 : 75423 create time local : 2023-03-03 12:26:14 create time in s3 : 2023-02-22 12:54:25 Precision_Recall_Teint_Dans_La_Masse.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_autre_refus.jpg size_local : 78883 size in s3 : 78883 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:31 Precision_Recall_autre_refus.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_cartonnette.jpg size_local : 81791 size in s3 : 81791 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:30 Precision_Recall_cartonnette.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_environnement.jpg size_local : 59936 size in s3 : 59936 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:17 Precision_Recall_environnement.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_kraft.jpg size_local : 80280 size in s3 : 80280 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:25 Precision_Recall_kraft.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_metal.jpg size_local : 77736 size in s3 : 77736 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:31 Precision_Recall_metal.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_papier.jpg size_local : 69041 size in s3 : 69041 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:31 Precision_Recall_papier.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Precision_Recall_plastique.jpg size_local : 70770 size in s3 : 70770 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:17 Precision_Recall_plastique.jpg already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/Result_Summary.txt size_local : 1092 size in s3 : 1092 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:31 Result_Summary.txt already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/checkpoint size_local : 99 size in s3 : 99 create time local : 2023-03-03 12:26:15 create time in s3 : 2023-02-22 12:54:31 checkpoint already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/model_checkpoint.ckpt.data-00000-of-00002 size_local : 429801 size in s3 : 429801 create time local : 2023-03-03 12:26:16 create time in s3 : 2023-02-22 12:54:30 model_checkpoint.ckpt.data-00000-of-00002 already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/model_checkpoint.ckpt.data-00001-of-00002 size_local : 141033188 size in s3 : 141033188 create time local : 2023-03-03 12:26:17 create time in s3 : 2023-02-22 12:54:25 model_checkpoint.ckpt.data-00001-of-00002 already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/model_checkpoint.ckpt.index size_local : 85618 size in s3 : 85618 create time local : 2023-03-03 12:26:17 create time in s3 : 2023-02-22 12:54:30 model_checkpoint.ckpt.index already exist and didn't need to update /data/models_weight/learn_papier_mixte_centre_tf_b4_220223_3/model_weights.h5 size_local : 71289448 size in s3 : 71289448 create time local : 2023-03-03 12:26:18 create time in s3 : 2023-02-22 12:54:17 model_weights.h5 already exist and didn't need to update ERROR in datou_step_exec, will save and exit ! assertion failed: [0] [Op:Assert] name: EagerVariableNameReuse File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2339, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2533, in datou_step_exec return lib_process.datou_step_tfhub2(param, json_param, args, cache, context, map_info, verbose) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_process.py", line 3139, in datou_step_tfhub2 this_model = model_evaluator(model_name, model_type=model_type, fc_size=fc_size,use_multi_inputs=use_multi_inputs) File "/home/admin/workarea/git/Velours/python/mtr/tfhub2/evaluate.py", line 156, in __init__ self.model, _, _ = create_tfhub_model(module_handle=self.tfhub_module, File "/home/admin/workarea/git/Velours/python/mtr/tfhub2/evaluate.py", line 77, in create_tfhub_model hub.KerasLayer(module_handle, trainable=do_fine_tuning, name="module"), File "/home/admin/.local/lib/python3.8/site-packages/tensorflow_hub/keras_layer.py", line 152, in __init__ self._func = load_module(handle, tags, self._load_options) File "/home/admin/.local/lib/python3.8/site-packages/tensorflow_hub/keras_layer.py", line 421, in load_module return module_v2.load(handle, tags=tags, options=set_load_options) File "/home/admin/.local/lib/python3.8/site-packages/tensorflow_hub/module_v2.py", line 106, in load obj = tf.compat.v1.saved_model.load_v2(module_path, tags=tags) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 578, in load return load_internal(export_dir, tags) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 602, in load_internal loader = loader_cls(object_graph_proto, File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 123, in __init__ self._load_all() File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 134, in _load_all self._load_nodes() File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 264, in _load_nodes node, setter = self._recreate(proto, node_id) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 370, in _recreate return factory[kind]() File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 363, in "variable": lambda: self._recreate_variable(proto.variable), File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 426, in _recreate_variable return variables.Variable( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 261, in __call__ return cls._variable_v2_call(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 243, in _variable_v2_call return previous_getter( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 66, in getter return captured_getter(captured_previous, **kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/load.py", line 418, in uninitialized_variable_creator return resource_variable_ops.UninitializedVariable(**kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ return super(VariableMetaclass, cls).__call__(*args, **kwargs) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1795, in __init__ handle = _variable_handle_from_shape_and_dtype( File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 174, in _variable_handle_from_shape_and_dtype gen_logging_ops._assert( # pylint: disable=protected-access File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_logging_ops.py", line 55, in _assert _ops.raise_from_not_ok_status(e, name) File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status six.raise_from(core._status_to_exception(e.code, message), None) File "", line 3, in raise_from [1385819682, 1385819680, 1385819678, 1385818789, 1385818787, 1385818780, 1385818768, 1385818765, 1385818761, 1385817937, 1385817929, 1385817923, 1385817895, 1385817858, 1385816270] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01734757423400879 save_final ERROR in last step tfhub_classification2, assertion failed: [0] [Op:Assert] name: EagerVariableNameReuse time spend for datou_step_exec : 23.312540769577026 time spend to save output : 0.025304317474365234 total time spend for step 5 : 23.33784508705139 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 297.28user 141.54system 7:53.46elapsed 92%CPU (0avgtext+0avgdata 6084860maxresident)k 5405456inputs+303288outputs (78859major+17046472minor)pagefaults 0swaps