python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1408051 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2883777'] with mtr_portfolio_ids : ['23079427'] and first list_photo_ids : [] new path : /proc/1408051/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFB[Errno 104] Connection reset by peer can't download the photo : 1359022341 complete_path : /home/admin/workarea/git/Velours/python/temp/1747417827_1408051_1359022341_8955a0a8f5cf16966a67456599b7fff1.jpg FB[Errno 104] Connection reset by peer can't download the photo : 1359022336 complete_path : /home/admin/workarea/git/Velours/python/temp/1747417827_1408051_1359022336_7d7360c4fe29887cafd098fa58ac0461.jpg FB[Errno 104] Connection reset by peer can't download the photo : 1359022332 complete_path : /home/admin/workarea/git/Velours/python/temp/1747417827_1408051_1359022332_e75171d3eae83fa25d9f1fd26c3a483a.jpg FBFBFBFBFBFBFBFwe have missing 3 photos in the step downloads : photo missing : [1359022341, 1359022336, 1359022332] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1359022341 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1359022336 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1359022332 length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 2.632147789001465 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri May 16 19:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7037 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-16 19:50:32.974659: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-16 19:50:32.999282: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-16 19:50:33.000882: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe084000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-16 19:50:33.000908: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-16 19:50:33.003593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-16 19:50:33.149559: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x32894a50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-16 19:50:33.149618: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-16 19:50:33.150538: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 19:50:33.151028: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 19:50:33.153829: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 19:50:33.156868: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 19:50:33.157600: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 19:50:33.160497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 19:50:33.161623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 19:50:33.166460: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 19:50:33.167863: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 19:50:33.167968: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 19:50:33.168665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 19:50:33.168682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 19:50:33.168692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 19:50:33.169860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6328 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-16 19:50:33.440899: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 19:50:33.441014: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 19:50:33.441032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 19:50:33.441047: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 19:50:33.441062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 19:50:33.441077: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 19:50:33.441090: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 19:50:33.441105: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 19:50:33.442144: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 19:50:33.443220: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 19:50:33.443258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 19:50:33.443274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 19:50:33.443288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 19:50:33.443302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 19:50:33.443315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 19:50:33.443328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 19:50:33.443357: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 19:50:33.444397: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 19:50:33.444433: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 19:50:33.444442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 19:50:33.444450: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 19:50:33.445530: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6328 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-16 19:50:43.803257: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 19:50:44.042808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 19:50:45.672545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.673118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.673893: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.674404: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.674923: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.675504: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.676046: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.676078: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.676632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.676649: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.684714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.684753: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.685308: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.685325: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.691822: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.691847: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.692892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.692932: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.726635: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.726679: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.727257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.727277: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.733101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.733127: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.733681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.733699: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 19:50:45.772340: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.772930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.774916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.775441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.821227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.821809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.824020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.824545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.851378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.851912: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.853387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.853910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.859331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.860005: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.861773: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.862324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.867853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.868374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.870044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.870564: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.901168: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.901700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.902217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.902734: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.907067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.907642: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.923823: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.924377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.924895: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.925447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.937740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.938280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.938802: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.939569: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.945005: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.945548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.950131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.950825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.962998: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.963526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.968692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.969215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.969750: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.970269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.970977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.971539: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.982255: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.982780: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.983369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.983921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.984459: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.985000: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.985548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.986096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.995566: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:45.996125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.002290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.002815: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.063615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.064196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.074975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.075556: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.093977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.095126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.096083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.096969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.101939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.102798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.103414: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.103939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.104977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.105013: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-16 19:50:46.115228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.120480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.130644: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.131402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.132167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.132871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.133593: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 19:50:46.134302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 50 Detection mask done ! Trying to reset tf kernel 1408415 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5844 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6816 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.003450632095336914 nb_pixel_total : 107562 time to create 1 rle with old method : 0.11314058303833008 length of segment : 392 time for calcul the mask position with numpy : 0.0034024715423583984 nb_pixel_total : 113291 time to create 1 rle with old method : 0.12350988388061523 length of segment : 576 time for calcul the mask position with numpy : 0.0026178359985351562 nb_pixel_total : 114229 time to create 1 rle with old method : 0.12322998046875 length of segment : 509 time for calcul the mask position with numpy : 0.006734371185302734 nb_pixel_total : 238987 time to create 1 rle with new method : 0.018491506576538086 length of segment : 615 time for calcul the mask position with numpy : 0.0024261474609375 nb_pixel_total : 110877 time to create 1 rle with old method : 0.12491822242736816 length of segment : 388 time for calcul the mask position with numpy : 0.0009644031524658203 nb_pixel_total : 35867 time to create 1 rle with old method : 0.048619747161865234 length of segment : 207 time for calcul the mask position with numpy : 0.0028028488159179688 nb_pixel_total : 125949 time to create 1 rle with old method : 0.13976693153381348 length of segment : 618 time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 25207 time to create 1 rle with old method : 0.029124021530151367 length of segment : 232 time for calcul the mask position with numpy : 0.0012371540069580078 nb_pixel_total : 61237 time to create 1 rle with old method : 0.06992602348327637 length of segment : 227 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 20885 time to create 1 rle with old method : 0.031279802322387695 length of segment : 221 time for calcul the mask position with numpy : 0.0006837844848632812 nb_pixel_total : 31528 time to create 1 rle with old method : 0.03483915328979492 length of segment : 204 time for time to create 1 rle with old method : 0.014982461929321289 length of segment : 101 time for calcul the mask position with numpy : 0.0007884502410888672 nb_pixel_total : 51597 time to create 1 rle with old method : 0.0560145378112793 length of segment : 330 time for calcul the mask position with numpy : 0.0020220279693603516 nb_pixel_total : 48738 time to create 1 rle with old method : 0.05492830276489258 length of segment : 303 time for calcul the mask position with numpy : 0.0006024837493896484 nb_pixel_total : 17790 time to create 1 rle with old method : 0.021551132202148438 length of segment : 211 time for calcul the mask position with numpy : 0.0028138160705566406 nb_pixel_total : 69138 time to create 1 rle with old method : 0.0767052173614502 length of segment : 519 time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 29395 time to create 1 rle with old method : 0.0329279899597168 length of segment : 344 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 10414 time to create 1 rle with old method : 0.011943340301513672 length of segment : 109 time for calcul the mask position with numpy : 0.004323244094848633 nb_pixel_total : 66107 time to create 1 rle with old method : 0.07392382621765137 length of segment : 667 time for calcul the mask position with numpy : 0.0031061172485351562 nb_pixel_total : 52702 time to create 1 rle with old method : 0.05874323844909668 length of segment : 350 time for calcul the mask position with numpy : 0.0007669925689697266 nb_pixel_total : 15267 time to create 1 rle with old method : 0.018037080764770508 length of segment : 160 time for calcul the mask position with numpy : 0.0007915496826171875 nb_pixel_total : 14378 time to create 1 rle with old method : 0.016402482986450195 length of segment : 120 time for calcul the mask position with numpy : 0.0006115436553955078 nb_pixel_total : 11394 time to create 1 rle with old method : 0.013175487518310547 length of segment : 146 time for calcul the mask position with numpy : 0.0014693737030029297 nb_pixel_total : 23577 time to create 1 rle with old method : 0.027248144149780273 length of segment : 238 time for calcul the mask position with numpy : 0.0011870861053466797 nb_pixel_total : 22754 time to create 1 rle with old method : 0.0254364013671875 length of segment : 172 time for calcul the mask position with numpy : 0.001313924789428711 nb_pixel_total : 27603 time to create 1 rle with old method : 0.03138875961303711 length of segment : 220 time for calcul the mask position with numpy : 0.0008463859558105469 nb_pixel_total : 20108 time to create 1 rle with old method : 0.023194074630737305 length of segment : 164 time for calcul the mask position with numpy : 0.001069784164428711 nb_pixel_total : 17852 time to create 1 rle with old method : 0.02289271354675293 length of segment : 138 time for calcul the mask position with numpy : 0.001516580581665039 nb_pixel_total : 24884 time to create 1 rle with old method : 0.028584003448486328 length of segment : 219 time for calcul the mask position with numpy : 0.002521514892578125 nb_pixel_total : 44850 time to create 1 rle with old method : 0.06849408149719238 length of segment : 297 time for calcul the mask position with numpy : 0.0007929801940917969 nb_pixel_total : 16133 time to create 1 rle with old method : 0.018532276153564453 length of segment : 226 time for calcul the mask position with numpy : 0.0014948844909667969 nb_pixel_total : 30145 time to create 1 rle with old method : 0.03455471992492676 length of segment : 211 time for calcul the mask position with numpy : 0.0017027854919433594 nb_pixel_total : 45346 time to create 1 rle with old method : 0.05351376533508301 length of segment : 319 time for calcul the mask position with numpy : 0.0011327266693115234 nb_pixel_total : 31536 time to create 1 rle with old method : 0.035758018493652344 length of segment : 232 time for calcul the mask position with numpy : 0.0030226707458496094 nb_pixel_total : 85606 time to create 1 rle with old method : 0.09745383262634277 length of segment : 480 time for calcul the mask position with numpy : 0.0062389373779296875 nb_pixel_total : 140481 time to create 1 rle with old method : 0.1602954864501953 length of segment : 588 time for calcul the mask position with numpy : 0.0015437602996826172 nb_pixel_total : 48391 time to create 1 rle with old method : 0.05969095230102539 length of segment : 291 time for calcul the mask position with numpy : 0.002946615219116211 nb_pixel_total : 80951 time to create 1 rle with old method : 0.09728312492370605 length of segment : 559 time for calcul the mask position with numpy : 0.004906415939331055 nb_pixel_total : 164395 time to create 1 rle with new method : 0.010434389114379883 length of segment : 610 time for calcul the mask position with numpy : 0.0007352828979492188 nb_pixel_total : 29878 time to create 1 rle with old method : 0.03326129913330078 length of segment : 228 time for calcul the mask position with numpy : 0.0017254352569580078 nb_pixel_total : 43594 time to create 1 rle with old method : 0.0502626895904541 length of segment : 296 time for calcul the mask position with numpy : 0.0005252361297607422 nb_pixel_total : 10385 time to create 1 rle with old method : 0.011931419372558594 length of segment : 108 time for calcul the mask position with numpy : 0.0009207725524902344 nb_pixel_total : 23372 time to create 1 rle with old method : 0.02716207504272461 length of segment : 279 time for calcul the mask position with numpy : 0.003456592559814453 nb_pixel_total : 67812 time to create 1 rle with old method : 0.07607221603393555 length of segment : 610 time for calcul the mask position with numpy : 0.0009047985076904297 nb_pixel_total : 17244 time to create 1 rle with old method : 0.01989126205444336 length of segment : 261 time for calcul the mask position with numpy : 0.0014846324920654297 nb_pixel_total : 52543 time to create 1 rle with old method : 0.05826878547668457 length of segment : 460 time for calcul the mask position with numpy : 0.004492521286010742 nb_pixel_total : 138363 time to create 1 rle with old method : 0.15443038940429688 length of segment : 572 time for calcul the mask position with numpy : 0.00047469139099121094 nb_pixel_total : 17896 time to create 1 rle with old method : 0.02087569236755371 length of segment : 107 time for calcul the mask position with numpy : 0.0012238025665283203 nb_pixel_total : 24708 time to create 1 rle with old method : 0.028483867645263672 length of segment : 192 time for calcul the mask position with numpy : 0.0018007755279541016 nb_pixel_total : 34378 time to create 1 rle with old method : 0.04673624038696289 length of segment : 241 time for calcul the mask position with numpy : 0.0009624958038330078 nb_pixel_total : 10163 time to create 1 rle with old method : 0.016106128692626953 length of segment : 206 time for calcul the mask position with numpy : 0.0007112026214599609 nb_pixel_total : 13130 time to create 1 rle with old method : 0.015663862228393555 length of segment : 146 time for calcul the mask position with numpy : 0.002263784408569336 nb_pixel_total : 53451 time to create 1 rle with old method : 0.0616917610168457 length of segment : 257 time for calcul the mask position with numpy : 0.004982471466064453 nb_pixel_total : 126267 time to create 1 rle with old method : 0.14531397819519043 length of segment : 547 time for calcul the mask position with numpy : 0.0006773471832275391 nb_pixel_total : 13304 time to create 1 rle with old method : 0.015645265579223633 length of segment : 120 time for calcul the mask position with numpy : 0.0038018226623535156 nb_pixel_total : 102777 time to create 1 rle with old method : 0.11975646018981934 length of segment : 371 time for calcul the mask position with numpy : 0.0015864372253417969 nb_pixel_total : 26261 time to create 1 rle with old method : 0.029630422592163086 length of segment : 259 time for calcul the mask position with numpy : 0.0011794567108154297 nb_pixel_total : 36557 time to create 1 rle with old method : 0.04331374168395996 length of segment : 119 time for calcul the mask position with numpy : 0.0011668205261230469 nb_pixel_total : 23443 time to create 1 rle with old method : 0.026978254318237305 length of segment : 165 time for calcul the mask position with numpy : 0.0007784366607666016 nb_pixel_total : 21157 time to create 1 rle with old method : 0.024516820907592773 length of segment : 189 time for calcul the mask position with numpy : 0.001222372055053711 nb_pixel_total : 25187 time to create 1 rle with old method : 0.029232025146484375 length of segment : 172 time for calcul the mask position with numpy : 0.0031723976135253906 nb_pixel_total : 70666 time to create 1 rle with old method : 0.08005714416503906 length of segment : 524 time for calcul the mask position with numpy : 0.0032701492309570312 nb_pixel_total : 91441 time to create 1 rle with old method : 0.10245323181152344 length of segment : 492 time for calcul the mask position with numpy : 0.007481098175048828 nb_pixel_total : 218786 time to create 1 rle with new method : 0.013221263885498047 length of segment : 523 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 7077 time to create 1 rle with old method : 0.008210420608520508 length of segment : 121 time for calcul the mask position with numpy : 0.0010080337524414062 nb_pixel_total : 20916 time to create 1 rle with old method : 0.024448156356811523 length of segment : 161 time for calcul the mask position with numpy : 0.0034227371215820312 nb_pixel_total : 55974 time to create 1 rle with old method : 0.06148648262023926 length of segment : 633 time for calcul the mask position with numpy : 0.002063751220703125 nb_pixel_total : 36132 time to create 1 rle with old method : 0.042061567306518555 length of segment : 378 time for calcul the mask position with numpy : 0.0032186508178710938 nb_pixel_total : 86973 time to create 1 rle with old method : 0.1016232967376709 length of segment : 442 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 13345 time to create 1 rle with old method : 0.014812946319580078 length of segment : 149 time for calcul the mask position with numpy : 0.0019481182098388672 nb_pixel_total : 60429 time to create 1 rle with old method : 0.07006978988647461 length of segment : 326 time for calcul the mask position with numpy : 0.0036504268646240234 nb_pixel_total : 87096 time to create 1 rle with old method : 0.10977745056152344 length of segment : 458 time for calcul the mask position with numpy : 0.0003001689910888672 nb_pixel_total : 7689 time to create 1 rle with old method : 0.009005069732666016 length of segment : 87 time for calcul the mask position with numpy : 0.009414196014404297 nb_pixel_total : 199592 time to create 1 rle with new method : 0.044246673583984375 length of segment : 640 time for calcul the mask position with numpy : 0.002527475357055664 nb_pixel_total : 80646 time to create 1 rle with old method : 0.08877229690551758 length of segment : 290 time for calcul the mask position with numpy : 0.0033397674560546875 nb_pixel_total : 81974 time to create 1 rle with old method : 0.09386897087097168 length of segment : 521 time for calcul the mask position with numpy : 0.010787487030029297 nb_pixel_total : 269227 time to create 1 rle with new method : 0.015757322311401367 length of segment : 506 time for calcul the mask position with numpy : 0.000736236572265625 nb_pixel_total : 22330 time to create 1 rle with old method : 0.03287148475646973 length of segment : 160 time for calcul the mask position with numpy : 0.0006978511810302734 nb_pixel_total : 34463 time to create 1 rle with old method : 0.04095578193664551 length of segment : 260 time for calcul the mask position with numpy : 0.0013275146484375 nb_pixel_total : 39132 time to create 1 rle with old method : 0.04367828369140625 length of segment : 350 time for calcul the mask position with numpy : 0.0017688274383544922 nb_pixel_total : 46848 time to create 1 rle with old method : 0.05196380615234375 length of segment : 497 time for calcul the mask position with numpy : 0.0004630088806152344 nb_pixel_total : 11922 time to create 1 rle with old method : 0.01368856430053711 length of segment : 82 time for calcul the mask position with numpy : 0.0009315013885498047 nb_pixel_total : 27320 time to create 1 rle with old method : 0.03034210205078125 length of segment : 162 time for calcul the mask position with numpy : 0.0011467933654785156 nb_pixel_total : 21187 time to create 1 rle with old method : 0.024271249771118164 length of segment : 268 time for calcul the mask position with numpy : 0.00537109375 nb_pixel_total : 160452 time to create 1 rle with new method : 0.009550333023071289 length of segment : 544 time for calcul the mask position with numpy : 0.0019659996032714844 nb_pixel_total : 41919 time to create 1 rle with old method : 0.04578661918640137 length of segment : 291 time for calcul the mask position with numpy : 0.0014307498931884766 nb_pixel_total : 28157 time to create 1 rle with old method : 0.032471418380737305 length of segment : 144 time for calcul the mask position with numpy : 0.0002663135528564453 nb_pixel_total : 9221 time to create 1 rle with old method : 0.010620355606079102 length of segment : 106 time for calcul the mask position with numpy : 0.00805974006652832 nb_pixel_total : 220383 time to create 1 rle with new method : 0.015500068664550781 length of segment : 576 time for calcul the mask position with numpy : 0.0007588863372802734 nb_pixel_total : 14815 time to create 1 rle with old method : 0.018363475799560547 length of segment : 159 time for calcul the mask position with numpy : 0.003226041793823242 nb_pixel_total : 35949 time to create 1 rle with old method : 0.05463075637817383 length of segment : 276 time for calcul the mask position with numpy : 0.0037336349487304688 nb_pixel_total : 92294 time to create 1 rle with old method : 0.10040521621704102 length of segment : 404 time for calcul the mask position with numpy : 0.0005214214324951172 nb_pixel_total : 13659 time to create 1 rle with old method : 0.01499032974243164 length of segment : 112 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 10726 time to create 1 rle with old method : 0.012366056442260742 length of segment : 172 time for calcul the mask position with numpy : 0.004292726516723633 nb_pixel_total : 88100 time to create 1 rle with old method : 0.09959268569946289 length of segment : 467 time for calcul the mask position with numpy : 0.0008738040924072266 nb_pixel_total : 16968 time to create 1 rle with old method : 0.019483327865600586 length of segment : 160 time for calcul the mask position with numpy : 0.003157377243041992 nb_pixel_total : 61387 time to create 1 rle with old method : 0.06981348991394043 length of segment : 378 time for calcul the mask position with numpy : 0.0021681785583496094 nb_pixel_total : 40768 time to create 1 rle with old method : 0.04558086395263672 length of segment : 207 time for calcul the mask position with numpy : 0.0012624263763427734 nb_pixel_total : 32475 time to create 1 rle with old method : 0.03735923767089844 length of segment : 129 time for calcul the mask position with numpy : 0.00803518295288086 nb_pixel_total : 178652 time to create 1 rle with new method : 0.015068292617797852 length of segment : 610 time for calcul the mask position with numpy : 0.003717660903930664 nb_pixel_total : 87119 time to create 1 rle with old method : 0.09663105010986328 length of segment : 566 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 6898 time to create 1 rle with old method : 0.008553028106689453 length of segment : 83 time spent for convertir_results : 12.50156855583191 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 131 chid ids of type : 3594 Number RLEs to save : 40952 save missing photos in datou_result : time spend for datou_step_exec : 82.8007082939148 time spend to save output : 2.3269541263580322 total time spend for step 1 : 85.12766242027283 step2:crop_condition Fri May 16 19:51:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 131 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 72 About to insert : list_path_to_insert length 72 new photo from crops ! About to upload 72 photos upload in portfolio : 3736932 init cache_photo without model_param we have 72 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417931_1408051 we have uploaded 72 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.419827938079834 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417955_1408051 we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.504249334335327 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417961_1408051 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5341813564300537 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3736932 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417977_1408051 we have uploaded 31 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.045406579971313 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417988_1408051 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.7055060863494873 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747417994_1408051 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1366949081420898 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359022346, 1359022330, 1359022317, 1359022311, 1359022300, 1359022296, 1359022266, 1359022249] Looping around the photos to save general results len do output : 131 /1359043909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359043999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359044105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022346', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022330', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022317', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022311', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022300', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022296', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022266', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022249', None, None, None, None, None, '2883777') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 401 time used for this insertion : 0.02747035026550293 save_final save missing photos in datou_result : time spend for datou_step_exec : 79.82537794113159 time spend to save output : 0.03197216987609863 total time spend for step 2 : 79.85735011100769 step3:rle_unique_nms_with_priority Fri May 16 19:53:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 131 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 7.241993188858032 time for calcul the mask position with numpy : 0.5607473850250244 nb_pixel_total : 7010942 time to create 1 rle with new method : 1.303720235824585 time for calcul the mask position with numpy : 0.026133298873901367 nb_pixel_total : 97359 time to create 1 rle with old method : 0.10782361030578613 time for calcul the mask position with numpy : 0.028592586517333984 nb_pixel_total : 92270 time to create 1 rle with old method : 0.10543942451477051 time for calcul the mask position with numpy : 0.025443315505981445 nb_pixel_total : 50009 time to create 1 rle with old method : 0.055048465728759766 time for calcul the mask position with numpy : 0.025583505630493164 nb_pixel_total : 33621 time to create 1 rle with old method : 0.03724503517150879 time for calcul the mask position with numpy : 0.026998281478881836 nb_pixel_total : 24645 time to create 1 rle with old method : 0.028157949447631836 time for calcul the mask position with numpy : 0.027637243270874023 nb_pixel_total : 31463 time to create 1 rle with old method : 0.034934282302856445 time for calcul the mask position with numpy : 0.025892257690429688 nb_pixel_total : 20885 time to create 1 rle with old method : 0.024946928024291992 time for calcul the mask position with numpy : 0.02788853645324707 nb_pixel_total : 61237 time to create 1 rle with old method : 0.07677030563354492 time for calcul the mask position with numpy : 0.03031468391418457 nb_pixel_total : 25207 time to create 1 rle with old method : 0.03360271453857422 time for calcul the mask position with numpy : 0.03286314010620117 nb_pixel_total : 125949 time to create 1 rle with old method : 0.13451147079467773 time for calcul the mask position with numpy : 0.024538516998291016 nb_pixel_total : 35867 time to create 1 rle with old method : 0.0386655330657959 time for calcul the mask position with numpy : 0.024616003036499023 nb_pixel_total : 110877 time to create 1 rle with old method : 0.12013077735900879 time for calcul the mask position with numpy : 0.026561498641967773 nb_pixel_total : 238987 time to create 1 rle with new method : 1.3525309562683105 time for calcul the mask position with numpy : 0.026412010192871094 nb_pixel_total : 114229 time to create 1 rle with old method : 0.12527871131896973 time for calcul the mask position with numpy : 0.026915550231933594 nb_pixel_total : 113291 time to create 1 rle with old method : 0.12586426734924316 time for calcul the mask position with numpy : 0.02639484405517578 nb_pixel_total : 107562 time to create 1 rle with old method : 0.12193560600280762 create new chi : 4.882648468017578 time to delete rle : 0.01919698715209961 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13841 TO DO : save crop sub photo not yet done ! save time : 0.8134396076202393 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 6.210015058517456 time for calcul the mask position with numpy : 1.5551872253417969 nb_pixel_total : 7367297 time to create 1 rle with new method : 2.0776124000549316 time for calcul the mask position with numpy : 0.029257774353027344 nb_pixel_total : 8915 time to create 1 rle with old method : 0.01093602180480957 time for calcul the mask position with numpy : 0.04479169845581055 nb_pixel_total : 207980 time to create 1 rle with new method : 0.9493882656097412 time for calcul the mask position with numpy : 0.042344093322753906 nb_pixel_total : 39518 time to create 1 rle with old method : 0.0434567928314209 time for calcul the mask position with numpy : 0.040689706802368164 nb_pixel_total : 130079 time to create 1 rle with old method : 0.14656472206115723 time for calcul the mask position with numpy : 0.04788517951965332 nb_pixel_total : 313987 time to create 1 rle with new method : 0.4190990924835205 time for calcul the mask position with numpy : 0.040122270584106445 nb_pixel_total : 39076 time to create 1 rle with old method : 0.042342424392700195 time for calcul the mask position with numpy : 0.040952205657958984 nb_pixel_total : 71694 time to create 1 rle with old method : 0.07881283760070801 time for calcul the mask position with numpy : 0.04278850555419922 nb_pixel_total : 47727 time to create 1 rle with old method : 0.05309605598449707 time for calcul the mask position with numpy : 0.0423126220703125 nb_pixel_total : 39602 time to create 1 rle with old method : 0.04529094696044922 time for calcul the mask position with numpy : 0.04198479652404785 nb_pixel_total : 28525 time to create 1 rle with old method : 0.03376960754394531 create new chi : 5.973855257034302 time to delete rle : 0.0026428699493408203 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 11005 TO DO : save crop sub photo not yet done ! save time : 0.6635925769805908 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 9.810106754302979 time for calcul the mask position with numpy : 0.7663531303405762 nb_pixel_total : 7730556 time to create 1 rle with new method : 1.0665788650512695 time for calcul the mask position with numpy : 0.0402369499206543 nb_pixel_total : 66107 time to create 1 rle with old method : 0.07094955444335938 time for calcul the mask position with numpy : 0.03949618339538574 nb_pixel_total : 10414 time to create 1 rle with old method : 0.01132822036743164 time for calcul the mask position with numpy : 0.03978586196899414 nb_pixel_total : 29395 time to create 1 rle with old method : 0.030963897705078125 time for calcul the mask position with numpy : 0.03908395767211914 nb_pixel_total : 68477 time to create 1 rle with old method : 0.07346391677856445 time for calcul the mask position with numpy : 0.03902840614318848 nb_pixel_total : 17790 time to create 1 rle with old method : 0.018909215927124023 time for calcul the mask position with numpy : 0.039215087890625 nb_pixel_total : 48738 time to create 1 rle with old method : 0.05357694625854492 time for calcul the mask position with numpy : 0.04066586494445801 nb_pixel_total : 51597 time to create 1 rle with old method : 0.05474233627319336 time for calcul the mask position with numpy : 0.04137110710144043 nb_pixel_total : 13225 time to create 1 rle with old method : 0.014513969421386719 time for calcul the mask position with numpy : 0.03963637351989746 nb_pixel_total : 22429 time to create 1 rle with old method : 0.023684263229370117 time for calcul the mask position with numpy : 0.039702415466308594 nb_pixel_total : 6149 time to create 1 rle with old method : 0.006769418716430664 time for calcul the mask position with numpy : 0.03727412223815918 nb_pixel_total : 14550 time to create 1 rle with old method : 0.016175508499145508 time for calcul the mask position with numpy : 0.0256197452545166 nb_pixel_total : 9076 time to create 1 rle with old method : 0.009964227676391602 time for calcul the mask position with numpy : 0.024953126907348633 nb_pixel_total : 8114 time to create 1 rle with old method : 0.009072303771972656 time for calcul the mask position with numpy : 0.02657628059387207 nb_pixel_total : 23540 time to create 1 rle with old method : 0.02577829360961914 time for calcul the mask position with numpy : 0.029033899307250977 nb_pixel_total : 8735 time to create 1 rle with old method : 0.009827136993408203 time for calcul the mask position with numpy : 0.0276641845703125 nb_pixel_total : 46409 time to create 1 rle with old method : 0.06605768203735352 time for calcul the mask position with numpy : 0.028336524963378906 nb_pixel_total : 12594 time to create 1 rle with old method : 0.020603418350219727 time for calcul the mask position with numpy : 0.02814006805419922 nb_pixel_total : 19719 time to create 1 rle with old method : 0.021267175674438477 time for calcul the mask position with numpy : 0.023201465606689453 nb_pixel_total : 13998 time to create 1 rle with old method : 0.01480245590209961 time for calcul the mask position with numpy : 0.02388596534729004 nb_pixel_total : 27281 time to create 1 rle with old method : 0.02868175506591797 time for calcul the mask position with numpy : 0.02455592155456543 nb_pixel_total : 21772 time to create 1 rle with old method : 0.02436089515686035 time for calcul the mask position with numpy : 0.0252535343170166 nb_pixel_total : 23735 time to create 1 rle with old method : 0.02676677703857422 create new chi : 3.231938362121582 time to delete rle : 0.0021209716796875 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 12099 TO DO : save crop sub photo not yet done ! save time : 0.7988259792327881 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 6.521545886993408 time for calcul the mask position with numpy : 1.4345006942749023 nb_pixel_total : 7972753 time to create 1 rle with new method : 1.431441307067871 time for calcul the mask position with numpy : 0.04466414451599121 nb_pixel_total : 30145 time to create 1 rle with old method : 0.04866647720336914 time for calcul the mask position with numpy : 0.04416251182556152 nb_pixel_total : 16133 time to create 1 rle with old method : 0.018075942993164062 time for calcul the mask position with numpy : 0.04157662391662598 nb_pixel_total : 44850 time to create 1 rle with old method : 0.050286054611206055 time for calcul the mask position with numpy : 0.03822827339172363 nb_pixel_total : 24884 time to create 1 rle with old method : 0.02810502052307129 time for calcul the mask position with numpy : 0.037109375 nb_pixel_total : 17852 time to create 1 rle with old method : 0.020313739776611328 time for calcul the mask position with numpy : 0.026606082916259766 nb_pixel_total : 20108 time to create 1 rle with old method : 0.02250051498413086 time for calcul the mask position with numpy : 0.02744579315185547 nb_pixel_total : 27603 time to create 1 rle with old method : 0.030797243118286133 time for calcul the mask position with numpy : 0.025922298431396484 nb_pixel_total : 22754 time to create 1 rle with old method : 0.02534198760986328 time for calcul the mask position with numpy : 0.025865554809570312 nb_pixel_total : 23577 time to create 1 rle with old method : 0.02659463882446289 time for calcul the mask position with numpy : 0.024668216705322266 nb_pixel_total : 11394 time to create 1 rle with old method : 0.012938499450683594 time for calcul the mask position with numpy : 0.02593374252319336 nb_pixel_total : 14378 time to create 1 rle with old method : 0.016274213790893555 time for calcul the mask position with numpy : 0.026408672332763672 nb_pixel_total : 15267 time to create 1 rle with old method : 0.017197608947753906 time for calcul the mask position with numpy : 0.02602863311767578 nb_pixel_total : 52702 time to create 1 rle with old method : 0.06125783920288086 create new chi : 3.704557418823242 time to delete rle : 0.0011191368103027344 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 7474 TO DO : save crop sub photo not yet done ! save time : 0.4916512966156006 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 8.688817024230957 time for calcul the mask position with numpy : 0.8101916313171387 nb_pixel_total : 7302530 time to create 1 rle with new method : 0.6124403476715088 time for calcul the mask position with numpy : 0.03110504150390625 nb_pixel_total : 11973 time to create 1 rle with old method : 0.014637947082519531 time for calcul the mask position with numpy : 0.026464223861694336 nb_pixel_total : 138363 time to create 1 rle with old method : 0.15405917167663574 time for calcul the mask position with numpy : 0.025736093521118164 nb_pixel_total : 52543 time to create 1 rle with old method : 0.058068275451660156 time for calcul the mask position with numpy : 0.02684497833251953 nb_pixel_total : 17244 time to create 1 rle with old method : 0.020125389099121094 time for calcul the mask position with numpy : 0.025746822357177734 nb_pixel_total : 67812 time to create 1 rle with old method : 0.08267879486083984 time for calcul the mask position with numpy : 0.024786710739135742 nb_pixel_total : 23372 time to create 1 rle with old method : 0.02518177032470703 time for calcul the mask position with numpy : 0.024959564208984375 nb_pixel_total : 10385 time to create 1 rle with old method : 0.011049509048461914 time for calcul the mask position with numpy : 0.02495288848876953 nb_pixel_total : 43594 time to create 1 rle with old method : 0.04623126983642578 time for calcul the mask position with numpy : 0.02472829818725586 nb_pixel_total : 29878 time to create 1 rle with old method : 0.03223729133605957 time for calcul the mask position with numpy : 0.02593207359313965 nb_pixel_total : 164395 time to create 1 rle with new method : 0.9625065326690674 time for calcul the mask position with numpy : 0.02492237091064453 nb_pixel_total : 80951 time to create 1 rle with old method : 0.08274173736572266 time for calcul the mask position with numpy : 0.02397608757019043 nb_pixel_total : 48391 time to create 1 rle with old method : 0.05157828330993652 time for calcul the mask position with numpy : 0.02565598487854004 nb_pixel_total : 140481 time to create 1 rle with old method : 0.15360713005065918 time for calcul the mask position with numpy : 0.025432825088500977 nb_pixel_total : 85606 time to create 1 rle with old method : 0.08955025672912598 time for calcul the mask position with numpy : 0.023702144622802734 nb_pixel_total : 31536 time to create 1 rle with old method : 0.034002065658569336 time for calcul the mask position with numpy : 0.024607181549072266 nb_pixel_total : 45346 time to create 1 rle with old method : 0.04897427558898926 create new chi : 3.772294044494629 time to delete rle : 0.0020940303802490234 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 14137 TO DO : save crop sub photo not yet done ! save time : 0.8377895355224609 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 8.645309925079346 time for calcul the mask position with numpy : 0.8779304027557373 nb_pixel_total : 7408583 time to create 1 rle with new method : 1.0635676383972168 time for calcul the mask position with numpy : 0.03935813903808594 nb_pixel_total : 7077 time to create 1 rle with old method : 0.008053064346313477 time for calcul the mask position with numpy : 0.041828155517578125 nb_pixel_total : 218786 time to create 1 rle with new method : 1.2175860404968262 time for calcul the mask position with numpy : 0.039810895919799805 nb_pixel_total : 90256 time to create 1 rle with old method : 0.09393787384033203 time for calcul the mask position with numpy : 0.03800010681152344 nb_pixel_total : 58915 time to create 1 rle with old method : 0.061285972595214844 time for calcul the mask position with numpy : 0.03774738311767578 nb_pixel_total : 25187 time to create 1 rle with old method : 0.03115701675415039 time for calcul the mask position with numpy : 0.038912296295166016 nb_pixel_total : 21157 time to create 1 rle with old method : 0.023244142532348633 time for calcul the mask position with numpy : 0.03854179382324219 nb_pixel_total : 23443 time to create 1 rle with old method : 0.02562689781188965 time for calcul the mask position with numpy : 0.04579901695251465 nb_pixel_total : 36557 time to create 1 rle with old method : 0.05220842361450195 time for calcul the mask position with numpy : 0.0376284122467041 nb_pixel_total : 26261 time to create 1 rle with old method : 0.027862548828125 time for calcul the mask position with numpy : 0.04138994216918945 nb_pixel_total : 102777 time to create 1 rle with old method : 0.11034584045410156 time for calcul the mask position with numpy : 0.030853986740112305 nb_pixel_total : 13304 time to create 1 rle with old method : 0.014578580856323242 time for calcul the mask position with numpy : 0.04014182090759277 nb_pixel_total : 126267 time to create 1 rle with old method : 0.14243602752685547 time for calcul the mask position with numpy : 0.0401151180267334 nb_pixel_total : 53451 time to create 1 rle with old method : 0.05875134468078613 time for calcul the mask position with numpy : 0.040311574935913086 nb_pixel_total : 13130 time to create 1 rle with old method : 0.014438629150390625 time for calcul the mask position with numpy : 0.03959178924560547 nb_pixel_total : 10163 time to create 1 rle with old method : 0.01127004623413086 time for calcul the mask position with numpy : 0.040517568588256836 nb_pixel_total : 34378 time to create 1 rle with old method : 0.037873029708862305 time for calcul the mask position with numpy : 0.041956424713134766 nb_pixel_total : 24708 time to create 1 rle with old method : 0.031028032302856445 create new chi : 4.650026321411133 time to delete rle : 0.002539396286010742 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 11340 TO DO : save crop sub photo not yet done ! save time : 0.6930699348449707 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 9.242545366287231 time for calcul the mask position with numpy : 0.6539297103881836 nb_pixel_total : 6935868 time to create 1 rle with new method : 1.5249567031860352 time for calcul the mask position with numpy : 0.03604888916015625 nb_pixel_total : 160452 time to create 1 rle with new method : 0.9296519756317139 time for calcul the mask position with numpy : 0.036051034927368164 nb_pixel_total : 21187 time to create 1 rle with old method : 0.024149179458618164 time for calcul the mask position with numpy : 0.03672218322753906 nb_pixel_total : 27320 time to create 1 rle with old method : 0.029781579971313477 time for calcul the mask position with numpy : 0.03578066825866699 nb_pixel_total : 10401 time to create 1 rle with old method : 0.011458396911621094 time for calcul the mask position with numpy : 0.03289508819580078 nb_pixel_total : 43254 time to create 1 rle with old method : 0.04851341247558594 time for calcul the mask position with numpy : 0.025633573532104492 nb_pixel_total : 39132 time to create 1 rle with old method : 0.04282402992248535 time for calcul the mask position with numpy : 0.024869203567504883 nb_pixel_total : 34463 time to create 1 rle with old method : 0.03607797622680664 time for calcul the mask position with numpy : 0.024676084518432617 nb_pixel_total : 22330 time to create 1 rle with old method : 0.024271488189697266 time for calcul the mask position with numpy : 0.02746891975402832 nb_pixel_total : 269227 time to create 1 rle with new method : 0.9114105701446533 time for calcul the mask position with numpy : 0.027783632278442383 nb_pixel_total : 81974 time to create 1 rle with old method : 0.09193944931030273 time for calcul the mask position with numpy : 0.026654958724975586 nb_pixel_total : 80646 time to create 1 rle with old method : 0.08945369720458984 time for calcul the mask position with numpy : 0.026529550552368164 nb_pixel_total : 199592 time to create 1 rle with new method : 0.7985122203826904 time for calcul the mask position with numpy : 0.0243985652923584 nb_pixel_total : 7689 time to create 1 rle with old method : 0.007863521575927734 time for calcul the mask position with numpy : 0.022975444793701172 nb_pixel_total : 87096 time to create 1 rle with old method : 0.09039807319641113 time for calcul the mask position with numpy : 0.02705836296081543 nb_pixel_total : 60429 time to create 1 rle with old method : 0.06197667121887207 time for calcul the mask position with numpy : 0.023076772689819336 nb_pixel_total : 13345 time to create 1 rle with old method : 0.013373136520385742 time for calcul the mask position with numpy : 0.03748893737792969 nb_pixel_total : 86973 time to create 1 rle with old method : 0.08978104591369629 time for calcul the mask position with numpy : 0.038469552993774414 nb_pixel_total : 36132 time to create 1 rle with old method : 0.03830766677856445 time for calcul the mask position with numpy : 0.0384063720703125 nb_pixel_total : 55974 time to create 1 rle with old method : 0.05976676940917969 time for calcul the mask position with numpy : 0.037755489349365234 nb_pixel_total : 20916 time to create 1 rle with old method : 0.022095441818237305 create new chi : 6.339026212692261 time to delete rle : 0.002309083938598633 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 15734 TO DO : save crop sub photo not yet done ! save time : 0.9706535339355469 nb_obj : 17 nb_hashtags : 5 time to prepare the origin masks : 7.995925664901733 time for calcul the mask position with numpy : 0.8130786418914795 nb_pixel_total : 7314994 time to create 1 rle with new method : 1.0984923839569092 time for calcul the mask position with numpy : 0.02481532096862793 nb_pixel_total : 6898 time to create 1 rle with old method : 0.007791996002197266 time for calcul the mask position with numpy : 0.027374744415283203 nb_pixel_total : 87119 time to create 1 rle with old method : 0.09692144393920898 time for calcul the mask position with numpy : 0.02687692642211914 nb_pixel_total : 178652 time to create 1 rle with new method : 0.7802836894989014 time for calcul the mask position with numpy : 0.025281906127929688 nb_pixel_total : 32475 time to create 1 rle with old method : 0.034960031509399414 time for calcul the mask position with numpy : 0.0254056453704834 nb_pixel_total : 40684 time to create 1 rle with old method : 0.043088436126708984 time for calcul the mask position with numpy : 0.025134801864624023 nb_pixel_total : 61387 time to create 1 rle with old method : 0.06648468971252441 time for calcul the mask position with numpy : 0.023694515228271484 nb_pixel_total : 16968 time to create 1 rle with old method : 0.018437623977661133 time for calcul the mask position with numpy : 0.025534629821777344 nb_pixel_total : 88100 time to create 1 rle with old method : 0.0942082405090332 time for calcul the mask position with numpy : 0.025844335556030273 nb_pixel_total : 10726 time to create 1 rle with old method : 0.011907100677490234 time for calcul the mask position with numpy : 0.025896787643432617 nb_pixel_total : 13659 time to create 1 rle with old method : 0.01505279541015625 time for calcul the mask position with numpy : 0.02997612953186035 nb_pixel_total : 92294 time to create 1 rle with old method : 0.10152482986450195 time for calcul the mask position with numpy : 0.026396751403808594 nb_pixel_total : 35949 time to create 1 rle with old method : 0.03893327713012695 time for calcul the mask position with numpy : 0.02454662322998047 nb_pixel_total : 14815 time to create 1 rle with old method : 0.0160214900970459 time for calcul the mask position with numpy : 0.025396347045898438 nb_pixel_total : 220383 time to create 1 rle with new method : 0.7955222129821777 time for calcul the mask position with numpy : 0.028546810150146484 nb_pixel_total : 9221 time to create 1 rle with old method : 0.010653257369995117 time for calcul the mask position with numpy : 0.02554941177368164 nb_pixel_total : 28157 time to create 1 rle with old method : 0.03057861328125 time for calcul the mask position with numpy : 0.03953266143798828 nb_pixel_total : 41919 time to create 1 rle with old method : 0.04544329643249512 create new chi : 4.676219701766968 time to delete rle : 0.0018453598022460938 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 11830 TO DO : save crop sub photo not yet done ! save time : 0.7066526412963867 map_output_result : {1359022346: (0.0, 'Should be the crop_list due to order', 0), 1359022330: (0.0, 'Should be the crop_list due to order', 0), 1359022317: (0.0, 'Should be the crop_list due to order', 0), 1359022311: (0.0, 'Should be the crop_list due to order', 0), 1359022300: (0.0, 'Should be the crop_list due to order', 0), 1359022296: (0.0, 'Should be the crop_list due to order', 0), 1359022266: (0.0, 'Should be the crop_list due to order', 0), 1359022249: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359022346, 1359022330, 1359022317, 1359022311, 1359022300, 1359022296, 1359022266, 1359022249] Looping around the photos to save general results len do output : 8 /1359022346.Didn't retrieve data . /1359022330.Didn't retrieve data . /1359022317.Didn't retrieve data . /1359022311.Didn't retrieve data . /1359022300.Didn't retrieve data . /1359022296.Didn't retrieve data . /1359022266.Didn't retrieve data . /1359022249.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022346', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022330', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022317', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022311', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022300', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022296', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022266', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022249', None, None, None, None, None, '2883777') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012050867080688477 save_final save missing photos in datou_result : time spend for datou_step_exec : 108.92617774009705 time spend to save output : 0.012452125549316406 total time spend for step 3 : 108.93862986564636 step4:ventilate_hashtags_in_portfolio Fri May 16 19:55:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23079427 get user id for portfolio 23079427 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079427 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','environnement','pet_fonce','flou','autre','pehd','background','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079427 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','environnement','pet_fonce','flou','autre','pehd','background','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079427 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','metal','environnement','pet_fonce','flou','autre','pehd','background','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23080480,23080481,23080482,23080484,23080485,23080486,23080488,23080489,23080490,23080491,23080493?tags=papier,carton,metal,environnement,pet_fonce,flou,autre,pehd,background,pet_clair,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359022346, 1359022330, 1359022317, 1359022311, 1359022300, 1359022296, 1359022266, 1359022249] Looping around the photos to save general results len do output : 1 /23079427. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022346', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022330', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022317', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022311', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022300', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022296', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022266', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022249', None, None, None, None, None, '2883777') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013482093811035156 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7646973133087158 time spend to save output : 0.013737916946411133 total time spend for step 4 : 0.778435230255127 step5:final Fri May 16 19:55:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359022346: ('0.11018996250482253',), 1359022330: ('0.11018996250482253',), 1359022317: ('0.11018996250482253',), 1359022311: ('0.11018996250482253',), 1359022300: ('0.11018996250482253',), 1359022296: ('0.11018996250482253',), 1359022266: ('0.11018996250482253',), 1359022249: ('0.11018996250482253',)} new output for save of step final : {1359022346: ('0.11018996250482253',), 1359022330: ('0.11018996250482253',), 1359022317: ('0.11018996250482253',), 1359022311: ('0.11018996250482253',), 1359022300: ('0.11018996250482253',), 1359022296: ('0.11018996250482253',), 1359022266: ('0.11018996250482253',), 1359022249: ('0.11018996250482253',)} [1359022346, 1359022330, 1359022317, 1359022311, 1359022300, 1359022296, 1359022266, 1359022249] Looping around the photos to save general results len do output : 8 /1359022346.Didn't retrieve data . /1359022330.Didn't retrieve data . /1359022317.Didn't retrieve data . /1359022311.Didn't retrieve data . /1359022300.Didn't retrieve data . /1359022296.Didn't retrieve data . /1359022266.Didn't retrieve data . /1359022249.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022346', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022330', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022317', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022311', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022300', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022296', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022266', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022249', None, None, None, None, None, '2883777') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012314319610595703 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11974358558654785 time spend to save output : 0.012996912002563477 total time spend for step 5 : 0.13274049758911133 step6:blur_detection Fri May 16 19:55:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a.jpg resize: (2160, 3840) 1359022346 -5.906176414289612 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e.jpg resize: (2160, 3840) 1359022330 -5.780313646831933 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88.jpg resize: (2160, 3840) 1359022317 -5.839832514885991 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290.jpg resize: (2160, 3840) 1359022311 -5.786097838636741 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7.jpg resize: (2160, 3840) 1359022300 -5.886638671476163 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1.jpg resize: (2160, 3840) 1359022296 -5.779040065785607 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417.jpg resize: (2160, 3840) 1359022266 -5.77300945882387 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6.jpg resize: (2160, 3840) 1359022249 -5.8591698555926985 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133708_0.png resize: (217, 220) 1359043909 -3.6674800028781895 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133705_0.png resize: (197, 122) 1359043910 -3.323284784762553 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133704_0.png resize: (213, 407) 1359043911 -3.9496450601826023 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133701_0.png resize: (205, 282) 1359043912 -3.860354377919394 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133718_0.png resize: (688, 285) 1359043913 -3.742877383531886 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133712_0.png resize: (184, 232) 1359043914 -3.168897587986476 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133715_0.png resize: (252, 417) 1359043915 -2.91998053442036 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133724_0.png resize: (281, 117) 1359043916 -3.7052888906737294 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133725_0.png resize: (126, 126) 1359043917 -0.006055245094984988 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133743_0.png resize: (419, 381) 1359043918 -3.6169420448806915 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133729_0.png resize: (149, 93) 1359043919 -3.9047879196875335 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133722_0.png resize: (166, 173) 1359043920 -2.86439154053017 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133739_0.png resize: (191, 135) 1359043921 -2.480081531712798 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133732_0.png resize: (102, 116) 1359043922 -2.3071756210492036 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133731_0.png resize: (83, 127) 1359043923 -3.7109098389326984 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133736_0.png resize: (99, 166) 1359043924 -1.0985581846934618 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133728_0.png resize: (238, 210) 1359043925 -0.4885076435622279 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133740_0.png resize: (360, 413) 1359043926 -2.1589447586573125 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133742_0.png resize: (108, 125) 1359043927 -2.973550702837841 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133730_0.png resize: (195, 143) 1359043928 -2.012477260866871 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133734_0.png resize: (76, 98) 1359043929 -1.1491345976164944 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133741_0.png resize: (318, 145) 1359043931 -3.629484125845273 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133727_0.png resize: (144, 102) 1359043932 -1.6312081211215095 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133735_0.png resize: (252, 153) 1359043933 -2.673522842474114 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133748_0.png resize: (231, 139) 1359043934 -3.1815090063685263 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133745_0.png resize: (159, 129) 1359043935 -1.4291209164190644 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133751_0.png resize: (161, 152) 1359043936 -2.7298067966783037 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133756_0.png resize: (147, 311) 1359043937 0.46467529228913157 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133746_0.png resize: (118, 164) 1359043938 -0.5341255917817217 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133755_0.png resize: (199, 120) 1359043939 -2.1518048254061295 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133753_0.png resize: (219, 166) 1359043940 -3.9453346173624624 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133769_0.png resize: (260, 89) 1359043941 -1.687142463462063 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133762_0.png resize: (497, 206) 1359043942 -3.947159284607829 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133765_0.png resize: (270, 327) 1359043943 -3.1780651169191634 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133770_0.png resize: (316, 228) 1359043944 -4.50567715625277 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133759_0.png resize: (469, 289) 1359043945 -2.220427651104137 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133760_0.png resize: (470, 455) 1359043946 -3.1187710262322286 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133757_0.png resize: (316, 208) 1359043947 -3.6758409389120286 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133758_0.png resize: (232, 178) 1359043948 -3.5242904734193226 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133764_0.png resize: (228, 169) 1359043949 -3.9237997510108316 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133785_0.png resize: (172, 212) 1359043950 -1.8802452056522896 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133784_0.png resize: (189, 136) 1359043952 -3.0553588948792356 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133781_0.png resize: (259, 154) 1359043953 -2.5810057910600146 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133782_0.png resize: (98, 434) 1359043954 -4.30495145715691 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133774_0.png resize: (241, 221) 1359043955 1.3255363838606509 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133773_0.png resize: (192, 195) 1359043956 -2.386668061411064 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133777_0.png resize: (257, 320) 1359043957 -3.9884364556917276 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133789_0.png resize: (121, 71) 1359043958 -1.3946754185729806 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133776_0.png resize: (146, 131) 1359043959 -2.5669991873755977 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133786_0.png resize: (499, 188) 1359043960 -3.3089354741620807 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133783_0.png resize: (165, 228) 1359043961 -3.16107406433212 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133787_0.png resize: (492, 285) 1359043962 -3.660422360766361 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133775_0.png resize: (173, 105) 1359043963 -3.6475233764186292 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133794_0.png resize: (149, 146) 1359043964 -2.3642163112638794 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133791_0.png resize: (506, 221) 1359043965 -3.249089354057187 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133804_0.png resize: (350, 167) 1359043966 -3.720038303721511 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133803_0.png resize: (260, 217) 1359043967 -0.9844391342249377 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133796_0.png resize: (431, 285) 1359043968 -3.53078645477921 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133792_0.png resize: (240, 279) 1359043969 -3.5976385091962864 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133802_0.png resize: (159, 169) 1359043970 0.8592374006893144 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133797_0.png resize: (85, 114) 1359043971 -2.590575672226058 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133809_0.png resize: (511, 404) 1359043972 -3.801430705348338 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133793_0.png resize: (436, 245) 1359043973 -2.9153153721770413 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133808_0.png resize: (253, 128) 1359043974 -3.655569269122422 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133811_0.png resize: (141, 347) 1359043975 -1.629606180222673 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133819_0.png resize: (406, 416) 1359043976 -2.817070915554304 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133823_0.png resize: (125, 367) 1359043977 -2.9463025794858098 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133814_0.png resize: (158, 138) 1359043978 -0.6201849008891276 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133810_0.png resize: (286, 241) 1359043979 -2.8970154031088606 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133812_0.png resize: (106, 120) 1359043980 -2.798172947708184 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133815_0.png resize: (275, 206) 1359043981 -1.555931293870481 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133824_0.png resize: (563, 466) 1359043982 -3.7728809305552677 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133703_0.png resize: (227, 165) 1359043988 -4.147759766762643 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133707_0.png resize: (161, 276) 1359043989 -3.588143222938036 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133699_0.png resize: (615, 620) 1359043990 -2.0567751846886875 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133721_0.png resize: (482, 581) 1359043991 -3.712054902086155 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133733_0.png resize: (350, 287) 1359043992 -2.5423667804101626 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133723_0.png resize: (184, 163) 1359043993 -1.473020773759237 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133738_0.png resize: (303, 265) 1359043994 -2.8462131869011666 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133726_0.png resize: (122, 203) 1359043995 -2.7215801472605317 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133750_0.png resize: (212, 202) 1359043996 -2.0920087953450097 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133754_0.png resize: (266, 265) 1359043997 -3.2742947717802457 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133744_0.png resize: (350, 332) 1359043998 -3.1065128850505173 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133772_0.png resize: (106, 293) 1359043999 -2.7944482619746984 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133805_0.png resize: (471, 234) 1359044000 -4.126151513431239 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133807_0.png resize: (162, 237) 1359044001 -3.6617032892703762 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133790_0.png resize: (161, 171) 1359044002 -3.428347061661807 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133795_0.png resize: (325, 208) 1359044003 -3.394395992792431 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133818_0.png resize: (171, 95) 1359044004 -2.1304061078096623 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133820_0.png resize: (160, 154) 1359044007 -3.0384567325106304 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133710_0.png resize: (523, 215) 1359044027 -3.9685949354084915 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133709_0.png resize: (284, 238) 1359044028 -4.507744070477772 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133698_0.png resize: (509, 377) 1359044029 -3.249073483227067 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133711_0.png resize: (375, 443) 1359044030 -4.056554106665467 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133700_0.png resize: (388, 372) 1359044031 -4.003770131157471 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133697_0.png resize: (569, 329) 1359044032 -3.065559514728129 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133696_0.png resize: (392, 378) 1359044033 -3.727882295650385 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133717_0.png resize: (982, 478) 1359044034 -4.521874648164951 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133714_0.png resize: (171, 335) 1359044035 -3.1446237281333556 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133719_0.png resize: (230, 279) 1359044036 -3.6835312245569414 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133716_0.png resize: (373, 266) 1359044037 -2.968756344139055 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133749_0.png resize: (136, 259) 1359044039 -2.275129727960943 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133767_0.png resize: (270, 124) 1359044040 -3.341056177988088 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133768_0.png resize: (546, 223) 1359044041 -4.059158355161361 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133761_0.png resize: (255, 268) 1359044042 -4.673212841198351 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133763_0.png resize: (556, 417) 1359044043 -4.312798540676088 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133771_0.png resize: (572, 315) 1359044044 -4.322068046875907 treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133766_0.png resize: (106, 137) 1359044045 -2.7571444299071186 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133788_0.png resize: (491, 520) 1359044046 -3.390154009323222 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133780_0.png resize: (368, 348) 1359044047 -3.6300437142566526 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133778_0.png resize: (547, 283) 1359044048 -4.428763594918074 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133801_0.png resize: (462, 864) 1359044049 -3.961864049890846 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133798_0.png resize: (523, 873) 1359044050 -2.105410075840694 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133806_0.png resize: (82, 193) 1359044051 -0.531857988126599 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133800_0.png resize: (322, 429) 1359044052 -1.4258507624340393 treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133799_0.png resize: (288, 374) 1359044053 -3.4024560614480905 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133813_0.png resize: (517, 532) 1359044054 -4.424566206037739 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133822_0.png resize: (207, 303) 1359044055 -4.287793459618079 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133821_0.png resize: (215, 550) 1359044056 -3.6579763942968504 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133816_0.png resize: (403, 316) 1359044057 -3.231153821123325 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133825_0.png resize: (560, 265) 1359044058 -3.927141350385081 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133720_0.png resize: (527, 519) 1359044095 -3.674227498411391 treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133713_0.png resize: (246, 185) 1359044096 -3.791882675181568 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133752_0.png resize: (126, 214) 1359044097 -4.346691181801707 treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133747_0.png resize: (145, 101) 1359044098 -2.7144885313814644 treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133779_0.png resize: (119, 146) 1359044099 0.7829341616595108 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133817_0.png resize: (112, 143) 1359044100 -2.5759459387553467 treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133826_0.png resize: (80, 109) 1359044101 -3.6294308215782376 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133706_0.png resize: (192, 196) 1359044103 -4.6424173733219485 treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133702_0.png resize: (617, 274) 1359044104 -5.4117743573678885 treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133737_0.png resize: (330, 179) 1359044105 -3.6095271361018235 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 139 time used for this insertion : 0.01815176010131836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 139 time used for this insertion : 0.026793241500854492 save missing photos in datou_result : time spend for datou_step_exec : 34.87709903717041 time spend to save output : 0.04996848106384277 total time spend for step 6 : 34.92706751823425 step7:brightness Fri May 16 19:55:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a.jpg treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e.jpg treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88.jpg treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290.jpg treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7.jpg treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1.jpg treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417.jpg treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6.jpg treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133708_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133705_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133704_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133701_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133718_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133712_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133715_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133724_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133725_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133743_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133729_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133722_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133739_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133732_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133731_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133736_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133728_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133740_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133742_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133730_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133734_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133741_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133727_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133735_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133748_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133745_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133751_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133756_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133746_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133755_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133753_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133769_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133762_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133765_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133770_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133759_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133760_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133757_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133758_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133764_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133785_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133784_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133781_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133782_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133774_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133773_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133777_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133789_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133776_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133786_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133783_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133787_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133775_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133794_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133791_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133804_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133803_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133796_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133792_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133802_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133797_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133809_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133793_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133808_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133811_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133819_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133823_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133814_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133810_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133812_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133815_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133824_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133703_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133707_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133699_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133721_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133733_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133723_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133738_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133726_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133750_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133754_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133744_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133772_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133805_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133807_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133790_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133795_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133818_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133820_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133710_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133709_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133698_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133711_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133700_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133697_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133696_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133717_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133714_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133719_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133716_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133749_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133767_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133768_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133761_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133763_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133771_0.png treat image : temp/1747417827_1408051_1359022300_6ac3cd0f3682f0236f0b0ea1623ad9d7_rle_crop_3802133766_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133788_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133780_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133778_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133801_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133798_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133806_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133800_0.png treat image : temp/1747417827_1408051_1359022266_97462cba9c5d045c83447162c8002417_rle_crop_3802133799_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133813_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133822_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133821_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133816_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133825_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133720_0.png treat image : temp/1747417827_1408051_1359022330_b461afd2079db3305fcc1389c6b42e1e_rle_crop_3802133713_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133752_0.png treat image : temp/1747417827_1408051_1359022311_b3b16fc41a4d9c8f5d66decc9b5ab290_rle_crop_3802133747_0.png treat image : temp/1747417827_1408051_1359022296_33395d25eb670ad50336830e26cc97b1_rle_crop_3802133779_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133817_0.png treat image : temp/1747417827_1408051_1359022249_85176763b56dfa2b932bde73c477e7c6_rle_crop_3802133826_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133706_0.png treat image : temp/1747417827_1408051_1359022346_9d57a16712f1a3112d8c7a118288c38a_rle_crop_3802133702_0.png treat image : temp/1747417827_1408051_1359022317_9bd4a1f587045a9544f443c172f00b88_rle_crop_3802133737_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 139 time used for this insertion : 0.017730712890625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 139 time used for this insertion : 0.02875494956970215 save missing photos in datou_result : time spend for datou_step_exec : 9.905765771865845 time spend to save output : 0.05118823051452637 total time spend for step 7 : 9.956954002380371 step8:velours_tree Fri May 16 19:55:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.16104888916015625 time spend to save output : 5.173683166503906e-05 total time spend for step 8 : 0.1611006259918213 step9:send_mail_cod Fri May 16 19:55:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23079427_16-05-2025_19_55_50.pdf 23080480 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230804801747418150 23080481 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230804811747418151 23080482 change filename to text .imagette230804821747418153 23080485 change filename to text .change filename to text .change filename to text .imagette230804851747418153 23080486 imagette230804861747418153 23080488 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230804881747418153 23080489 imagette230804891747418153 23080490 imagette230804901747418153 23080491 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230804911747418153 23080493 imagette230804931747418155 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23079427 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23080480,23080481,23080482,23080484,23080485,23080486,23080488,23080489,23080490,23080491,23080493?tags=papier,carton,metal,environnement,pet_fonce,flou,autre,pehd,background,pet_clair,mal_croppe args[1359022346] : ((1359022346, -5.906176414289612, 492609224), (1359022346, 0.4333284730602978, 2107752395), '0.11018996250482253') We are sending mail with results at report@fotonower.com args[1359022330] : ((1359022330, -5.780313646831933, 492609224), (1359022330, 0.6521172459337481, 2107752395), '0.11018996250482253') We are sending mail with results at report@fotonower.com args[1359022317] : ((1359022317, -5.839832514885991, 492609224), (1359022317, 0.49718751005702716, 2107752395), '0.11018996250482253') We are sending mail with results at report@fotonower.com args[1359022311] : ((1359022311, -5.786097838636741, 492609224), (1359022311, 0.523292127910154, 2107752395), '0.11018996250482253') We are sending mail with results at report@fotonower.com args[1359022300] : ((1359022300, -5.886638671476163, 492609224), (1359022300, 0.5630005775008495, 2107752395), '0.11018996250482253') We are sending mail with results at report@fotonower.com args[1359022296] : ((1359022296, -5.779040065785607, 492609224), (1359022296, 0.548741087845328, 2107752395), '0.11018996250482253') We are sending mail with results at report@fotonower.com args[1359022266] : ((1359022266, -5.77300945882387, 492609224), (1359022266, 0.6436656921419573, 2107752395), '0.11018996250482253') We are sending mail with results at report@fotonower.com args[1359022249] : ((1359022249, -5.8591698555926985, 492609224), (1359022249, 0.5744655219240579, 2107752395), '0.11018996250482253') We are sending mail with results at report@fotonower.com refus_total : 0.11018996250482253 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23079427 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079427_16-05-2025_19_55_50.pdf results_Auto_P23079427_16-05-2025_19_55_50.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079427_16-05-2025_19_55_50.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23079427','results_Auto_P23079427_16-05-2025_19_55_50.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079427_16-05-2025_19_55_50.pdf','pdf','','0.88','0.11018996250482253') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23079427

https://www.fotonower.com/image?json=false&list_photos_id=1359022346
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359022330
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359022317
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359022311
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359022300
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359022296
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359022266
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359022249
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.02%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23080480?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23080481?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23080482?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23080485?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23080488?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23080491?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079427_16-05-2025_19_55_50.pdf.

Lien vers velours :https://www.fotonower.com/velours/23080480,23080481,23080482,23080484,23080485,23080486,23080488,23080489,23080490,23080491,23080493?tags=papier,carton,metal,environnement,pet_fonce,flou,autre,pehd,background,pet_clair,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 16 May 2025 17:55:59 GMT Content-Length: 0 Connection: close X-Message-Id: iwxvpl2zTbiuPsDbQI6ANQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359022346, 1359022330, 1359022317, 1359022311, 1359022300, 1359022296, 1359022266, 1359022249] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022346', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022330', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022317', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022311', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022300', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022296', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022266', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022249', None, None, None, None, None, '2883777') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013160943984985352 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.687909364700317 time spend to save output : 0.013453006744384766 total time spend for step 9 : 9.701362371444702 step10:split_time_score Fri May 16 19:55:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16052025 23079427 Nombre de photos uploadées : 11 / 23040 (0%) 16052025 23079427 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 16052025 23079427 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005660057067871094 elapsed_time : insert_dashboard_record_day_entry 0.022303342819213867 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14881168016975313 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23052716_16-05-2025_08_52_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23052716 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23052716 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23052744 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23067225 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23067239 order by id desc limit 1 Qualite : 0.10353827080118315 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23071983_16-05-2025_16_52_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23071983 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23071983 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23073354 order by id desc limit 1 Qualite : 0.1697871024856702 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23073358_16-05-2025_17_35_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23073358 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23073358 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23075513 order by id desc limit 1 Qualite : 0.12602876639660496 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23075515_16-05-2025_18_22_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23075515 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23075515 AND mptpi.`type`=3594 To do Qualite : 0.11018996250482253 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079427_16-05-2025_19_55_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23079427 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079427 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23079432 order by id desc limit 1 Qualite : 0.14222299081307868 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23079435_16-05-2025_19_46_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23079435 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23079435 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359022346, 1359022330, 1359022317, 1359022311, 1359022300, 1359022296, 1359022266, 1359022249] Looping around the photos to save general results len do output : 1 /23079427Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022346', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022330', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022317', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022311', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022300', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022296', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022266', None, None, None, None, None, '2883777') ('3318', None, None, None, None, None, None, None, '2883777') ('3318', '23079427', '1359022249', None, None, None, None, None, '2883777') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013766050338745117 save_final save missing photos in datou_result : begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.011792659759521484 time spend for datou_step_exec : 5.966144800186157 time spend to save output : 0.02585005760192871 total time spend for step 10 : 5.991994857788086 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 140.99user 146.68system 5:41.23elapsed 84%CPU (0avgtext+0avgdata 5657776maxresident)k 614064inputs+140584outputs (7178major+15109014minor)pagefaults 0swaps