python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 31155 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2984688'] with mtr_portfolio_ids : ['23443373'] and first list_photo_ids : [] new path : /proc/31155/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.1986315250396729 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 29 22:00:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3439 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-29 22:00:34.956928: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-29 22:00:34.983101: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-29 22:00:34.985439: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbb4c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-29 22:00:34.985492: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-29 22:00:34.989621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-29 22:00:35.130041: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ef8de0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-29 22:00:35.130084: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-29 22:00:35.130882: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-29 22:00:35.131335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-29 22:00:35.134644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-29 22:00:35.137379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-29 22:00:35.138113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-29 22:00:35.141131: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-29 22:00:35.142496: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-29 22:00:35.147944: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-29 22:00:35.149175: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-29 22:00:35.149274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-29 22:00:35.149940: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-29 22:00:35.149959: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-29 22:00:35.149970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-29 22:00:35.151111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2987 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-29 22:00:35.493096: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-29 22:00:35.493184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-29 22:00:35.493206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-29 22:00:35.493225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-29 22:00:35.493244: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-29 22:00:35.493261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-29 22:00:35.493279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-29 22:00:35.493297: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-29 22:00:35.494385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-29 22:00:35.495589: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-29 22:00:35.495634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-29 22:00:35.495653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-29 22:00:35.495671: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-29 22:00:35.495687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-29 22:00:35.495704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-29 22:00:35.495722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-29 22:00:35.495740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-29 22:00:35.496740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-29 22:00:35.496787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-29 22:00:35.496798: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-29 22:00:35.496807: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-29 22:00:35.497874: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2987 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-29 22:00:45.460424: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-29 22:00:45.630190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-29 22:00:47.450619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.451228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.18G (2337472512 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.451268: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.451845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.451862: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.459073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.459105: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.459708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.459725: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.466394: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.466422: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.467048: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.467069: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.501386: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.501456: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.502031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.502047: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.510471: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.510495: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.511091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.511109: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-29 22:00:47.546332: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.546920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.548783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.549345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.595313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.596231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.598562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.599220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.631510: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.632460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.634263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.634913: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.641202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.642347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.644177: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.644780: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.651575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.652273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.654028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.654633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.688281: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.689177: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.690008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.690836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.694529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.695116: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.711108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.711730: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.712296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.712858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.725786: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.726391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.726959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.727521: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.731853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.732456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.737030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.737597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.749726: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.750299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.754466: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.755089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.755692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.756289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.757038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.757602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.768565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.769131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.769701: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.770256: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.770811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.771372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.786294: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.786873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.822852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.822935: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-29 22:00:47.823889: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.824837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.832147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.833115: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.834064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.834999: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.843761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.844731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.868239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.868882: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.869502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.870110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.874233: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.874844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.875463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.876096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.891030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.895776: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.896543: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.905969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.906746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.907569: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.908347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.909020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-29 22:00:47.909628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2597191680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 Detection mask done ! Trying to reset tf kernel 34550 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2181 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clength of segment : 175 time for calcul the mask position with numpy : 0.0007047653198242188 nb_pixel_total : 25893 time to create 1 rle with old method : 0.029063940048217773 length of segment : 185 time for calcul the mask position with numpy : 0.0058019161224365234 nb_pixel_total : 260395 time to create 1 rle with new method : 0.012262105941772461 length of segment : 803 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 6586 time to create 1 rle with old method : 0.008033037185668945 length of segment : 88 time for calcul the mask position with numpy : 0.002091646194458008 nb_pixel_total : 81787 time to create 1 rle with old method : 0.10233592987060547 length of segment : 240 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 7147 time to create 1 rle with old method : 0.008442401885986328 length of segment : 83 time for calcul the mask position with numpy : 0.0016350746154785156 nb_pixel_total : 56644 time to create 1 rle with old method : 0.06586933135986328 length of segment : 270 time for calcul the mask position with numpy : 0.0003886222839355469 nb_pixel_total : 8569 time to create 1 rle with old method : 0.010633230209350586 length of segment : 114 time for calcul the mask position with numpy : 0.0003561973571777344 nb_pixel_total : 6992 time to create 1 rle with old method : 0.008608102798461914 length of segment : 97 time for calcul the mask position with numpy : 0.0013566017150878906 nb_pixel_total : 46615 time to create 1 rle with old method : 0.051987648010253906 length of segment : 249 time for calcul the mask position with numpy : 0.0017578601837158203 nb_pixel_total : 73073 time to create 1 rle with old method : 0.08087396621704102 length of segment : 400 time for calcul the mask position with numpy : 0.0004191398620605469 nb_pixel_total : 10875 time to create 1 rle with old method : 0.012777328491210938 length of segment : 121 time for calcul the mask position with numpy : 0.0007257461547851562 nb_pixel_total : 27907 time to create 1 rle with old method : 0.031984567642211914 length of segment : 173 time for calcul the mask position with numpy : 0.0010859966278076172 nb_pixel_total : 29672 time to create 1 rle with old method : 0.0338740348815918 length of segment : 203 time for calcul the mask position with numpy : 0.0009548664093017578 nb_pixel_total : 26106 time to create 1 rle with old method : 0.03005695343017578 length of segment : 170 time for calcul the mask position with numpy : 0.00058746337890625 nb_pixel_total : 16966 time to create 1 rle with old method : 0.019959688186645508 length of segment : 105 time for calcul the mask position with numpy : 0.0009663105010986328 nb_pixel_total : 17649 time to create 1 rle with old method : 0.01998114585876465 length of segment : 216 time for calcul the mask position with numpy : 0.0005421638488769531 nb_pixel_total : 14595 time to create 1 rle with old method : 0.016267776489257812 length of segment : 116 time for calcul the mask position with numpy : 0.0009362697601318359 nb_pixel_total : 26319 time to create 1 rle with old method : 0.03278493881225586 length of segment : 152 time for calcul the mask position with numpy : 0.0005521774291992188 nb_pixel_total : 9688 time to create 1 rle with old method : 0.016118288040161133 length of segment : 123 time for calcul the mask position with numpy : 0.0003104209899902344 nb_pixel_total : 6218 time to create 1 rle with old method : 0.010303258895874023 length of segment : 117 time for calcul the mask position with numpy : 0.0023572444915771484 nb_pixel_total : 43136 time to create 1 rle with old method : 0.04960441589355469 length of segment : 492 time for calcul the mask position with numpy : 0.0006229877471923828 nb_pixel_total : 16220 time to create 1 rle with old method : 0.018786907196044922 length of segment : 228 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 3205 time to create 1 rle with old method : 0.003909587860107422 length of segment : 57 time for calcul the mask position with numpy : 0.0009319782257080078 nb_pixel_total : 33281 time to create 1 rle with old method : 0.03788399696350098 length of segment : 225 time for calcul the mask position with numpy : 0.0006377696990966797 nb_pixel_total : 11947 time to create 1 rle with old method : 0.014164924621582031 length of segment : 124 time for calcul the mask position with numpy : 0.0023784637451171875 nb_pixel_total : 58302 time to create 1 rle with old method : 0.06776571273803711 length of segment : 306 time for calcul the mask position with numpy : 0.0009613037109375 nb_pixel_total : 13427 time to create 1 rle with old method : 0.01695990562438965 length of segment : 141 time for calcul the mask position with numpy : 0.0016841888427734375 nb_pixel_total : 42035 time to create 1 rle with old method : 0.05047106742858887 length of segment : 193 time for calcul the mask position with numpy : 0.015153646469116211 nb_pixel_total : 466533 time to create 1 rle with new method : 0.041541099548339844 length of segment : 838 time for calcul the mask position with numpy : 0.0037178993225097656 nb_pixel_total : 118298 time to create 1 rle with old method : 0.13901901245117188 length of segment : 341 time for calcul the mask position with numpy : 0.0006897449493408203 nb_pixel_total : 17163 time to create 1 rle with old method : 0.01978015899658203 length of segment : 173 time for calcul the mask position with numpy : 0.0006563663482666016 nb_pixel_total : 12025 time to create 1 rle with old method : 0.01424098014831543 length of segment : 122 time for calcul the mask position with numpy : 0.01202392578125 nb_pixel_total : 208849 time to create 1 rle with new method : 0.034425973892211914 length of segment : 817 time for calcul the mask position with numpy : 0.0042476654052734375 nb_pixel_total : 152086 time to create 1 rle with new method : 0.007857322692871094 length of segment : 423 time for calcul the mask position with numpy : 0.0027055740356445312 nb_pixel_total : 73592 time to create 1 rle with old method : 0.08426785469055176 length of segment : 234 time for calcul the mask position with numpy : 0.0012309551239013672 nb_pixel_total : 27555 time to create 1 rle with old method : 0.031359195709228516 length of segment : 209 time for calcul the mask position with numpy : 0.0027599334716796875 nb_pixel_total : 78222 time to create 1 rle with old method : 0.08799266815185547 length of segment : 317 time for calcul the mask position with numpy : 0.0019488334655761719 nb_pixel_total : 48655 time to create 1 rle with old method : 0.0567011833190918 length of segment : 250 time for calcul the mask position with numpy : 0.0008318424224853516 nb_pixel_total : 18316 time to create 1 rle with old method : 0.022196531295776367 length of segment : 181 time for calcul the mask position with numpy : 0.005676746368408203 nb_pixel_total : 193002 time to create 1 rle with new method : 0.015536069869995117 length of segment : 667 time for calcul the mask position with numpy : 0.007962942123413086 nb_pixel_total : 224126 time to create 1 rle with new method : 0.013333797454833984 length of segment : 489 time for calcul the mask position with numpy : 0.012389421463012695 nb_pixel_total : 325685 time to create 1 rle with new method : 0.014347553253173828 length of segment : 480 time for calcul the mask position with numpy : 0.0013535022735595703 nb_pixel_total : 37846 time to create 1 rle with old method : 0.04321861267089844 length of segment : 196 time for calcul the mask position with numpy : 0.001875162124633789 nb_pixel_total : 68328 time to create 1 rle with old method : 0.09238147735595703 length of segment : 370 time for calcul the mask position with numpy : 0.001772165298461914 nb_pixel_total : 71510 time to create 1 rle with old method : 0.08027911186218262 length of segment : 542 time spent for convertir_results : 9.78894305229187 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 132 chid ids of type : 3594 Number RLEs to save : 30314 save missing photos in datou_result : time spend for datou_step_exec : 75.72527956962585 time spend to save output : 1.732926845550537 total time spend for step 1 : 77.45820641517639 step2:crop_condition Thu May 29 22:01:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 132 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 90 About to insert : list_path_to_insert length 90 new photo from crops ! About to upload 90 photos upload in portfolio : 3736932 init cache_photo without model_param we have 90 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748548929_31155 we have uploaded 90 photos in the portfolio 3736932 time of upload the photos Elapsed time : 23.507818460464478 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748548956_31155 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.790783166885376 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748548968_31155 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.248915672302246 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748548976_31155 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2794303894042969 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361673568, 1361673563, 1361636131, 1361636125, 1361635961, 1361635917, 1361635913, 1361635863] Looping around the photos to save general results len do output : 132 /1361676606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361676759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673568', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673563', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636131', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636125', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635961', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635917', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635913', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635863', None, None, None, None, None, '2984688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 404 time used for this insertion : 0.026696205139160156 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.7465467453003 time spend to save output : 0.030779361724853516 total time spend for step 2 : 68.77732610702515 step3:rle_unique_nms_with_priority Thu May 29 22:02:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 132 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 11.870546579360962 time for calcul the mask position with numpy : 0.874053955078125 nb_pixel_total : 6544049 time to create 1 rle with new method : 0.6852226257324219 time for calcul the mask position with numpy : 0.03246021270751953 nb_pixel_total : 16587 time to create 1 rle with old method : 0.017582416534423828 time for calcul the mask position with numpy : 0.03313136100769043 nb_pixel_total : 26941 time to create 1 rle with old method : 0.028954505920410156 time for calcul the mask position with numpy : 0.03285837173461914 nb_pixel_total : 20231 time to create 1 rle with old method : 0.021709203720092773 time for calcul the mask position with numpy : 0.032379150390625 nb_pixel_total : 19680 time to create 1 rle with old method : 0.021399497985839844 time for calcul the mask position with numpy : 0.020328521728515625 nb_pixel_total : 22647 time to create 1 rle with old method : 0.024028778076171875 time for calcul the mask position with numpy : 0.02074718475341797 nb_pixel_total : 34851 time to create 1 rle with old method : 0.037969350814819336 time for calcul the mask position with numpy : 0.020626544952392578 nb_pixel_total : 9596 time to create 1 rle with old method : 0.01038360595703125 time for calcul the mask position with numpy : 0.020000219345092773 nb_pixel_total : 37449 time to create 1 rle with old method : 0.03821206092834473 time for calcul the mask position with numpy : 0.02038121223449707 nb_pixel_total : 38935 time to create 1 rle with old method : 0.04089045524597168 time for calcul the mask position with numpy : 0.02032160758972168 nb_pixel_total : 18083 time to create 1 rle with old method : 0.018471240997314453 time for calcul the mask position with numpy : 0.019491195678710938 nb_pixel_total : 5421 time to create 1 rle with old method : 0.005789041519165039 time for calcul the mask position with numpy : 0.019845008850097656 nb_pixel_total : 28711 time to create 1 rle with old method : 0.030263185501098633 time for calcul the mask position with numpy : 0.021503210067749023 nb_pixel_total : 8993 time to create 1 rle with old method : 0.009898185729980469 time for calcul the mask position with numpy : 0.021323680877685547 nb_pixel_total : 12695 time to create 1 rle with old method : 0.013703346252441406 time for calcul the mask position with numpy : 0.02124762535095215 nb_pixel_total : 22658 time to create 1 rle with old method : 0.024039506912231445 time for calcul the mask position with numpy : 0.02040243148803711 nb_pixel_total : 26060 time to create 1 rle with old method : 0.031035900115966797 time for calcul the mask position with numpy : 0.02065277099609375 nb_pixel_total : 11853 time to create 1 rle with old method : 0.012232780456542969 time for calcul the mask position with numpy : 0.019991159439086914 nb_pixel_total : 52247 time to create 1 rle with old method : 0.054108381271362305 time for calcul the mask position with numpy : 0.020502805709838867 nb_pixel_total : 16432 time to create 1 rle with old method : 0.016844749450683594 time for calcul the mask position with numpy : 0.019353151321411133 nb_pixel_total : 9698 time to create 1 rle with old method : 0.009965658187866211 time for calcul the mask position with numpy : 0.019931793212890625 nb_pixel_total : 46373 time to create 1 rle with old method : 0.04931807518005371 time for calcul the mask position with numpy : 0.019352436065673828 nb_pixel_total : 20050 time to create 1 rle with old method : 0.02059340476989746 create new chi : 2.629244327545166 time to delete rle : 0.032592058181762695 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 9846 TO DO : save crop sub photo not yet done ! save time : 0.6328029632568359 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.359016180038452 time for calcul the mask position with numpy : 0.639855146408081 nb_pixel_total : 6525891 time to create 1 rle with new method : 1.6190805435180664 time for calcul the mask position with numpy : 0.021437406539916992 nb_pixel_total : 68057 time to create 1 rle with old method : 0.07970786094665527 time for calcul the mask position with numpy : 0.028261423110961914 nb_pixel_total : 61559 time to create 1 rle with old method : 0.06869101524353027 time for calcul the mask position with numpy : 0.03584933280944824 nb_pixel_total : 23724 time to create 1 rle with old method : 0.027073144912719727 time for calcul the mask position with numpy : 0.0355377197265625 nb_pixel_total : 64556 time to create 1 rle with old method : 0.07076001167297363 time for calcul the mask position with numpy : 0.035421133041381836 nb_pixel_total : 11835 time to create 1 rle with old method : 0.01328897476196289 time for calcul the mask position with numpy : 0.028929948806762695 nb_pixel_total : 28328 time to create 1 rle with old method : 0.03137493133544922 time for calcul the mask position with numpy : 0.021708965301513672 nb_pixel_total : 23864 time to create 1 rle with old method : 0.026452064514160156 time for calcul the mask position with numpy : 0.02177286148071289 nb_pixel_total : 11560 time to create 1 rle with old method : 0.012824058532714844 time for calcul the mask position with numpy : 0.021529674530029297 nb_pixel_total : 11502 time to create 1 rle with old method : 0.012561559677124023 time for calcul the mask position with numpy : 0.02094721794128418 nb_pixel_total : 28999 time to create 1 rle with old method : 0.031762123107910156 time for calcul the mask position with numpy : 0.02168750762939453 nb_pixel_total : 25869 time to create 1 rle with old method : 0.028158903121948242 time for calcul the mask position with numpy : 0.02107715606689453 nb_pixel_total : 55020 time to create 1 rle with old method : 0.06005382537841797 time for calcul the mask position with numpy : 0.021268129348754883 nb_pixel_total : 87385 time to create 1 rle with old method : 0.09285378456115723 time for calcul the mask position with numpy : 0.022255897521972656 nb_pixel_total : 22091 time to create 1 rle with old method : 0.035872459411621094 create new chi : 3.244957685470581 time to delete rle : 0.0016071796417236328 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8894 TO DO : save crop sub photo not yet done ! save time : 0.5493593215942383 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 9.742637157440186 time for calcul the mask position with numpy : 1.5860860347747803 nb_pixel_total : 6657481 time to create 1 rle with new method : 0.39738988876342773 time for calcul the mask position with numpy : 0.03579425811767578 nb_pixel_total : 18265 time to create 1 rle with old method : 0.02033376693725586 time for calcul the mask position with numpy : 0.02145528793334961 nb_pixel_total : 9215 time to create 1 rle with old method : 0.01025247573852539 time for calcul the mask position with numpy : 0.022098302841186523 nb_pixel_total : 11976 time to create 1 rle with old method : 0.013092041015625 time for calcul the mask position with numpy : 0.025867462158203125 nb_pixel_total : 4124 time to create 1 rle with old method : 0.004750251770019531 time for calcul the mask position with numpy : 0.022973299026489258 nb_pixel_total : 12807 time to create 1 rle with old method : 0.014258146286010742 time for calcul the mask position with numpy : 0.022114276885986328 nb_pixel_total : 30227 time to create 1 rle with old method : 0.033194780349731445 time for calcul the mask position with numpy : 0.02132248878479004 nb_pixel_total : 29547 time to create 1 rle with old method : 0.03307914733886719 time for calcul the mask position with numpy : 0.022606611251831055 nb_pixel_total : 28864 time to create 1 rle with old method : 0.032366037368774414 time for calcul the mask position with numpy : 0.02392411231994629 nb_pixel_total : 20765 time to create 1 rle with old method : 0.023343324661254883 time for calcul the mask position with numpy : 0.023590803146362305 nb_pixel_total : 19068 time to create 1 rle with old method : 0.02140045166015625 time for calcul the mask position with numpy : 0.022146940231323242 nb_pixel_total : 18744 time to create 1 rle with old method : 0.02080059051513672 time for calcul the mask position with numpy : 0.022989511489868164 nb_pixel_total : 34464 time to create 1 rle with old method : 0.03824329376220703 time for calcul the mask position with numpy : 0.023083209991455078 nb_pixel_total : 12322 time to create 1 rle with old method : 0.013576984405517578 time for calcul the mask position with numpy : 0.021715641021728516 nb_pixel_total : 38045 time to create 1 rle with old method : 0.042112112045288086 time for calcul the mask position with numpy : 0.02256631851196289 nb_pixel_total : 14673 time to create 1 rle with old method : 0.016576290130615234 time for calcul the mask position with numpy : 0.02215433120727539 nb_pixel_total : 59250 time to create 1 rle with old method : 0.0682077407836914 time for calcul the mask position with numpy : 0.02338719367980957 nb_pixel_total : 30403 time to create 1 rle with old method : 0.03336977958679199 create new chi : 2.8608286380767822 time to delete rle : 0.0011124610900878906 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8344 TO DO : save crop sub photo not yet done ! save time : 0.5484113693237305 nb_obj : 24 nb_hashtags : 3 time to prepare the origin masks : 12.591161727905273 time for calcul the mask position with numpy : 0.5147218704223633 nb_pixel_total : 6386435 time to create 1 rle with new method : 0.42533087730407715 time for calcul the mask position with numpy : 0.02178049087524414 nb_pixel_total : 88512 time to create 1 rle with old method : 0.10678410530090332 time for calcul the mask position with numpy : 0.02198648452758789 nb_pixel_total : 6645 time to create 1 rle with old method : 0.011069297790527344 time for calcul the mask position with numpy : 0.024605512619018555 nb_pixel_total : 28240 time to create 1 rle with old method : 0.03150200843811035 time for calcul the mask position with numpy : 0.022542238235473633 nb_pixel_total : 14288 time to create 1 rle with old method : 0.015923738479614258 time for calcul the mask position with numpy : 0.022730350494384766 nb_pixel_total : 11712 time to create 1 rle with old method : 0.013144493103027344 time for calcul the mask position with numpy : 0.021892786026000977 nb_pixel_total : 72644 time to create 1 rle with old method : 0.08088803291320801 time for calcul the mask position with numpy : 0.022411346435546875 nb_pixel_total : 35818 time to create 1 rle with old method : 0.04134392738342285 time for calcul the mask position with numpy : 0.02228569984436035 nb_pixel_total : 34211 time to create 1 rle with old method : 0.038259029388427734 time for calcul the mask position with numpy : 0.02315211296081543 nb_pixel_total : 12998 time to create 1 rle with old method : 0.014511823654174805 time for calcul the mask position with numpy : 0.021525144577026367 nb_pixel_total : 6871 time to create 1 rle with old method : 0.007400989532470703 time for calcul the mask position with numpy : 0.021452903747558594 nb_pixel_total : 10064 time to create 1 rle with old method : 0.011333703994750977 time for calcul the mask position with numpy : 0.021539926528930664 nb_pixel_total : 8208 time to create 1 rle with old method : 0.008817911148071289 time for calcul the mask position with numpy : 0.020062685012817383 nb_pixel_total : 23370 time to create 1 rle with old method : 0.02577376365661621 time for calcul the mask position with numpy : 0.02171611785888672 nb_pixel_total : 14082 time to create 1 rle with old method : 0.015954017639160156 time for calcul the mask position with numpy : 0.021474599838256836 nb_pixel_total : 27385 time to create 1 rle with old method : 0.02920389175415039 time for calcul the mask position with numpy : 0.020955801010131836 nb_pixel_total : 16932 time to create 1 rle with old method : 0.017691612243652344 time for calcul the mask position with numpy : 0.029237031936645508 nb_pixel_total : 13459 time to create 1 rle with old method : 0.014426469802856445 time for calcul the mask position with numpy : 0.02085137367248535 nb_pixel_total : 39035 time to create 1 rle with old method : 0.04169058799743652 time for calcul the mask position with numpy : 0.020333051681518555 nb_pixel_total : 13052 time to create 1 rle with old method : 0.014732599258422852 time for calcul the mask position with numpy : 0.02105426788330078 nb_pixel_total : 9742 time to create 1 rle with old method : 0.010708332061767578 time for calcul the mask position with numpy : 0.022043704986572266 nb_pixel_total : 104750 time to create 1 rle with old method : 0.14107012748718262 time for calcul the mask position with numpy : 0.022396326065063477 nb_pixel_total : 27185 time to create 1 rle with old method : 0.029905319213867188 time for calcul the mask position with numpy : 0.02200150489807129 nb_pixel_total : 18951 time to create 1 rle with old method : 0.020587682723999023 time for calcul the mask position with numpy : 0.020386934280395508 nb_pixel_total : 25651 time to create 1 rle with old method : 0.027876615524291992 create new chi : 2.2813379764556885 time to delete rle : 0.001737356185913086 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 11647 TO DO : save crop sub photo not yet done ! save time : 0.7218174934387207 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 5.599337100982666 time for calcul the mask position with numpy : 0.4790792465209961 nb_pixel_total : 5952085 time to create 1 rle with new method : 0.4189119338989258 time for calcul the mask position with numpy : 0.02215099334716797 nb_pixel_total : 260395 time to create 1 rle with new method : 0.47978711128234863 time for calcul the mask position with numpy : 0.03370046615600586 nb_pixel_total : 25893 time to create 1 rle with old method : 0.027553796768188477 time for calcul the mask position with numpy : 0.03658914566040039 nb_pixel_total : 18789 time to create 1 rle with old method : 0.019487380981445312 time for calcul the mask position with numpy : 0.03316974639892578 nb_pixel_total : 40663 time to create 1 rle with old method : 0.0439455509185791 time for calcul the mask position with numpy : 0.02399921417236328 nb_pixel_total : 575023 time to create 1 rle with new method : 0.3772730827331543 time for calcul the mask position with numpy : 0.021590709686279297 nb_pixel_total : 25546 time to create 1 rle with old method : 0.028652667999267578 time for calcul the mask position with numpy : 0.020464420318603516 nb_pixel_total : 23888 time to create 1 rle with old method : 0.028452157974243164 time for calcul the mask position with numpy : 0.022937774658203125 nb_pixel_total : 75977 time to create 1 rle with old method : 0.09018254280090332 time for calcul the mask position with numpy : 0.024072885513305664 nb_pixel_total : 20412 time to create 1 rle with old method : 0.035877227783203125 time for calcul the mask position with numpy : 0.030476808547973633 nb_pixel_total : 8830 time to create 1 rle with old method : 0.016182899475097656 time for calcul the mask position with numpy : 0.02921295166015625 nb_pixel_total : 12425 time to create 1 rle with old method : 0.020833492279052734 time for calcul the mask position with numpy : 0.026357412338256836 nb_pixel_total : 10314 time to create 1 rle with old method : 0.012718677520751953 create new chi : 2.484848737716675 time to delete rle : 0.002270936965942383 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9495 TO DO : save crop sub photo not yet done ! save time : 0.553823709487915 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 6.400712490081787 time for calcul the mask position with numpy : 0.48885178565979004 nb_pixel_total : 6724045 time to create 1 rle with new method : 0.7173459529876709 time for calcul the mask position with numpy : 0.0323944091796875 nb_pixel_total : 27907 time to create 1 rle with old method : 0.028945446014404297 time for calcul the mask position with numpy : 0.0194551944732666 nb_pixel_total : 10875 time to create 1 rle with old method : 0.011737585067749023 time for calcul the mask position with numpy : 0.02078533172607422 nb_pixel_total : 73073 time to create 1 rle with old method : 0.07860875129699707 time for calcul the mask position with numpy : 0.020106792449951172 nb_pixel_total : 46615 time to create 1 rle with old method : 0.0484461784362793 time for calcul the mask position with numpy : 0.0233612060546875 nb_pixel_total : 6992 time to create 1 rle with old method : 0.0073206424713134766 time for calcul the mask position with numpy : 0.01977992057800293 nb_pixel_total : 8569 time to create 1 rle with old method : 0.008881807327270508 time for calcul the mask position with numpy : 0.019743919372558594 nb_pixel_total : 56644 time to create 1 rle with old method : 0.05844521522521973 time for calcul the mask position with numpy : 0.0193021297454834 nb_pixel_total : 7147 time to create 1 rle with old method : 0.0076868534088134766 time for calcul the mask position with numpy : 0.01955413818359375 nb_pixel_total : 81787 time to create 1 rle with old method : 0.08385753631591797 time for calcul the mask position with numpy : 0.01907944679260254 nb_pixel_total : 6586 time to create 1 rle with old method : 0.006705760955810547 create new chi : 1.7963600158691406 time to delete rle : 0.0008063316345214844 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 5830 TO DO : save crop sub photo not yet done ! save time : 0.36582136154174805 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 5.9774205684661865 time for calcul the mask position with numpy : 0.60565185546875 nb_pixel_total : 6723509 time to create 1 rle with new method : 0.8475174903869629 time for calcul the mask position with numpy : 0.019518613815307617 nb_pixel_total : 13427 time to create 1 rle with old method : 0.01369619369506836 time for calcul the mask position with numpy : 0.01904892921447754 nb_pixel_total : 58302 time to create 1 rle with old method : 0.05939960479736328 time for calcul the mask position with numpy : 0.018709659576416016 nb_pixel_total : 11947 time to create 1 rle with old method : 0.012047767639160156 time for calcul the mask position with numpy : 0.01916027069091797 nb_pixel_total : 33281 time to create 1 rle with old method : 0.03427863121032715 time for calcul the mask position with numpy : 0.019034624099731445 nb_pixel_total : 3205 time to create 1 rle with old method : 0.003294706344604492 time for calcul the mask position with numpy : 0.020636320114135742 nb_pixel_total : 16220 time to create 1 rle with old method : 0.017045021057128906 time for calcul the mask position with numpy : 0.019596576690673828 nb_pixel_total : 43136 time to create 1 rle with old method : 0.04462599754333496 time for calcul the mask position with numpy : 0.019634008407592773 nb_pixel_total : 6218 time to create 1 rle with old method : 0.0064737796783447266 time for calcul the mask position with numpy : 0.01931595802307129 nb_pixel_total : 9688 time to create 1 rle with old method : 0.010148048400878906 time for calcul the mask position with numpy : 0.020282983779907227 nb_pixel_total : 26319 time to create 1 rle with old method : 0.026975393295288086 time for calcul the mask position with numpy : 0.021356821060180664 nb_pixel_total : 14595 time to create 1 rle with old method : 0.01544642448425293 time for calcul the mask position with numpy : 0.020529985427856445 nb_pixel_total : 17649 time to create 1 rle with old method : 0.018601655960083008 time for calcul the mask position with numpy : 0.02036762237548828 nb_pixel_total : 16966 time to create 1 rle with old method : 0.01738905906677246 time for calcul the mask position with numpy : 0.019287586212158203 nb_pixel_total : 26106 time to create 1 rle with old method : 0.02691960334777832 time for calcul the mask position with numpy : 0.020312070846557617 nb_pixel_total : 29672 time to create 1 rle with old method : 0.0307619571685791 create new chi : 2.121668577194214 time to delete rle : 0.0010762214660644531 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 7710 TO DO : save crop sub photo not yet done ! save time : 0.4831278324127197 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 8.307338237762451 time for calcul the mask position with numpy : 0.5112531185150146 nb_pixel_total : 4877667 time to create 1 rle with new method : 1.1820852756500244 time for calcul the mask position with numpy : 0.022376537322998047 nb_pixel_total : 65433 time to create 1 rle with old method : 0.0734400749206543 time for calcul the mask position with numpy : 0.021669387817382812 nb_pixel_total : 68328 time to create 1 rle with old method : 0.07517361640930176 time for calcul the mask position with numpy : 0.02091360092163086 nb_pixel_total : 37846 time to create 1 rle with old method : 0.04148292541503906 time for calcul the mask position with numpy : 0.026410341262817383 nb_pixel_total : 325685 time to create 1 rle with new method : 0.704838752746582 time for calcul the mask position with numpy : 0.025019407272338867 nb_pixel_total : 224126 time to create 1 rle with new method : 0.6938695907592773 time for calcul the mask position with numpy : 0.030124187469482422 nb_pixel_total : 187826 time to create 1 rle with new method : 1.5869266986846924 time for calcul the mask position with numpy : 0.021329879760742188 nb_pixel_total : 18316 time to create 1 rle with old method : 0.019231319427490234 time for calcul the mask position with numpy : 0.021373271942138672 nb_pixel_total : 48655 time to create 1 rle with old method : 0.0524907112121582 time for calcul the mask position with numpy : 0.02181839942932129 nb_pixel_total : 78222 time to create 1 rle with old method : 0.08226156234741211 time for calcul the mask position with numpy : 0.02169013023376465 nb_pixel_total : 27555 time to create 1 rle with old method : 0.028767824172973633 time for calcul the mask position with numpy : 0.021016597747802734 nb_pixel_total : 73592 time to create 1 rle with old method : 0.07828927040100098 time for calcul the mask position with numpy : 0.021765470504760742 nb_pixel_total : 152086 time to create 1 rle with new method : 0.6904308795928955 time for calcul the mask position with numpy : 0.02205657958984375 nb_pixel_total : 208849 time to create 1 rle with new method : 0.5024216175079346 time for calcul the mask position with numpy : 0.02173018455505371 nb_pixel_total : 12025 time to create 1 rle with old method : 0.013081073760986328 time for calcul the mask position with numpy : 0.021300792694091797 nb_pixel_total : 17163 time to create 1 rle with old method : 0.019252538681030273 time for calcul the mask position with numpy : 0.023537874221801758 nb_pixel_total : 118298 time to create 1 rle with old method : 0.12861132621765137 time for calcul the mask position with numpy : 0.024298429489135742 nb_pixel_total : 466533 time to create 1 rle with new method : 0.7693312168121338 time for calcul the mask position with numpy : 0.021428585052490234 nb_pixel_total : 42035 time to create 1 rle with old method : 0.045639753341674805 create new chi : 7.905675172805786 time to delete rle : 0.0019600391387939453 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 15373 TO DO : save crop sub photo not yet done ! save time : 0.9400696754455566 map_output_result : {1361673568: (0.0, 'Should be the crop_list due to order', 0), 1361673563: (0.0, 'Should be the crop_list due to order', 0), 1361636131: (0.0, 'Should be the crop_list due to order', 0), 1361636125: (0.0, 'Should be the crop_list due to order', 0), 1361635961: (0.0, 'Should be the crop_list due to order', 0), 1361635917: (0.0, 'Should be the crop_list due to order', 0), 1361635913: (0.0, 'Should be the crop_list due to order', 0), 1361635863: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361673568, 1361673563, 1361636131, 1361636125, 1361635961, 1361635917, 1361635913, 1361635863] Looping around the photos to save general results len do output : 8 /1361673568.Didn't retrieve data . /1361673563.Didn't retrieve data . /1361636131.Didn't retrieve data . /1361636125.Didn't retrieve data . /1361635961.Didn't retrieve data . /1361635917.Didn't retrieve data . /1361635913.Didn't retrieve data . /1361635863.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673568', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673563', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636131', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636125', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635961', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635917', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635913', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635863', None, None, None, None, None, '2984688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012871980667114258 save_final save missing photos in datou_result : time spend for datou_step_exec : 98.13242173194885 time spend to save output : 0.01335597038269043 total time spend for step 3 : 98.14577770233154 step4:ventilate_hashtags_in_portfolio Thu May 29 22:04:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23443373 get user id for portfolio 23443373 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23443373 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','flou','metal','environnement','background','papier','mal_croppe','autre','carton','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23443373 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','flou','metal','environnement','background','papier','mal_croppe','autre','carton','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23443373 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','flou','metal','environnement','background','papier','mal_croppe','autre','carton','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23443576,23443577,23443578,23443579,23443580,23443581,23443582,23443583,23443584,23443585,23443586?tags=pehd,flou,metal,environnement,background,papier,mal_croppe,autre,carton,pet_fonce,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361673568, 1361673563, 1361636131, 1361636125, 1361635961, 1361635917, 1361635913, 1361635863] Looping around the photos to save general results len do output : 1 /23443373. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673568', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673563', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636131', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636125', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635961', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635917', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635913', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635863', None, None, None, None, None, '2984688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013637542724609375 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.482450246810913 time spend to save output : 0.013926506042480469 total time spend for step 4 : 1.4963767528533936 step5:final Thu May 29 22:04:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361673568: ('0.10657009548611114',), 1361673563: ('0.10657009548611114',), 1361636131: ('0.10657009548611114',), 1361636125: ('0.10657009548611114',), 1361635961: ('0.10657009548611114',), 1361635917: ('0.10657009548611114',), 1361635913: ('0.10657009548611114',), 1361635863: ('0.10657009548611114',)} new output for save of step final : {1361673568: ('0.10657009548611114',), 1361673563: ('0.10657009548611114',), 1361636131: ('0.10657009548611114',), 1361636125: ('0.10657009548611114',), 1361635961: ('0.10657009548611114',), 1361635917: ('0.10657009548611114',), 1361635913: ('0.10657009548611114',), 1361635863: ('0.10657009548611114',)} [1361673568, 1361673563, 1361636131, 1361636125, 1361635961, 1361635917, 1361635913, 1361635863] Looping around the photos to save general results len do output : 8 /1361673568.Didn't retrieve data . /1361673563.Didn't retrieve data . /1361636131.Didn't retrieve data . /1361636125.Didn't retrieve data . /1361635961.Didn't retrieve data . /1361635917.Didn't retrieve data . /1361635913.Didn't retrieve data . /1361635863.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673568', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673563', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636131', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636125', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635961', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635917', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635913', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635863', None, None, None, None, None, '2984688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012473821640014648 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1030888557434082 time spend to save output : 0.012892484664916992 total time spend for step 5 : 0.1159813404083252 step6:blur_detection Thu May 29 22:04:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5.jpg resize: (2160, 3264) 1361673568 -2.783957264666289 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784.jpg resize: (2160, 3264) 1361673563 -2.4507544930463885 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d.jpg resize: (2160, 3264) 1361636131 -2.041146536400295 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0.jpg resize: (2160, 3264) 1361636125 -2.4687774028944123 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02.jpg resize: (2160, 3264) 1361635961 -0.8152012214441611 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd.jpg resize: (2160, 3264) 1361635917 -1.4195699084747386 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478.jpg resize: (2160, 3264) 1361635913 -1.6346225139599535 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d.jpg resize: (2160, 3264) 1361635863 -1.339937761055244 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395550_0.png resize: (188, 160) 1361676606 -2.1774955766059314 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395534_0.png resize: (286, 230) 1361676607 -1.128335222288662 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395537_0.png resize: (245, 346) 1361676608 -1.3657231896997009 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395545_0.png resize: (198, 124) 1361676609 -0.988519728785966 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395544_0.png resize: (103, 67) 1361676610 1.3550155394300087 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395536_0.png resize: (160, 166) 1361676611 -1.0025749915429185 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395551_0.png resize: (183, 172) 1361676612 -1.539338223892207 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395552_0.png resize: (160, 154) 1361676613 0.3083745083638454 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395535_0.png resize: (124, 108) 1361676614 -0.5899019927780386 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395542_0.png resize: (127, 86) 1361676615 -0.3549646977556506 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395554_0.png resize: (104, 235) 1361676616 -3.1429888146633282 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395543_0.png resize: (199, 218) 1361676617 -1.0556576477265898 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395546_0.png resize: (223, 231) 1361676618 -2.5957569939888874 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395538_0.png resize: (172, 96) 1361676619 -1.9396871476027904 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395566_0.png resize: (169, 257) 1361676620 -2.121242968753618 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395563_0.png resize: (161, 218) 1361676621 -0.5339404737561949 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395556_0.png resize: (316, 407) 1361676622 -1.333011866948255 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395564_0.png resize: (158, 99) 1361676624 -1.0874788357658214 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395561_0.png resize: (94, 153) 1361676625 0.8436622213217841 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395555_0.png resize: (211, 196) 1361676626 -2.69809330223645 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395559_0.png resize: (206, 272) 1361676627 -2.4548620437564073 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395560_0.png resize: (183, 89) 1361676628 -1.3268526801944605 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395562_0.png resize: (227, 174) 1361676629 -1.2411749843214719 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395572_0.png resize: (259, 212) 1361676630 -0.9948721197406665 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395580_0.png resize: (298, 153) 1361676631 -1.7472921204883 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395576_0.png resize: (84, 279) 1361676632 -0.9706379649455368 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395569_0.png resize: (163, 210) 1361676633 2.668920668723976 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395577_0.png resize: (195, 171) 1361676634 -0.1943571257559371 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395579_0.png resize: (262, 164) 1361676635 -1.344614874654549 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395570_0.png resize: (204, 338) 1361676636 -1.1103228039617388 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395578_0.png resize: (309, 136) 1361676637 -1.3627391999818517 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395581_0.png resize: (117, 201) 1361676638 -1.1957008105133797 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395575_0.png resize: (129, 172) 1361676639 -1.4121114669184216 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395585_0.png resize: (192, 124) 1361676640 -1.3073923028209322 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395584_0.png resize: (120, 118) 1361676641 -1.81532954605861 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395605_0.png resize: (99, 155) 1361676642 -0.5205586766463286 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395597_0.png resize: (242, 129) 1361676643 -1.686736577434741 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395590_0.png resize: (123, 129) 1361676644 -1.784750179400712 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395600_0.png resize: (98, 99) 1361676645 -1.422863023210738 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395586_0.png resize: (210, 186) 1361676646 -1.2823700743260402 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395591_0.png resize: (114, 143) 1361676647 -0.48699280498447634 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395595_0.png resize: (170, 228) 1361676648 -0.6067305840358962 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395593_0.png resize: (157, 105) 1361676649 0.6300616495394941 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395598_0.png resize: (104, 104) 1361676650 -0.13796984399376402 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395608_0.png resize: (81, 99) 1361676651 1.8991241735021873 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395594_0.png resize: (171, 181) 1361676652 -1.543230335011331 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395602_0.png resize: (282, 201) 1361676653 -0.7734038663032724 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395588_0.png resize: (181, 195) 1361676654 -1.2232661369590436 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395596_0.png resize: (163, 145) 1361676655 -1.3395938725249137 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395603_0.png resize: (185, 210) 1361676656 1.4573700766983504 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395601_0.png resize: (187, 101) 1361676657 -1.532353732380333 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395587_0.png resize: (197, 119) 1361676658 -1.9402636263582453 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395613_0.png resize: (161, 183) 1361676659 -1.9732221570600805 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395616_0.png resize: (184, 176) 1361676660 -0.9152903842669461 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395617_0.png resize: (801, 845) 1361676661 0.9080309751010329 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395612_0.png resize: (122, 112) 1361676662 -1.3921656846653547 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395620_0.png resize: (182, 180) 1361676663 -0.40963803822968836 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395611_0.png resize: (96, 207) 1361676664 -0.9491666836745541 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395619_0.png resize: (175, 131) 1361676665 -0.039077731444137315 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395610_0.png resize: (159, 111) 1361676666 -0.8973985159548192 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395621_0.png resize: (671, 564) 1361676667 -2.166077359337323 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395615_0.png resize: (161, 192) 1361676668 -0.2560316081407066 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395618_0.png resize: (270, 230) 1361676670 -0.11959664761573541 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395628_0.png resize: (243, 270) 1361676671 -0.4367563748682746 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395631_0.png resize: (172, 186) 1361676672 1.340981093554869 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395626_0.png resize: (114, 94) 1361676673 0.37657599574527983 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395629_0.png resize: (375, 245) 1361676674 -0.01764330865119639 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395622_0.png resize: (88, 91) 1361676675 -0.2958182248547378 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395625_0.png resize: (270, 313) 1361676676 -0.08806292942196266 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395624_0.png resize: (83, 122) 1361676677 0.9780040156305987 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395639_0.png resize: (117, 70) 1361676678 -0.9563683771464783 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395646_0.png resize: (140, 160) 1361676679 -1.4795700437221828 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395635_0.png resize: (216, 140) 1361676680 -1.4889548467648965 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395642_0.png resize: (53, 71) 1361676681 20.0 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395644_0.png resize: (122, 147) 1361676682 -0.23445613981335772 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395637_0.png resize: (152, 229) 1361676684 -1.1340665672405896 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395634_0.png resize: (102, 237) 1361676686 -0.7815939763678685 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395645_0.png resize: (305, 273) 1361676687 -0.007498206998762767 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395641_0.png resize: (228, 106) 1361676688 -0.9414165926795918 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395643_0.png resize: (221, 220) 1361676689 -0.44890342589586035 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395655_0.png resize: (178, 200) 1361676690 -1.6031754901994615 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395647_0.png resize: (162, 411) 1361676691 -1.2044706577697686 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395658_0.png resize: (179, 159) 1361676692 -1.5265011655901937 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395657_0.png resize: (210, 346) 1361676693 -1.391755152173789 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395649_0.png resize: (339, 491) 1361676694 -1.1305044070221435 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395648_0.png resize: (835, 845) 1361676695 -0.29972482234699 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395663_0.png resize: (370, 329) 1361676696 0.18681607935571212 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395652_0.png resize: (759, 549) 1361676697 -1.5075720377301292 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395653_0.png resize: (410, 520) 1361676698 -0.10042976794890102 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395664_0.png resize: (540, 165) 1361676699 -1.088771823005193 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395533_0.png resize: (126, 287) 1361676705 -2.547463930885012 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395548_0.png resize: (108, 142) 1361676706 -1.086635069769291 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395541_0.png resize: (118, 171) 1361676707 -1.706817982301675 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395549_0.png resize: (163, 344) 1361676708 -2.3617500164834526 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395553_0.png resize: (137, 267) 1361676709 -0.2941554175332593 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395557_0.png resize: (192, 393) 1361676710 -1.1028279613419043 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395571_0.png resize: (122, 166) 1361676711 -1.275121433314035 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395573_0.png resize: (138, 112) 1361676712 0.06822728055139703 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395583_0.png resize: (100, 155) 1361676713 -0.033052340132766915 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395606_0.png resize: (163, 125) 1361676714 -0.10972952300588486 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395607_0.png resize: (244, 188) 1361676715 -0.7582984980454379 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395627_0.png resize: (93, 111) 1361676716 -0.3062181454416627 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395632_0.png resize: (203, 203) 1361676717 -0.9980463487564084 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395633_0.png resize: (170, 208) 1361676718 -0.3462942532272295 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395638_0.png resize: (123, 97) 1361676719 1.8321632159706742 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395636_0.png resize: (112, 183) 1361676721 -0.04500534763521986 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395547_0.png resize: (211, 349) 1361676733 -2.121585716993603 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395540_0.png resize: (176, 164) 1361676734 -3.1315509690262258 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395558_0.png resize: (140, 232) 1361676735 -3.103387106832593 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395568_0.png resize: (272, 404) 1361676736 -1.785907370685225 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395565_0.png resize: (344, 261) 1361676737 -1.2160892584041016 treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395567_0.png resize: (350, 247) 1361676738 -2.095669592715229 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395574_0.png resize: (200, 216) 1361676739 -1.3852670674255678 treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395582_0.png resize: (62, 78) 1361676740 -2.0182911792431537 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395599_0.png resize: (85, 150) 1361676741 -1.3376237345496855 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395604_0.png resize: (258, 414) 1361676742 -0.6514332722402074 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395589_0.png resize: (391, 356) 1361676743 -0.8546332503872242 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395609_0.png resize: (402, 288) 1361676744 -2.2528361279442852 treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395592_0.png resize: (276, 268) 1361676745 -1.208596166524127 treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395614_0.png resize: (436, 300) 1361676746 -0.47005102996764786 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395623_0.png resize: (220, 440) 1361676747 -1.8742114861350723 treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395640_0.png resize: (324, 240) 1361676748 -2.379240403595449 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395660_0.png resize: (485, 776) 1361676749 -1.1041233992999833 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395650_0.png resize: (170, 119) 1361676750 -1.7943053634167947 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395662_0.png resize: (193, 241) 1361676751 -2.9167529613650003 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395661_0.png resize: (476, 919) 1361676752 0.2685682150643822 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395659_0.png resize: (489, 684) 1361676753 -1.0595432574637362 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395656_0.png resize: (316, 359) 1361676754 -0.8106772434074502 treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395539_0.png resize: (163, 190) 1361676756 0.5544085458173673 treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395630_0.png resize: (121, 114) 1361676757 0.5387427880791249 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395651_0.png resize: (122, 132) 1361676758 -0.7462315008335675 treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395654_0.png resize: (233, 481) 1361676759 -0.5746590107786127 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 140 time used for this insertion : 0.018506765365600586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 140 time used for this insertion : 0.04745793342590332 save missing photos in datou_result : time spend for datou_step_exec : 34.30699610710144 time spend to save output : 0.07091975212097168 total time spend for step 6 : 34.37791585922241 step7:brightness Thu May 29 22:05:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5.jpg treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784.jpg treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d.jpg treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0.jpg treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02.jpg treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd.jpg treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478.jpg treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d.jpg treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395550_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395534_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395537_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395545_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395544_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395536_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395551_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395552_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395535_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395542_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395554_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395543_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395546_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395538_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395566_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395563_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395556_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395564_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395561_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395555_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395559_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395560_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395562_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395572_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395580_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395576_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395569_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395577_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395579_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395570_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395578_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395581_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395575_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395585_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395584_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395605_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395597_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395590_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395600_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395586_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395591_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395595_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395593_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395598_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395608_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395594_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395602_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395588_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395596_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395603_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395601_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395587_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395613_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395616_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395617_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395612_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395620_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395611_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395619_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395610_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395621_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395615_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395618_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395628_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395631_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395626_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395629_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395622_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395625_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395624_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395639_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395646_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395635_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395642_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395644_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395637_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395634_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395645_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395641_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395643_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395655_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395647_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395658_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395657_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395649_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395648_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395663_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395652_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395653_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395664_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395533_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395548_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395541_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395549_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395553_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395557_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395571_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395573_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395583_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395606_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395607_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395627_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395632_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395633_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395638_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395636_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395547_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395540_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395558_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395568_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395565_0.png treat image : temp/1748548830_31155_1361673563_667a923dafdd25da8c118ae708730784_rle_crop_3815395567_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395574_0.png treat image : temp/1748548830_31155_1361636131_da2ffd516163022cf635d2c45573256d_rle_crop_3815395582_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395599_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395604_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395589_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395609_0.png treat image : temp/1748548830_31155_1361636125_ae4b66c010a52f3640f60993324841c0_rle_crop_3815395592_0.png treat image : temp/1748548830_31155_1361635961_47a6ab7aff369274bc80520905e46e02_rle_crop_3815395614_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395623_0.png treat image : temp/1748548830_31155_1361635913_463f6966c465c714b5ed1fb082018478_rle_crop_3815395640_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395660_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395650_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395662_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395661_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395659_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395656_0.png treat image : temp/1748548830_31155_1361673568_0278324f7a0040361a64be7f9c5b58b5_rle_crop_3815395539_0.png treat image : temp/1748548830_31155_1361635917_6e2528404145c010c0c43f20a1503bdd_rle_crop_3815395630_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395651_0.png treat image : temp/1748548830_31155_1361635863_c3a17d631281bca5085f82efd9adc45d_rle_crop_3815395654_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 140 time used for this insertion : 0.018974781036376953 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 140 time used for this insertion : 0.032030582427978516 save missing photos in datou_result : time spend for datou_step_exec : 7.259927272796631 time spend to save output : 0.056215524673461914 total time spend for step 7 : 7.316142797470093 step8:velours_tree Thu May 29 22:05:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.11771416664123535 time spend to save output : 5.412101745605469e-05 total time spend for step 8 : 0.1177682876586914 step9:send_mail_cod Thu May 29 22:05:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23443373_29-05-2025_22_05_19.pdf 23443576 imagette234435761748549119 23443577 imagette234435771748549119 23443578 imagette234435781748549119 23443580 imagette234435801748549119 23443581 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234435811748549119 23443582 imagette234435821748549120 23443583 change filename to text .change filename to text .change filename to text .change filename to text .imagette234435831748549120 23443584 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234435841748549120 23443585 imagette234435851748549121 23443586 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234435861748549121 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23443373 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23443576,23443577,23443578,23443579,23443580,23443581,23443582,23443583,23443584,23443585,23443586?tags=pehd,flou,metal,environnement,background,papier,mal_croppe,autre,carton,pet_fonce,pet_clair args[1361673568] : ((1361673568, -2.783957264666289, 492609224), (1361673568, -0.09662932242430033, 496442774), '0.10657009548611114') We are sending mail with results at report@fotonower.com args[1361673563] : ((1361673563, -2.4507544930463885, 492609224), (1361673563, 0.1998007559418474, 2107752395), '0.10657009548611114') We are sending mail with results at report@fotonower.com args[1361636131] : ((1361636131, -2.041146536400295, 492609224), (1361636131, 0.2541666311159437, 2107752395), '0.10657009548611114') We are sending mail with results at report@fotonower.com args[1361636125] : ((1361636125, -2.4687774028944123, 492609224), (1361636125, 0.07123293189298165, 2107752395), '0.10657009548611114') We are sending mail with results at report@fotonower.com args[1361635961] : ((1361635961, -0.8152012214441611, 492688767), (1361635961, 0.22561284275304153, 2107752395), '0.10657009548611114') We are sending mail with results at report@fotonower.com args[1361635917] : ((1361635917, -1.4195699084747386, 492688767), (1361635917, 0.35673151185683355, 2107752395), '0.10657009548611114') We are sending mail with results at report@fotonower.com args[1361635913] : ((1361635913, -1.6346225139599535, 492688767), (1361635913, 0.08067061241589282, 2107752395), '0.10657009548611114') We are sending mail with results at report@fotonower.com args[1361635863] : ((1361635863, -1.339937761055244, 492688767), (1361635863, 0.24995237549694244, 2107752395), '0.10657009548611114') We are sending mail with results at report@fotonower.com refus_total : 0.10657009548611114 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23443373 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23443373_29-05-2025_22_05_19.pdf results_Auto_P23443373_29-05-2025_22_05_19.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23443373_29-05-2025_22_05_19.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23443373','results_Auto_P23443373_29-05-2025_22_05_19.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23443373_29-05-2025_22_05_19.pdf','pdf','','0.61','0.10657009548611114') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23443373

https://www.fotonower.com/image?json=false&list_photos_id=1361673568
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361673563
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361636131
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361636125
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361635961
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361635917
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361635913
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361635863
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.66%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23443581?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23443583?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23443584?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23443586?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23443373_29-05-2025_22_05_19.pdf.

Lien vers velours :https://www.fotonower.com/velours/23443576,23443577,23443578,23443579,23443580,23443581,23443582,23443583,23443584,23443585,23443586?tags=pehd,flou,metal,environnement,background,papier,mal_croppe,autre,carton,pet_fonce,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 29 May 2025 20:05:25 GMT Content-Length: 0 Connection: close X-Message-Id: __EvZEOqTuC0ZjBZxAh-cw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361673568, 1361673563, 1361636131, 1361636125, 1361635961, 1361635917, 1361635913, 1361635863] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673568', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673563', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636131', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636125', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635961', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635917', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635913', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635863', None, None, None, None, None, '2984688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014394521713256836 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.256204843521118 time spend to save output : 0.014600753784179688 total time spend for step 9 : 6.270805597305298 step10:split_time_score Thu May 29 22:05:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 29052025 23443373 Nombre de photos uploadées : 8 / 23040 (0%) 29052025 23443373 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 29052025 23443373 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0005123615264892578 elapsed_time : insert_dashboard_record_day_entry 0.023491621017456055 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23440003 order by id desc limit 1 Qualite : 0.13914992019184222 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23440005_29-05-2025_14_36_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23440005 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23440005 AND mptpi.`type`=3594 To do Qualite : 0.09789808573892522 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23439680_29-05-2025_13_14_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23439680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23439680 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23440235 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23440236 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23443370 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23443371 order by id desc limit 1 Qualite : 0.10657009548611114 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23443373_29-05-2025_22_05_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23443373 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23443373 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23443374 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23443377 order by id desc limit 1 Qualite : 0.1411218181934232 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23442859_29-05-2025_21_11_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23442859 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23442859 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23442861 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'29052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361673568, 1361673563, 1361636131, 1361636125, 1361635961, 1361635917, 1361635913, 1361635863] Looping around the photos to save general results len do output : 1 /23443373Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673568', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361673563', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636131', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361636125', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635961', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635917', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635913', None, None, None, None, None, '2984688') ('3318', None, None, None, None, None, None, None, '2984688') ('3318', '23443373', '1361635863', None, None, None, None, None, '2984688') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013170242309570312 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.425736665725708 time spend to save output : 0.013413429260253906 total time spend for step 10 : 7.439150094985962 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 111.14user 140.28system 5:06.89elapsed 81%CPU (0avgtext+0avgdata 4875140maxresident)k 658624inputs+66160outputs (2353major+11445855minor)pagefaults 0swaps