python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2998039 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2720210'] with mtr_portfolio_ids : ['22018590'] and first list_photo_ids : [] new path : /proc/2998039/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.628037452697754 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Apr 3 10:50:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-03 10:50:57.675488: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-03 10:50:57.711321: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-03 10:50:57.713594: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb9ec000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-03 10:50:57.713619: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-03 10:50:57.719264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-03 10:50:58.032341: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x146f4940 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-03 10:50:58.032435: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-03 10:50:58.034438: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-03 10:50:58.037628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-03 10:50:58.075524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-03 10:50:58.096596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-03 10:50:58.101601: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-03 10:50:58.137274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-03 10:50:58.143500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-03 10:50:58.207243: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-03 10:50:58.212026: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-03 10:50:58.212533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-03 10:50:58.215691: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-03 10:50:58.215719: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-03 10:50:58.215734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-03 10:50:58.219406: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9881 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-03 10:50:58.686551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-03 10:50:58.686678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-03 10:50:58.686706: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-03 10:50:58.686732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-03 10:50:58.686756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-03 10:50:58.686780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-03 10:50:58.686804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-03 10:50:58.686828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-03 10:50:58.688680: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-03 10:50:58.690021: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-03 10:50:58.690073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-03 10:50:58.690095: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-03 10:50:58.690116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-03 10:50:58.690136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-03 10:50:58.690156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-03 10:50:58.690175: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-03 10:50:58.690195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-03 10:50:58.691812: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-03 10:50:58.691846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-03 10:50:58.691857: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-03 10:50:58.691866: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-03 10:50:58.693503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9881 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-03 10:51:12.716683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-03 10:51:13.003794: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-03 10:51:14.747328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.747944: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.748472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.748996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.749528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.750049: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.750576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.750614: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.751333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.751353: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.792378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.792440: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.792983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.793001: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.800646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.800713: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.801259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.801276: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.983377: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.983446: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.983994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.984010: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.998361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.998425: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:14.998984: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:14.999004: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-03 10:51:15.150072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.150690: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.152722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.153314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.195613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.196496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.198870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.199709: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.232873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.233791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.236001: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.236887: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.244907: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.245489: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.248116: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.248680: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.257627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.258211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.259939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.260497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.287484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.288069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.288609: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.289147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.292797: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.293373: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.309674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.310296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.310859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.311456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.324372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.324997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.325563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.326116: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.330866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.331491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.336295: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.336859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.349343: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.349960: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.354184: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.354758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.355350: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.355921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.356830: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.357415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.368017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.368574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.369146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.369699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.370251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.370803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.371369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.371930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.381259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.381830: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.388237: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.388845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.440677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.441772: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.442832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.443820: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.452356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.452957: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.471331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.472118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.472973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.473708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.477908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.478468: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.479074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.479673: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.480829: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.480853: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-03 10:51:15.491095: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.491712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.501101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.501707: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.502269: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.502824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.503438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-03 10:51:15.504019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 Detection mask done ! Trying to reset tf kernel 2999322 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 555 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7037 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005619525909423828 nb_pixel_total : 14401 time to create 1 rle with old method : 0.015894174575805664 length of segment : 153 time for calcul the mask position with numpy : 0.002719402313232422 nb_pixel_total : 95860 time to create 1 rle with old method : 0.1013936996459961 length of segment : 833 time for calcul the mask position with numpy : 0.0007090568542480469 nb_pixel_total : 41805 time to create 1 rle with old method : 0.04502391815185547 length of segment : 285 time for calcul the mask position with numpy : 0.00023508071899414062 nb_pixel_total : 12150 time to create 1 rle with old method : 0.013727426528930664 length of segment : 125 time for calcul the mask position with numpy : 0.00048232078552246094 nb_pixel_total : 23372 time to create 1 rle with old method : 0.025650739669799805 length of segment : 249 time for calcul the mask position with numpy : 0.002781391143798828 nb_pixel_total : 115115 time to create 1 rle with old method : 0.12709641456604004 length of segment : 470 time for calcul the mask position with numpy : 0.0013816356658935547 nb_pixel_total : 60166 time to create 1 rle with old method : 0.0668954849243164 length of segment : 622 time for calcul the mask position with numpy : 0.0003883838653564453 nb_pixel_total : 19747 time to create 1 rle with old method : 0.02212214469909668 length of segment : 120 time for calcul the mask position with numpy : 0.0009794235229492188 nb_pixel_total : 55088 time to create 1 rle with old method : 0.059641361236572266 length of segment : 541 time for calcul the mask position with numpy : 0.0006105899810791016 nb_pixel_total : 25954 time to create 1 rle with old method : 0.0284576416015625 length of segment : 154 time for calcul the mask position with numpy : 0.001999378204345703 nb_pixel_total : 67802 time to create 1 rle with old method : 0.08324480056762695 length of segment : 878 time for calcul the mask position with numpy : 0.09824204444885254 nb_pixel_total : 707959 time to create 1 rle with new method : 0.07113528251647949 length of segment : 805 time for calcul the mask position with numpy : 0.0051288604736328125 nb_pixel_total : 210370 time to create 1 rle with new method : 0.013361454010009766 length of segment : 675 time for calcul the mask position with numpy : 0.0005555152893066406 nb_pixel_total : 22823 time to create 1 rle with old method : 0.0376129150390625 length of segment : 140 time for calcul the mask position with numpy : 0.0014619827270507812 nb_pixel_total : 87674 time to create 1 rle with old method : 0.10085439682006836 length of segment : 536 time for calcul the mask position with numpy : 0.0010256767272949219 nb_pixel_total : 49970 time to create 1 rle with old method : 0.05720067024230957 length of segment : 374 time for calcul the mask position with numpy : 0.0010254383087158203 nb_pixel_total : 24291 time to create 1 rle with old method : 0.038626909255981445 length of segment : 298 time for calcul the mask position with numpy : 0.0003840923309326172 nb_pixel_total : 11449 time to create 1 rle with old method : 0.014195442199707031 length of segment : 135 time for calcul the mask position with numpy : 0.0002493858337402344 nb_pixel_total : 7904 time to create 1 rle with old method : 0.009708166122436523 length of segment : 113 time for calcul the mask position with numpy : 0.0007293224334716797 nb_pixel_total : 28018 time to create 1 rle with old method : 0.03352689743041992 length of segment : 237 time for calcul the mask position with numpy : 0.0011785030364990234 nb_pixel_total : 77060 time to create 1 rle with old method : 0.08953332901000977 length of segment : 318 time for calcul the mask position with numpy : 0.0003597736358642578 nb_pixel_total : 13472 time to create 1 rle with old method : 0.020359516143798828 length of segment : 127 time for calcul the mask position with numpy : 0.0010459423065185547 nb_pixel_total : 51950 time to create 1 rle with old method : 0.06691670417785645 length of segment : 299 time for calcul the mask position with numpy : 0.0004658699035644531 nb_pixel_total : 21339 time to create 1 rle with old method : 0.026157855987548828 length of segment : 125 time for calcul the mask position with numpy : 0.0007333755493164062 nb_pixel_total : 9611 time to create 1 rle with old method : 0.011020660400390625 length of segment : 151 time for calcul the mask position with numpy : 0.001882791519165039 nb_pixel_total : 39734 time to create 1 rle with old method : 0.06395816802978516 length of segment : 221 time for calcul the mask position with numpy : 0.0015578269958496094 nb_pixel_total : 26654 time to create 1 rle with old method : 0.03135538101196289 length of segment : 157 time for calcul the mask position with numpy : 0.005891323089599609 nb_pixel_total : 114410 time to create 1 rle with old method : 0.12988734245300293 length of segment : 604 time for calcul the mask position with numpy : 0.003164529800415039 nb_pixel_total : 40399 time to create 1 rle with old method : 0.04671001434326172 length of segment : 350 time for calcul the mask position with numpy : 0.0012297630310058594 nb_pixel_total : 12862 time to create 1 rle with old method : 0.0152130126953125 length of segment : 187 time for calcul the mask position with numpy : 0.0023674964904785156 nb_pixel_total : 27237 time to create 1 rle with old method : 0.040116071701049805 length of segment : 259 time for calcul the mask position with numpy : 0.004832744598388672 nb_pixel_total : 125480 time to create 1 rle with old method : 0.14490151405334473 length of segment : 459 time for calcul the mask position with numpy : 0.0025229454040527344 nb_pixel_total : 32293 time to create 1 rle with old method : 0.036881446838378906 length of segment : 464 time for calcul the mask position with numpy : 0.0013682842254638672 nb_pixel_total : 25284 time to create 1 rle with old method : 0.035427093505859375 length of segment : 371 time for calcul the mask position with numpy : 0.001291513442993164 nb_pixel_total : 31662 time to create 1 rle with old method : 0.038483381271362305 length of segment : 223 time for calcul the mask position with numpy : 0.0008842945098876953 nb_pixel_total : 12020 time to create 1 rle with old method : 0.01955890655517578 length of segment : 195 time for calcul the mask position with numpy : 0.005043506622314453 nb_pixel_total : 27030 time to create 1 rle with old method : 0.05178332328796387 length of segment : 448 time for calcul the mask position with numpy : 0.005345821380615234 nb_pixel_total : 66817 time to create 1 rle with old method : 0.12846112251281738 length of segment : 623 time for calcul the mask position with numpy : 0.0005078315734863281 nb_pixel_total : 10286 time to create 1 rle with old method : 0.011701107025146484 length of segment : 151 time for calcul the mask position with numpy : 0.0011641979217529297 nb_pixel_total : 29819 time to create 1 rle with old method : 0.03629183769226074 length of segment : 220 time for calcul the mask position with numpy : 0.006076812744140625 nb_pixel_total : 184841 time to create 1 rle with new method : 0.011162757873535156 length of segment : 603 time for calcul the mask position with numpy : 0.0009784698486328125 nb_pixel_total : 27739 time to create 1 rle with old method : 0.031341552734375 length of segment : 309 time for calcul the mask position with numpy : 0.0013506412506103516 nb_pixel_total : 15914 time to create 1 rle with old method : 0.028690576553344727 length of segment : 234 time for calcul the mask position with numpy : 0.00693964958190918 nb_pixel_total : 92780 time to create 1 rle with old method : 0.15642237663269043 length of segment : 617 time for calcul the mask position with numpy : 0.001764059066772461 nb_pixel_total : 25580 time to create 1 rle with old method : 0.031801462173461914 length of segment : 279 time for calcul the mask position with numpy : 0.0034923553466796875 nb_pixel_total : 68492 time to create 1 rle with old method : 0.08200263977050781 length of segment : 360 time for calcul the mask position with numpy : 0.0011501312255859375 nb_pixel_total : 7551 time to create 1 rle with old method : 0.009138345718383789 length of segment : 148 time for calcul the mask position with numpy : 0.0001842975616455078 nb_pixel_total : 6476 time to create 1 rle with old method : 0.007877111434936523 length of segment : 78 time for calcul the mask position with numpy : 0.007283926010131836 nb_pixel_total : 79382 time to create 1 rle with old method : 0.09168601036071777 length of segment : 609 time for calcul the mask position with numpy : 0.006350278854370117 nb_pixel_total : 171451 time to create 1 rle with new method : 0.008868932723999023 length of segment : 583 time for calcul the mask position with numpy : 0.002514362335205078 nb_pixel_total : 41291 time to create 1 rle with old method : 0.04813814163208008 length of segment : 447 time for calcul the mask position with numpy : 0.0007472038269042969 nb_pixel_total : 11958 time to create 1 rle with old method : 0.013880491256713867 length of segment : 164 time for calcul the mask position with numpy : 0.0007250308990478516 nb_pixel_total : 17143 time to create 1 rle with old method : 0.0218656063079834 length of segment : 96 time for calcul the mask position with numpy : 0.004160881042480469 nb_pixel_total : 48995 time to create 1 rle with old method : 0.05839705467224121 length of segment : 654 time for calcul the mask position with numpy : 0.0009338855743408203 nb_pixel_total : 23864 time to create 1 rle with old method : 0.02917194366455078 length of segment : 125 time for calcul the mask position with numpy : 0.0035986900329589844 nb_pixel_total : 96230 time to create 1 rle with old method : 0.11221885681152344 length of segment : 282 time for calcul the mask position with numpy : 0.0017342567443847656 nb_pixel_total : 26648 time to create 1 rle with old method : 0.043692588806152344 length of segment : 201 time for calcul the mask position with numpy : 0.0013399124145507812 nb_pixel_total : 29146 time to create 1 rle with old method : 0.0335698127746582 length of segment : 286 time for calcul the mask position with numpy : 0.0010800361633300781 nb_pixel_total : 17604 time to create 1 rle with old method : 0.021752357482910156 length of segment : 144 time for calcul the mask position with numpy : 0.0020110607147216797 nb_pixel_total : 30247 time to create 1 rle with old method : 0.035524845123291016 length of segment : 269 time for calcul the mask position with numpy : 0.001538991928100586 nb_pixel_total : 25143 time to create 1 rle with old method : 0.02873516082763672 length of segment : 218 time for calcul the mask position with numpy : 0.10489344596862793 nb_pixel_total : 1404313 time to create 1 rle with new method : 0.3517918586730957 length of segment : 1404 time for calcul the mask position with numpy : 0.003813505172729492 nb_pixel_total : 108701 time to create 1 rle with old method : 0.155534029006958 length of segment : 612 time for calcul the mask position with numpy : 0.0013909339904785156 nb_pixel_total : 26215 time to create 1 rle with old method : 0.033559322357177734 length of segment : 192 time for calcul the mask position with numpy : 0.002665996551513672 nb_pixel_total : 56365 time to create 1 rle with old method : 0.07281041145324707 length of segment : 253 time for calcul the mask position with numpy : 0.0014400482177734375 nb_pixel_total : 24538 time to create 1 rle with old method : 0.0324094295501709 length of segment : 207 time for calcul the mask position with numpy : 0.0009622573852539062 nb_pixel_total : 16567 time to create 1 rle with old method : 0.02183222770690918 length of segment : 252 time for calcul the mask position with numpy : 0.0009334087371826172 nb_pixel_total : 9836 time to create 1 rle with old method : 0.013716697692871094 length of segment : 130 time for calcul the mask position with numpy : 0.0007238388061523438 nb_pixel_total : 10600 time to create 1 rle with old method : 0.013373374938964844 length of segment : 175 time for calcul the mask position with numpy : 0.0018811225891113281 nb_pixel_total : 49279 time to create 1 rle with old method : 0.08135318756103516 length of segment : 275 time for calcul the mask position with numpy : 0.0019085407257080078 nb_pixel_total : 39674 time to create 1 rle with old method : 0.04470944404602051 length of segment : 306 time for calcul the mask position with numpy : 0.002491474151611328 nb_pixel_total : 51045 time to create 1 rle with old method : 0.0609438419342041 length of segment : 263 time for calcul the mask position with numpy : 0.0017108917236328125 nb_pixel_total : 29335 time to create 1 rle with old method : 0.03542900085449219 length of segment : 193 time for calcul the mask position with numpy : 0.0021445751190185547 nb_pixel_total : 42973 time to create 1 rle with old method : 0.052343130111694336 length of segment : 309 time for calcul the mask position with numpy : 0.0009791851043701172 nb_pixel_total : 17458 time to create 1 rle with old method : 0.023291587829589844 length of segment : 157 time for calcul the mask position with numpy : 0.003398895263671875 nb_pixel_total : 54935 time to create 1 rle with old method : 0.09263873100280762 length of segment : 448 time for calcul the mask position with numpy : 0.002592325210571289 nb_pixel_total : 41568 time to create 1 rle with old method : 0.04779815673828125 length of segment : 277 time for calcul the mask position with numpy : 0.0018658638000488281 nb_pixel_total : 42319 time to create 1 rle with old method : 0.053250789642333984 length of segment : 225 time for calcul the mask position with numpy : 0.0008332729339599609 nb_pixel_total : 15128 time to create 1 rle with old method : 0.01742696762084961 length of segment : 142 time for calcul the mask position with numpy : 0.0015904903411865234 nb_pixel_total : 28730 time to create 1 rle with old method : 0.045632123947143555 length of segment : 213 time for calcul the mask position with numpy : 0.0009529590606689453 nb_pixel_total : 23234 time to create 1 rle with old method : 0.030190229415893555 length of segment : 154 time for calcul the mask position with numpy : 0.001245737075805664 nb_pixel_total : 37408 time to create 1 rle with old method : 0.04466724395751953 length of segment : 127 time for calcul the mask position with numpy : 0.010622501373291016 nb_pixel_total : 180881 time to create 1 rle with new method : 0.013101816177368164 length of segment : 929 time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 12942 time to create 1 rle with old method : 0.015259504318237305 length of segment : 122 time for calcul the mask position with numpy : 0.00435185432434082 nb_pixel_total : 108118 time to create 1 rle with old method : 0.12950372695922852 length of segment : 405 time for calcul the mask position with numpy : 0.0011265277862548828 nb_pixel_total : 23833 time to create 1 rle with old method : 0.03140902519226074 length of segment : 152 time for calcul the mask position with numpy : 0.0017313957214355469 nb_pixel_total : 33140 time to create 1 rle with old method : 0.04189753532409668 length of segment : 249 time for calcul the mask position with numpy : 0.0025060176849365234 nb_pixel_total : 78436 time to create 1 rle with old method : 0.09402799606323242 length of segment : 304 time for calcul the mask position with numpy : 0.002331972122192383 nb_pixel_total : 67598 time to create 1 rle with old method : 0.07950592041015625 length of segment : 287 time for calcul the mask position with numpy : 0.0015714168548583984 nb_pixel_total : 26089 time to create 1 rle with old method : 0.030690670013427734 length of segment : 220 time for calcul the mask position with numpy : 0.0014181137084960938 nb_pixel_total : 15585 time to create 1 rle with old method : 0.018621206283569336 length of segment : 208 time for calcul the mask position with numpy : 0.002186298370361328 nb_pixel_total : 26697 time to create 1 rle with old method : 0.033557891845703125 length of segment : 285 time for calcul the mask position with numpy : 0.0005819797515869141 nb_pixel_total : 11143 time to create 1 rle with old method : 0.013561487197875977 length of segment : 150 time for calcul the mask position with numpy : 0.002041339874267578 nb_pixel_total : 38007 time to create 1 rle with old method : 0.043361663818359375 length of segment : 408 time for calcul the mask position with numpy : 0.0006582736968994141 nb_pixel_total : 14362 time to create 1 rle with old method : 0.016913652420043945 length of segment : 175 time for calcul the mask position with numpy : 0.004639148712158203 nb_pixel_total : 53101 time to create 1 rle with old method : 0.06227540969848633 length of segment : 349 time for calcul the mask position with numpy : 0.0033783912658691406 nb_pixel_total : 42565 time to create 1 rle with old method : 0.052167654037475586 length of segment : 481 time for calcul the mask position with numpy : 0.00033354759216308594 nb_pixel_total : 4618 time to create 1 rle with old method : 0.005582571029663086 length of segment : 78 time for calcul the mask position with numpy : 0.0004162788391113281 nb_pixel_total : 10136 time to create 1 rle with old method : 0.011811256408691406 length of segment : 149 time for calcul the mask position with numpy : 0.0018246173858642578 nb_pixel_total : 55266 time to create 1 rle with old method : 0.06774640083312988 length of segment : 675 time for calcul the mask position with numpy : 0.0013587474822998047 nb_pixel_total : 43743 time to create 1 rle with old method : 0.0518186092376709 length of segment : 334 time for calcul the mask position with numpy : 0.007330179214477539 nb_pixel_total : 135181 time to create 1 rle with old method : 0.17136526107788086 length of segment : 658 time for calcul the mask position with numpy : 0.0015020370483398438 nb_pixel_total : 28173 time to create 1 rle with old method : 0.033750295639038086 length of segment : 252 time for calcul the mask position with numpy : 0.0015611648559570312 nb_pixel_total : 30492 time to create 1 rle with old method : 0.035143375396728516 length of segment : 431 time for calcul the mask position with numpy : 0.0007336139678955078 nb_pixel_total : 11085 time to create 1 rle with old method : 0.013512134552001953 length of segment : 139 time for calcul the mask position with numpy : 0.0003726482391357422 nb_pixel_total : 10214 time to create 1 rle with old method : 0.012110710144042969 length of segment : 166 time for calcul the mask position with numpy : 0.0004525184631347656 nb_pixel_total : 8401 time to create 1 rle with old method : 0.010043144226074219 length of segment : 107 time for calcul the mask position with numpy : 0.0007860660552978516 nb_pixel_total : 13984 time to create 1 rle with old method : 0.016304969787597656 length of segment : 177 time for calcul the mask position with numpy : 0.00046324729919433594 nb_pixel_total : 8726 time to create 1 rle with old method : 0.010298728942871094 length of segment : 109 time for calcul the mask position with numpy : 0.001744985580444336 nb_pixel_total : 44541 time to create 1 rle with old method : 0.05058693885803223 length of segment : 314 time for calcul the mask position with numpy : 0.0007123947143554688 nb_pixel_total : 16298 time to create 1 rle with old method : 0.018215179443359375 length of segment : 148 time for calcul the mask position with numpy : 0.006635427474975586 nb_pixel_total : 171022 time to create 1 rle with new method : 0.009947776794433594 length of segment : 755 time for calcul the mask position with numpy : 0.0007238388061523438 nb_pixel_total : 16012 time to create 1 rle with old method : 0.018447160720825195 length of segment : 219 time for calcul the mask position with numpy : 0.0008482933044433594 nb_pixel_total : 9865 time to create 1 rle with old method : 0.011722326278686523 length of segment : 182 time for calcul the mask position with numpy : 0.0014111995697021484 nb_pixel_total : 34925 time to create 1 rle with old method : 0.04276442527770996 length of segment : 171 time for calcul the mask position with numpy : 0.0009365081787109375 nb_pixel_total : 18363 time to create 1 rle with old method : 0.021945476531982422 length of segment : 226 time for calcul the mask position with numpy : 0.0036325454711914062 nb_pixel_total : 113245 time to create 1 rle with old method : 0.16108441352844238 length of segment : 392 time for calcul the mask position with numpy : 0.002399444580078125 nb_pixel_total : 32023 time to create 1 rle with old method : 0.06113171577453613 length of segment : 265 time for calcul the mask position with numpy : 0.0003688335418701172 nb_pixel_total : 12513 time to create 1 rle with old method : 0.01664590835571289 length of segment : 176 time for calcul the mask position with numpy : 0.0011937618255615234 nb_pixel_total : 34798 time to create 1 rle with old method : 0.04386496543884277 length of segment : 314 time for calcul the mask position with numpy : 0.0034377574920654297 nb_pixel_total : 37979 time to create 1 rle with old method : 0.05172586441040039 length of segment : 254 time for calcul the mask position with numpy : 0.0013005733489990234 nb_pixel_total : 25709 time to create 1 rle with old method : 0.031028032302856445 length of segment : 139 time for calcul the mask position with numpy : 0.001188039779663086 nb_pixel_total : 15272 time to create 1 rle with old method : 0.02691793441772461 length of segment : 202 time for calcul the mask position with numpy : 0.0013816356658935547 nb_pixel_total : 33328 time to create 1 rle with old method : 0.049382686614990234 length of segment : 203 time for calcul the mask position with numpy : 0.0009145736694335938 nb_pixel_total : 49180 time to create 1 rle with old method : 0.05681729316711426 length of segment : 236 time for calcul the mask position with numpy : 0.0007860660552978516 nb_pixel_total : 22712 time to create 1 rle with old method : 0.025998353958129883 length of segment : 187 time for calcul the mask position with numpy : 0.0009541511535644531 nb_pixel_total : 17089 time to create 1 rle with old method : 0.0200042724609375 length of segment : 175 time for calcul the mask position with numpy : 0.002432584762573242 nb_pixel_total : 75734 time to create 1 rle with old method : 0.09000730514526367 length of segment : 357 time for calcul the mask position with numpy : 0.0007405281066894531 nb_pixel_total : 34317 time to create 1 rle with old method : 0.040204763412475586 length of segment : 185 time for calcul the mask position with numpy : 0.0006647109985351562 nb_pixel_total : 23007 time to create 1 rle with old method : 0.027202129364013672 length of segment : 142 time for calcul the mask position with numpy : 0.0005242824554443359 nb_pixel_total : 16974 time to create 1 rle with old method : 0.019545555114746094 length of segment : 156 time for calcul the mask position with numpy : 0.0009551048278808594 nb_pixel_total : 25575 time to create 1 rle with old method : 0.029430627822875977 length of segment : 207 time for calcul the mask position with numpy : 0.0030934810638427734 nb_pixel_total : 59017 time to create 1 rle with old method : 0.0672156810760498 length of segment : 444 time for calcul the mask position with numpy : 0.0012660026550292969 nb_pixel_total : 45275 time to create 1 rle with old method : 0.05269479751586914 length of segment : 257 time for calcul the mask position with numpy : 0.0007381439208984375 nb_pixel_total : 24945 time to create 1 rle with old method : 0.02829909324645996 length of segment : 196 time for calcul the mask position with numpy : 0.0008559226989746094 nb_pixel_total : 21250 time to create 1 rle with old method : 0.03185606002807617 length of segment : 200 time for calcul the mask position with numpy : 0.0016138553619384766 nb_pixel_total : 49213 time to create 1 rle with old method : 0.05950188636779785 length of segment : 422 time for calcul the mask position with numpy : 0.0014164447784423828 nb_pixel_total : 34142 time to create 1 rle with old method : 0.04012274742126465 length of segment : 215 time for calcul the mask position with numpy : 0.0015032291412353516 nb_pixel_total : 51668 time to create 1 rle with old method : 0.06979489326477051 length of segment : 287 time for calcul the mask position with numpy : 0.006014108657836914 nb_pixel_total : 136360 time to create 1 rle with old method : 0.2087247371673584 length of segment : 504 time for calcul the mask position with numpy : 0.001688241958618164 nb_pixel_total : 40976 time to create 1 rle with old method : 0.04828310012817383 length of segment : 168 time for calcul the mask position with numpy : 0.0010111331939697266 nb_pixel_total : 20611 time to create 1 rle with old method : 0.02383732795715332 length of segment : 160 time for calcul the mask position with numpy : 0.0019192695617675781 nb_pixel_total : 38886 time to create 1 rle with old method : 0.06987452507019043 length of segment : 198 time for calcul the mask position with numpy : 0.00573420524597168 nb_pixel_total : 73295 time to create 1 rle with old method : 0.10813546180725098 length of segment : 355 time for calcul the mask position with numpy : 0.0008370876312255859 nb_pixel_total : 11850 time to create 1 rle with old method : 0.013735055923461914 length of segment : 205 time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 9266 time to create 1 rle with old method : 0.01077723503112793 length of segment : 121 time for calcul the mask position with numpy : 0.0007266998291015625 nb_pixel_total : 20123 time to create 1 rle with old method : 0.02379631996154785 length of segment : 146 time for calcul the mask position with numpy : 0.0004782676696777344 nb_pixel_total : 3653 time to create 1 rle with old method : 0.005973339080810547 length of segment : 96 time for calcul the mask position with numpy : 0.0019223690032958984 nb_pixel_total : 32843 time to create 1 rle with old method : 0.044530391693115234 length of segment : 247 time for calcul the mask position with numpy : 0.001096487045288086 nb_pixel_total : 19705 time to create 1 rle with old method : 0.025706052780151367 length of segment : 184 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 2813 time to create 1 rle with old method : 0.0033311843872070312 length of segment : 106 time for calcul the mask position with numpy : 0.0016937255859375 nb_pixel_total : 39426 time to create 1 rle with old method : 0.04603934288024902 length of segment : 216 time for calcul the mask position with numpy : 0.0006914138793945312 nb_pixel_total : 13762 time to create 1 rle with old method : 0.016105175018310547 length of segment : 149 time for calcul the mask position with numpy : 0.002162933349609375 nb_pixel_total : 61290 time to create 1 rle with old method : 0.10573172569274902 length of segment : 310 time for calcul the mask position with numpy : 0.001234292984008789 nb_pixel_total : 21729 time to create 1 rle with old method : 0.03970670700073242 length of segment : 245 time for calcul the mask position with numpy : 0.0010192394256591797 nb_pixel_total : 26181 time to create 1 rle with old method : 0.030368328094482422 length of segment : 165 time for calcul the mask position with numpy : 0.001703023910522461 nb_pixel_total : 39545 time to create 1 rle with old method : 0.0633554458618164 length of segment : 255 time for calcul the mask position with numpy : 0.002221822738647461 nb_pixel_total : 43756 time to create 1 rle with old method : 0.05052495002746582 length of segment : 302 time for calcul the mask position with numpy : 0.0004487037658691406 nb_pixel_total : 11264 time to create 1 rle with old method : 0.013202905654907227 length of segment : 94 time for calcul the mask position with numpy : 0.002426624298095703 nb_pixel_total : 97476 time to create 1 rle with old method : 0.11417841911315918 length of segment : 502 time for calcul the mask position with numpy : 0.0006892681121826172 nb_pixel_total : 31782 time to create 1 rle with old method : 0.038773298263549805 length of segment : 304 time for calcul the mask position with numpy : 0.0007345676422119141 nb_pixel_total : 17346 time to create 1 rle with old method : 0.021350383758544922 length of segment : 110 time for calcul the mask position with numpy : 0.0005805492401123047 nb_pixel_total : 19433 time to create 1 rle with old method : 0.02390766143798828 length of segment : 152 time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 9125 time to create 1 rle with old method : 0.010829925537109375 length of segment : 88 time for calcul the mask position with numpy : 0.00036406517028808594 nb_pixel_total : 7065 time to create 1 rle with old method : 0.009604692459106445 length of segment : 111 time for calcul the mask position with numpy : 0.0010783672332763672 nb_pixel_total : 29856 time to create 1 rle with old method : 0.03882193565368652 length of segment : 327 time for calcul the mask position with numpy : 0.00025391578674316406 nb_pixel_total : 12857 time to create 1 rle with old method : 0.017527103424072266 length of segment : 143 time for calcul the mask position with numpy : 0.282012939453125 nb_pixel_total : 3676562 time to create 1 rle with new method : 0.6447129249572754 length of segment : 2643 time spent for convertir_results : 19.19005250930786 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 168 chid ids of type : 3594 Number RLEs to save : 50946 save missing photos in datou_result : time spend for datou_step_exec : 104.11126971244812 time spend to save output : 3.1868302822113037 total time spend for step 1 : 107.29809999465942 step2:crop_condition Thu Apr 3 10:52:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 168 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 127 About to insert : list_path_to_insert length 127 new photo from crops ! About to upload 127 photos upload in portfolio : 3736932 init cache_photo without model_param we have 127 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743670398_2998039 we have uploaded 127 photos in the portfolio 3736932 time of upload the photos Elapsed time : 33.14391803741455 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743670436_2998039 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.739243030548096 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743670443_2998039 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7212471961975098 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743670467_2998039 we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.797233819961548 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743670476_2998039 we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.304859161376953 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1349750331, 1349750328, 1349750310, 1349750278, 1349750209, 1349750207, 1349750200, 1349750197, 1349750185] Looping around the photos to save general results len do output : 168 /1349782963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349782998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349783338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750331', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750328', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750310', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750278', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750209', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750207', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750200', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750197', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750185', None, None, None, None, None, '2720210') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 513 time used for this insertion : 0.03201436996459961 save_final save missing photos in datou_result : time spend for datou_step_exec : 117.3360710144043 time spend to save output : 0.03718066215515137 total time spend for step 2 : 117.37325167655945 step3:rle_unique_nms_with_priority Thu Apr 3 10:54:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 168 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 6.280785083770752 time for calcul the mask position with numpy : 0.8381242752075195 nb_pixel_total : 7243450 time to create 1 rle with new method : 0.7377502918243408 time for calcul the mask position with numpy : 0.03062152862548828 nb_pixel_total : 521276 time to create 1 rle with new method : 0.9535093307495117 time for calcul the mask position with numpy : 0.03060007095336914 nb_pixel_total : 66016 time to create 1 rle with old method : 0.07828545570373535 time for calcul the mask position with numpy : 0.027983427047729492 nb_pixel_total : 25954 time to create 1 rle with old method : 0.028780698776245117 time for calcul the mask position with numpy : 0.03749537467956543 nb_pixel_total : 55088 time to create 1 rle with old method : 0.06256413459777832 time for calcul the mask position with numpy : 0.046170711517333984 nb_pixel_total : 19747 time to create 1 rle with old method : 0.02182173728942871 time for calcul the mask position with numpy : 0.04102730751037598 nb_pixel_total : 60166 time to create 1 rle with old method : 0.07166886329650879 time for calcul the mask position with numpy : 0.04444551467895508 nb_pixel_total : 115115 time to create 1 rle with old method : 0.1475059986114502 time for calcul the mask position with numpy : 0.06015181541442871 nb_pixel_total : 23372 time to create 1 rle with old method : 0.043402910232543945 time for calcul the mask position with numpy : 0.03930234909057617 nb_pixel_total : 12150 time to create 1 rle with old method : 0.01678919792175293 time for calcul the mask position with numpy : 0.02638101577758789 nb_pixel_total : 41805 time to create 1 rle with old method : 0.05439448356628418 time for calcul the mask position with numpy : 0.028328895568847656 nb_pixel_total : 95860 time to create 1 rle with old method : 0.10852456092834473 time for calcul the mask position with numpy : 0.03285360336303711 nb_pixel_total : 14401 time to create 1 rle with old method : 0.017122507095336914 create new chi : 3.693446397781372 time to delete rle : 0.022034406661987305 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 12345 TO DO : save crop sub photo not yet done ! save time : 1.3429296016693115 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 7.112153053283691 time for calcul the mask position with numpy : 0.9267926216125488 nb_pixel_total : 7688080 time to create 1 rle with new method : 0.9171123504638672 time for calcul the mask position with numpy : 0.04108738899230957 nb_pixel_total : 21339 time to create 1 rle with old method : 0.02363276481628418 time for calcul the mask position with numpy : 0.043488502502441406 nb_pixel_total : 51950 time to create 1 rle with old method : 0.06541585922241211 time for calcul the mask position with numpy : 0.04391956329345703 nb_pixel_total : 13472 time to create 1 rle with old method : 0.014587879180908203 time for calcul the mask position with numpy : 0.04190421104431152 nb_pixel_total : 77060 time to create 1 rle with old method : 0.08292603492736816 time for calcul the mask position with numpy : 0.03982853889465332 nb_pixel_total : 28018 time to create 1 rle with old method : 0.0297091007232666 time for calcul the mask position with numpy : 0.04347372055053711 nb_pixel_total : 7904 time to create 1 rle with old method : 0.008675813674926758 time for calcul the mask position with numpy : 0.0410311222076416 nb_pixel_total : 11449 time to create 1 rle with old method : 0.012472867965698242 time for calcul the mask position with numpy : 0.03538155555725098 nb_pixel_total : 24291 time to create 1 rle with old method : 0.026378154754638672 time for calcul the mask position with numpy : 0.026546001434326172 nb_pixel_total : 49970 time to create 1 rle with old method : 0.05402636528015137 time for calcul the mask position with numpy : 0.02833080291748047 nb_pixel_total : 87674 time to create 1 rle with old method : 0.09565448760986328 time for calcul the mask position with numpy : 0.02660059928894043 nb_pixel_total : 22823 time to create 1 rle with old method : 0.02602243423461914 time for calcul the mask position with numpy : 0.028090715408325195 nb_pixel_total : 210370 time to create 1 rle with new method : 0.6960504055023193 create new chi : 3.49481463432312 time to delete rle : 0.0015637874603271484 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8914 TO DO : save crop sub photo not yet done ! save time : 0.6081874370574951 nb_obj : 27 nb_hashtags : 3 time to prepare the origin masks : 4.785150527954102 time for calcul the mask position with numpy : 0.9822466373443604 nb_pixel_total : 6991979 time to create 1 rle with new method : 1.2305231094360352 time for calcul the mask position with numpy : 0.03416109085083008 nb_pixel_total : 29819 time to create 1 rle with old method : 0.0336301326751709 time for calcul the mask position with numpy : 0.040418386459350586 nb_pixel_total : 41291 time to create 1 rle with old method : 0.060173749923706055 time for calcul the mask position with numpy : 0.034442901611328125 nb_pixel_total : 15914 time to create 1 rle with old method : 0.01761937141418457 time for calcul the mask position with numpy : 0.03453516960144043 nb_pixel_total : 68492 time to create 1 rle with old method : 0.07465410232543945 time for calcul the mask position with numpy : 0.03384852409362793 nb_pixel_total : 12862 time to create 1 rle with old method : 0.014192819595336914 time for calcul the mask position with numpy : 0.03438282012939453 nb_pixel_total : 31456 time to create 1 rle with old method : 0.050362348556518555 time for calcul the mask position with numpy : 0.038902997970581055 nb_pixel_total : 125480 time to create 1 rle with old method : 0.13637781143188477 time for calcul the mask position with numpy : 0.03422856330871582 nb_pixel_total : 171451 time to create 1 rle with new method : 0.9736816883087158 time for calcul the mask position with numpy : 0.03422832489013672 nb_pixel_total : 26654 time to create 1 rle with old method : 0.03163576126098633 time for calcul the mask position with numpy : 0.035144805908203125 nb_pixel_total : 25580 time to create 1 rle with old method : 0.04136538505554199 time for calcul the mask position with numpy : 0.03834056854248047 nb_pixel_total : 25284 time to create 1 rle with old method : 0.029746294021606445 time for calcul the mask position with numpy : 0.035298824310302734 nb_pixel_total : 7549 time to create 1 rle with old method : 0.008507013320922852 time for calcul the mask position with numpy : 0.03412318229675293 nb_pixel_total : 27030 time to create 1 rle with old method : 0.030948638916015625 time for calcul the mask position with numpy : 0.04043388366699219 nb_pixel_total : 27237 time to create 1 rle with old method : 0.03212285041809082 time for calcul the mask position with numpy : 0.03619670867919922 nb_pixel_total : 184841 time to create 1 rle with new method : 0.8011198043823242 time for calcul the mask position with numpy : 0.03358578681945801 nb_pixel_total : 40399 time to create 1 rle with old method : 0.04536294937133789 time for calcul the mask position with numpy : 0.03454875946044922 nb_pixel_total : 12020 time to create 1 rle with old method : 0.01360774040222168 time for calcul the mask position with numpy : 0.034410953521728516 nb_pixel_total : 62297 time to create 1 rle with old method : 0.06911587715148926 time for calcul the mask position with numpy : 0.03315448760986328 nb_pixel_total : 3589 time to create 1 rle with old method : 0.003934144973754883 time for calcul the mask position with numpy : 0.0338594913482666 nb_pixel_total : 9611 time to create 1 rle with old method : 0.010484695434570312 time for calcul the mask position with numpy : 0.033475637435913086 nb_pixel_total : 66817 time to create 1 rle with old method : 0.07226729393005371 time for calcul the mask position with numpy : 0.03406858444213867 nb_pixel_total : 31662 time to create 1 rle with old method : 0.03449440002441406 time for calcul the mask position with numpy : 0.033531904220581055 nb_pixel_total : 114410 time to create 1 rle with old method : 0.12021899223327637 time for calcul the mask position with numpy : 0.03377819061279297 nb_pixel_total : 89413 time to create 1 rle with old method : 0.09685325622558594 time for calcul the mask position with numpy : 0.03340744972229004 nb_pixel_total : 5053 time to create 1 rle with old method : 0.005835771560668945 time for calcul the mask position with numpy : 0.03434944152832031 nb_pixel_total : 39734 time to create 1 rle with old method : 0.04404854774475098 time for calcul the mask position with numpy : 0.03454875946044922 nb_pixel_total : 6476 time to create 1 rle with old method : 0.007189273834228516 create new chi : 6.116276741027832 time to delete rle : 0.003433704376220703 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19938 TO DO : save crop sub photo not yet done ! save time : 1.494288444519043 nb_obj : 25 nb_hashtags : 4 time to prepare the origin masks : 5.1925437450408936 time for calcul the mask position with numpy : 0.4308304786682129 nb_pixel_total : 6138846 time to create 1 rle with new method : 0.9057087898254395 time for calcul the mask position with numpy : 0.03432440757751465 nb_pixel_total : 10600 time to create 1 rle with old method : 0.01195526123046875 time for calcul the mask position with numpy : 0.03585100173950195 nb_pixel_total : 51045 time to create 1 rle with old method : 0.08052849769592285 time for calcul the mask position with numpy : 0.03702712059020996 nb_pixel_total : 11958 time to create 1 rle with old method : 0.013247251510620117 time for calcul the mask position with numpy : 0.03407740592956543 nb_pixel_total : 29335 time to create 1 rle with old method : 0.0322728157043457 time for calcul the mask position with numpy : 0.036347389221191406 nb_pixel_total : 42973 time to create 1 rle with old method : 0.06607198715209961 time for calcul the mask position with numpy : 0.034523963928222656 nb_pixel_total : 56365 time to create 1 rle with old method : 0.06819558143615723 time for calcul the mask position with numpy : 0.0373530387878418 nb_pixel_total : 54935 time to create 1 rle with old method : 0.06395220756530762 time for calcul the mask position with numpy : 0.03625988960266113 nb_pixel_total : 9836 time to create 1 rle with old method : 0.012887239456176758 time for calcul the mask position with numpy : 0.035218000411987305 nb_pixel_total : 22375 time to create 1 rle with old method : 0.025009632110595703 time for calcul the mask position with numpy : 0.04673194885253906 nb_pixel_total : 1326172 time to create 1 rle with new method : 0.7340097427368164 time for calcul the mask position with numpy : 0.03579068183898926 nb_pixel_total : 17604 time to create 1 rle with old method : 0.019030094146728516 time for calcul the mask position with numpy : 0.033112525939941406 nb_pixel_total : 25143 time to create 1 rle with old method : 0.02764105796813965 time for calcul the mask position with numpy : 0.0344696044921875 nb_pixel_total : 96230 time to create 1 rle with old method : 0.11233234405517578 time for calcul the mask position with numpy : 0.034462690353393555 nb_pixel_total : 24538 time to create 1 rle with old method : 0.02744317054748535 time for calcul the mask position with numpy : 0.034714460372924805 nb_pixel_total : 48995 time to create 1 rle with old method : 0.054589033126831055 time for calcul the mask position with numpy : 0.03726339340209961 nb_pixel_total : 29146 time to create 1 rle with old method : 0.03261971473693848 time for calcul the mask position with numpy : 0.034700870513916016 nb_pixel_total : 26215 time to create 1 rle with old method : 0.029536008834838867 time for calcul the mask position with numpy : 0.03570866584777832 nb_pixel_total : 26648 time to create 1 rle with old method : 0.03010106086730957 time for calcul the mask position with numpy : 0.0343930721282959 nb_pixel_total : 108629 time to create 1 rle with old method : 0.1343698501586914 time for calcul the mask position with numpy : 0.03434276580810547 nb_pixel_total : 16567 time to create 1 rle with old method : 0.018506288528442383 time for calcul the mask position with numpy : 0.03593158721923828 nb_pixel_total : 30247 time to create 1 rle with old method : 0.03685617446899414 time for calcul the mask position with numpy : 0.03754568099975586 nb_pixel_total : 41568 time to create 1 rle with old method : 0.04694652557373047 time for calcul the mask position with numpy : 0.03438091278076172 nb_pixel_total : 7423 time to create 1 rle with old method : 0.008495807647705078 time for calcul the mask position with numpy : 0.03565216064453125 nb_pixel_total : 23864 time to create 1 rle with old method : 0.026628971099853516 time for calcul the mask position with numpy : 0.03439474105834961 nb_pixel_total : 17143 time to create 1 rle with old method : 0.0196990966796875 create new chi : 4.037312746047974 time to delete rle : 0.00307464599609375 batch 1 Loaded 52 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 16880 TO DO : save crop sub photo not yet done ! save time : 1.0057082176208496 nb_obj : 24 nb_hashtags : 4 time to prepare the origin masks : 15.582155227661133 time for calcul the mask position with numpy : 0.6176466941833496 nb_pixel_total : 7306018 time to create 1 rle with new method : 0.5976266860961914 time for calcul the mask position with numpy : 0.04915642738342285 nb_pixel_total : 43698 time to create 1 rle with old method : 0.048895835876464844 time for calcul the mask position with numpy : 0.0510859489440918 nb_pixel_total : 50703 time to create 1 rle with old method : 0.060864925384521484 time for calcul the mask position with numpy : 0.049115896224975586 nb_pixel_total : 10047 time to create 1 rle with old method : 0.011184215545654297 time for calcul the mask position with numpy : 0.04385066032409668 nb_pixel_total : 4618 time to create 1 rle with old method : 0.005494356155395508 time for calcul the mask position with numpy : 0.04455089569091797 nb_pixel_total : 42565 time to create 1 rle with old method : 0.04999971389770508 time for calcul the mask position with numpy : 0.05540323257446289 nb_pixel_total : 53101 time to create 1 rle with old method : 0.08344578742980957 time for calcul the mask position with numpy : 0.0432126522064209 nb_pixel_total : 14362 time to create 1 rle with old method : 0.015454292297363281 time for calcul the mask position with numpy : 0.039098262786865234 nb_pixel_total : 38007 time to create 1 rle with old method : 0.04182243347167969 time for calcul the mask position with numpy : 0.027875185012817383 nb_pixel_total : 11143 time to create 1 rle with old method : 0.012495279312133789 time for calcul the mask position with numpy : 0.02767491340637207 nb_pixel_total : 26697 time to create 1 rle with old method : 0.029676198959350586 time for calcul the mask position with numpy : 0.026630401611328125 nb_pixel_total : 15585 time to create 1 rle with old method : 0.017226696014404297 time for calcul the mask position with numpy : 0.02492237091064453 nb_pixel_total : 26089 time to create 1 rle with old method : 0.0285036563873291 time for calcul the mask position with numpy : 0.026125669479370117 nb_pixel_total : 67598 time to create 1 rle with old method : 0.0914146900177002 time for calcul the mask position with numpy : 0.031341552734375 nb_pixel_total : 78436 time to create 1 rle with old method : 0.08795380592346191 time for calcul the mask position with numpy : 0.02753901481628418 nb_pixel_total : 33140 time to create 1 rle with old method : 0.03662681579589844 time for calcul the mask position with numpy : 0.02830791473388672 nb_pixel_total : 23833 time to create 1 rle with old method : 0.0266420841217041 time for calcul the mask position with numpy : 0.02807760238647461 nb_pixel_total : 108118 time to create 1 rle with old method : 0.12159037590026855 time for calcul the mask position with numpy : 0.028258323669433594 nb_pixel_total : 12942 time to create 1 rle with old method : 0.014571189880371094 time for calcul the mask position with numpy : 0.02754831314086914 nb_pixel_total : 180881 time to create 1 rle with new method : 0.6453258991241455 time for calcul the mask position with numpy : 0.038344621658325195 nb_pixel_total : 37408 time to create 1 rle with old method : 0.06078624725341797 time for calcul the mask position with numpy : 0.053090572357177734 nb_pixel_total : 23234 time to create 1 rle with old method : 0.025887727737426758 time for calcul the mask position with numpy : 0.04367208480834961 nb_pixel_total : 28730 time to create 1 rle with old method : 0.03174138069152832 time for calcul the mask position with numpy : 0.04351520538330078 nb_pixel_total : 15128 time to create 1 rle with old method : 0.01749110221862793 time for calcul the mask position with numpy : 0.041717529296875 nb_pixel_total : 42319 time to create 1 rle with old method : 0.05123019218444824 create new chi : 3.809816360473633 time to delete rle : 0.0027871131896972656 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15543 TO DO : save crop sub photo not yet done ! save time : 0.9529483318328857 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 10.318509817123413 time for calcul the mask position with numpy : 0.41031694412231445 nb_pixel_total : 7548725 time to create 1 rle with new method : 2.0710067749023438 time for calcul the mask position with numpy : 0.05018901824951172 nb_pixel_total : 34798 time to create 1 rle with old method : 0.04258370399475098 time for calcul the mask position with numpy : 0.04430270195007324 nb_pixel_total : 10539 time to create 1 rle with old method : 0.013623476028442383 time for calcul the mask position with numpy : 0.049368858337402344 nb_pixel_total : 32023 time to create 1 rle with old method : 0.03725171089172363 time for calcul the mask position with numpy : 0.04677438735961914 nb_pixel_total : 113245 time to create 1 rle with old method : 0.14097046852111816 time for calcul the mask position with numpy : 0.04335474967956543 nb_pixel_total : 18363 time to create 1 rle with old method : 0.021562814712524414 time for calcul the mask position with numpy : 0.04342389106750488 nb_pixel_total : 34925 time to create 1 rle with old method : 0.03824925422668457 time for calcul the mask position with numpy : 0.043614864349365234 nb_pixel_total : 9865 time to create 1 rle with old method : 0.013647794723510742 time for calcul the mask position with numpy : 0.04693889617919922 nb_pixel_total : 16012 time to create 1 rle with old method : 0.018634796142578125 time for calcul the mask position with numpy : 0.04562950134277344 nb_pixel_total : 171022 time to create 1 rle with new method : 1.7202658653259277 time for calcul the mask position with numpy : 0.03079962730407715 nb_pixel_total : 16298 time to create 1 rle with old method : 0.017940044403076172 time for calcul the mask position with numpy : 0.031490325927734375 nb_pixel_total : 44541 time to create 1 rle with old method : 0.052938222885131836 time for calcul the mask position with numpy : 0.02834177017211914 nb_pixel_total : 8726 time to create 1 rle with old method : 0.014357566833496094 time for calcul the mask position with numpy : 0.032990455627441406 nb_pixel_total : 13984 time to create 1 rle with old method : 0.02346181869506836 time for calcul the mask position with numpy : 0.03246927261352539 nb_pixel_total : 8401 time to create 1 rle with old method : 0.00948643684387207 time for calcul the mask position with numpy : 0.032073974609375 nb_pixel_total : 8002 time to create 1 rle with old method : 0.011098146438598633 time for calcul the mask position with numpy : 0.03605198860168457 nb_pixel_total : 11085 time to create 1 rle with old method : 0.01239633560180664 time for calcul the mask position with numpy : 0.03386378288269043 nb_pixel_total : 30492 time to create 1 rle with old method : 0.03437232971191406 time for calcul the mask position with numpy : 0.03422117233276367 nb_pixel_total : 28173 time to create 1 rle with old method : 0.03130936622619629 time for calcul the mask position with numpy : 0.04418683052062988 nb_pixel_total : 135181 time to create 1 rle with old method : 0.15349626541137695 create new chi : 5.726499080657959 time to delete rle : 0.003127574920654297 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 12410 TO DO : save crop sub photo not yet done ! save time : 1.0468969345092773 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 11.156887769699097 time for calcul the mask position with numpy : 0.6469666957855225 nb_pixel_total : 7717824 time to create 1 rle with new method : 1.127716302871704 time for calcul the mask position with numpy : 0.044057607650756836 nb_pixel_total : 49213 time to create 1 rle with old method : 0.058583736419677734 time for calcul the mask position with numpy : 0.045122385025024414 nb_pixel_total : 21250 time to create 1 rle with old method : 0.025443315505981445 time for calcul the mask position with numpy : 0.046131134033203125 nb_pixel_total : 24945 time to create 1 rle with old method : 0.04024171829223633 time for calcul the mask position with numpy : 0.0496063232421875 nb_pixel_total : 45275 time to create 1 rle with old method : 0.05356860160827637 time for calcul the mask position with numpy : 0.0453338623046875 nb_pixel_total : 59017 time to create 1 rle with old method : 0.07151007652282715 time for calcul the mask position with numpy : 0.04346585273742676 nb_pixel_total : 25575 time to create 1 rle with old method : 0.02939605712890625 time for calcul the mask position with numpy : 0.04195904731750488 nb_pixel_total : 16974 time to create 1 rle with old method : 0.01974964141845703 time for calcul the mask position with numpy : 0.046506404876708984 nb_pixel_total : 23007 time to create 1 rle with old method : 0.026723861694335938 time for calcul the mask position with numpy : 0.04872941970825195 nb_pixel_total : 34317 time to create 1 rle with old method : 0.03996992111206055 time for calcul the mask position with numpy : 0.044756174087524414 nb_pixel_total : 75734 time to create 1 rle with old method : 0.09583544731140137 time for calcul the mask position with numpy : 0.04558992385864258 nb_pixel_total : 17089 time to create 1 rle with old method : 0.02020096778869629 time for calcul the mask position with numpy : 0.0444488525390625 nb_pixel_total : 22712 time to create 1 rle with old method : 0.03018784523010254 time for calcul the mask position with numpy : 0.047785043716430664 nb_pixel_total : 49180 time to create 1 rle with old method : 0.06867575645446777 time for calcul the mask position with numpy : 0.0493013858795166 nb_pixel_total : 33328 time to create 1 rle with old method : 0.039287567138671875 time for calcul the mask position with numpy : 0.048506975173950195 nb_pixel_total : 15272 time to create 1 rle with old method : 0.018244504928588867 time for calcul the mask position with numpy : 0.04660320281982422 nb_pixel_total : 25709 time to create 1 rle with old method : 0.03245258331298828 time for calcul the mask position with numpy : 0.048857927322387695 nb_pixel_total : 37979 time to create 1 rle with old method : 0.04223942756652832 create new chi : 3.3361995220184326 time to delete rle : 0.002554655075073242 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10084 TO DO : save crop sub photo not yet done ! save time : 0.771826982498169 nb_obj : 19 nb_hashtags : 5 time to prepare the origin masks : 11.738869667053223 time for calcul the mask position with numpy : 0.8766524791717529 nb_pixel_total : 7644440 time to create 1 rle with new method : 1.0265781879425049 time for calcul the mask position with numpy : 0.04340028762817383 nb_pixel_total : 26181 time to create 1 rle with old method : 0.0362856388092041 time for calcul the mask position with numpy : 0.04222893714904785 nb_pixel_total : 21729 time to create 1 rle with old method : 0.026558399200439453 time for calcul the mask position with numpy : 0.04798555374145508 nb_pixel_total : 61290 time to create 1 rle with old method : 0.0671849250793457 time for calcul the mask position with numpy : 0.04310774803161621 nb_pixel_total : 13762 time to create 1 rle with old method : 0.015125274658203125 time for calcul the mask position with numpy : 0.04320693016052246 nb_pixel_total : 39426 time to create 1 rle with old method : 0.04545903205871582 time for calcul the mask position with numpy : 0.04706764221191406 nb_pixel_total : 2813 time to create 1 rle with old method : 0.00458836555480957 time for calcul the mask position with numpy : 0.04775810241699219 nb_pixel_total : 19705 time to create 1 rle with old method : 0.021959304809570312 time for calcul the mask position with numpy : 0.04923844337463379 nb_pixel_total : 32843 time to create 1 rle with old method : 0.03688979148864746 time for calcul the mask position with numpy : 0.04566144943237305 nb_pixel_total : 3653 time to create 1 rle with old method : 0.004095554351806641 time for calcul the mask position with numpy : 0.04379892349243164 nb_pixel_total : 20123 time to create 1 rle with old method : 0.02512502670288086 time for calcul the mask position with numpy : 0.0453343391418457 nb_pixel_total : 647 time to create 1 rle with old method : 0.0008053779602050781 time for calcul the mask position with numpy : 0.04224228858947754 nb_pixel_total : 11850 time to create 1 rle with old method : 0.013326406478881836 time for calcul the mask position with numpy : 0.04263877868652344 nb_pixel_total : 73295 time to create 1 rle with old method : 0.08184337615966797 time for calcul the mask position with numpy : 0.040618896484375 nb_pixel_total : 38886 time to create 1 rle with old method : 0.04331469535827637 time for calcul the mask position with numpy : 0.04250192642211914 nb_pixel_total : 20611 time to create 1 rle with old method : 0.02295064926147461 time for calcul the mask position with numpy : 0.04373574256896973 nb_pixel_total : 40976 time to create 1 rle with old method : 0.04558515548706055 time for calcul the mask position with numpy : 0.04444599151611328 nb_pixel_total : 136360 time to create 1 rle with old method : 0.15727853775024414 time for calcul the mask position with numpy : 0.041696786880493164 nb_pixel_total : 51668 time to create 1 rle with old method : 0.0564112663269043 time for calcul the mask position with numpy : 0.04171919822692871 nb_pixel_total : 34142 time to create 1 rle with old method : 0.03713488578796387 create new chi : 3.53910756111145 time to delete rle : 0.0019598007202148438 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10199 TO DO : save crop sub photo not yet done ! save time : 0.8523528575897217 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 8.847145318984985 time for calcul the mask position with numpy : 0.3497347831726074 nb_pixel_total : 4511476 time to create 1 rle with new method : 1.1913738250732422 time for calcul the mask position with numpy : 0.3913760185241699 nb_pixel_total : 3471999 time to create 1 rle with new method : 1.0661530494689941 time for calcul the mask position with numpy : 0.045647621154785156 nb_pixel_total : 12679 time to create 1 rle with old method : 0.014438152313232422 time for calcul the mask position with numpy : 0.04844188690185547 nb_pixel_total : 29856 time to create 1 rle with old method : 0.03353619575500488 time for calcul the mask position with numpy : 0.04590201377868652 nb_pixel_total : 7065 time to create 1 rle with old method : 0.008982181549072266 time for calcul the mask position with numpy : 0.05204415321350098 nb_pixel_total : 9125 time to create 1 rle with old method : 0.011449575424194336 time for calcul the mask position with numpy : 0.0489659309387207 nb_pixel_total : 19433 time to create 1 rle with old method : 0.025393962860107422 time for calcul the mask position with numpy : 0.045502424240112305 nb_pixel_total : 17346 time to create 1 rle with old method : 0.02198052406311035 time for calcul the mask position with numpy : 0.049974918365478516 nb_pixel_total : 23380 time to create 1 rle with old method : 0.05134725570678711 time for calcul the mask position with numpy : 0.05838322639465332 nb_pixel_total : 97476 time to create 1 rle with old method : 0.12693572044372559 time for calcul the mask position with numpy : 0.044448137283325195 nb_pixel_total : 11264 time to create 1 rle with old method : 0.013446807861328125 time for calcul the mask position with numpy : 0.04220247268676758 nb_pixel_total : 43756 time to create 1 rle with old method : 0.05075573921203613 time for calcul the mask position with numpy : 0.04181408882141113 nb_pixel_total : 39545 time to create 1 rle with old method : 0.04591536521911621 create new chi : 4.0189831256866455 time to delete rle : 0.0029010772705078125 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 11749 TO DO : save crop sub photo not yet done ! save time : 0.8025784492492676 map_output_result : {1349750331: (0.0, 'Should be the crop_list due to order', 0), 1349750328: (0.0, 'Should be the crop_list due to order', 0), 1349750310: (0.0, 'Should be the crop_list due to order', 0), 1349750278: (0.0, 'Should be the crop_list due to order', 0), 1349750209: (0.0, 'Should be the crop_list due to order', 0), 1349750207: (0.0, 'Should be the crop_list due to order', 0), 1349750200: (0.0, 'Should be the crop_list due to order', 0), 1349750197: (0.0, 'Should be the crop_list due to order', 0), 1349750185: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1349750331, 1349750328, 1349750310, 1349750278, 1349750209, 1349750207, 1349750200, 1349750197, 1349750185] Looping around the photos to save general results len do output : 9 /1349750331.Didn't retrieve data . /1349750328.Didn't retrieve data . /1349750310.Didn't retrieve data . /1349750278.Didn't retrieve data . /1349750209.Didn't retrieve data . /1349750207.Didn't retrieve data . /1349750200.Didn't retrieve data . /1349750197.Didn't retrieve data . /1349750185.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750331', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750328', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750310', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750278', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750209', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750207', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750200', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750197', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750185', None, None, None, None, None, '2720210') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013019800186157227 save_final save missing photos in datou_result : time spend for datou_step_exec : 129.36322355270386 time spend to save output : 0.01361536979675293 total time spend for step 3 : 129.3768389225006 step4:ventilate_hashtags_in_portfolio Thu Apr 3 10:56:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22018590 get user id for portfolio 22018590 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22018590 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_fonce','mal_croppe','pet_clair','metal','flou','environnement','papier','autre','carton','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22018590 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_fonce','mal_croppe','pet_clair','metal','flou','environnement','papier','autre','carton','pehd')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22018590 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_fonce','mal_croppe','pet_clair','metal','flou','environnement','papier','autre','carton','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22019654,22019655,22019656,22019657,22019658,22019659,22019660,22019661,22019662,22019663,22019664?tags=background,pet_fonce,mal_croppe,pet_clair,metal,flou,environnement,papier,autre,carton,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1349750331, 1349750328, 1349750310, 1349750278, 1349750209, 1349750207, 1349750200, 1349750197, 1349750185] Looping around the photos to save general results len do output : 1 /22018590. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750331', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750328', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750310', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750278', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750209', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750207', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750200', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750197', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750185', None, None, None, None, None, '2720210') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013752937316894531 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8703787326812744 time spend to save output : 0.013996601104736328 total time spend for step 4 : 0.8843753337860107 step5:final Thu Apr 3 10:56:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1349750331: ('0.158859015989369',), 1349750328: ('0.158859015989369',), 1349750310: ('0.158859015989369',), 1349750278: ('0.158859015989369',), 1349750209: ('0.158859015989369',), 1349750207: ('0.158859015989369',), 1349750200: ('0.158859015989369',), 1349750197: ('0.158859015989369',), 1349750185: ('0.158859015989369',)} new output for save of step final : {1349750331: ('0.158859015989369',), 1349750328: ('0.158859015989369',), 1349750310: ('0.158859015989369',), 1349750278: ('0.158859015989369',), 1349750209: ('0.158859015989369',), 1349750207: ('0.158859015989369',), 1349750200: ('0.158859015989369',), 1349750197: ('0.158859015989369',), 1349750185: ('0.158859015989369',)} [1349750331, 1349750328, 1349750310, 1349750278, 1349750209, 1349750207, 1349750200, 1349750197, 1349750185] Looping around the photos to save general results len do output : 9 /1349750331.Didn't retrieve data . /1349750328.Didn't retrieve data . /1349750310.Didn't retrieve data . /1349750278.Didn't retrieve data . /1349750209.Didn't retrieve data . /1349750207.Didn't retrieve data . /1349750200.Didn't retrieve data . /1349750197.Didn't retrieve data . /1349750185.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750331', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750328', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750310', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750278', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750209', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750207', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750200', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750197', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750185', None, None, None, None, None, '2720210') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013589859008789062 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11294817924499512 time spend to save output : 0.01403188705444336 total time spend for step 5 : 0.12698006629943848 step6:blur_detection Thu Apr 3 10:56:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030.jpg resize: (2160, 3840) 1349750331 -3.6937624186911404 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37.jpg resize: (2160, 3840) 1349750328 -6.075785073644355 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8.jpg resize: (2160, 3840) 1349750310 -6.17295953365871 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b.jpg resize: (2160, 3840) 1349750278 -6.205759984857397 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904.jpg resize: (2160, 3840) 1349750209 -6.22244965467113 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473.jpg resize: (2160, 3840) 1349750207 -6.24932721365245 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459.jpg resize: (2160, 3840) 1349750200 -6.265174900545275 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83.jpg resize: (2160, 3840) 1349750197 -5.545810959849826 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408.jpg resize: (2160, 3840) 1349750185 -3.4925748700683847 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030163_0.png resize: (619, 217) 1349782963 -4.692747720843917 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030164_0.png resize: (723, 1651) 1349782964 -4.551777676571724 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030161_0.png resize: (377, 242) 1349782965 -4.329145350430768 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030155_0.png resize: (285, 230) 1349782966 -3.099233153352701 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030157_0.png resize: (249, 153) 1349782967 -3.9913780352858557 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030158_0.png resize: (456, 392) 1349782968 -3.2424642912843407 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030153_0.png resize: (153, 146) 1349782969 -2.5586288897338574 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030159_0.png resize: (273, 519) 1349782970 -4.206611018506359 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030154_0.png resize: (571, 277) 1349782971 -4.021687068548008 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030162_0.png resize: (154, 225) 1349782972 -4.497468541071278 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030160_0.png resize: (119, 199) 1349782973 -3.3068786068629152 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030168_0.png resize: (291, 287) 1349782974 -3.0962326991634392 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030175_0.png resize: (291, 269) 1349782975 -3.6257267951981595 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030173_0.png resize: (313, 319) 1349782976 -4.2825275422101265 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030165_0.png resize: (512, 691) 1349782977 -3.4239842096055475 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030170_0.png resize: (135, 112) 1349782978 -1.9621871428696835 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030169_0.png resize: (295, 206) 1349782979 -2.932978276337832 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030166_0.png resize: (139, 241) 1349782980 -2.779235274336028 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030176_0.png resize: (121, 255) 1349782981 -3.0301079091985015 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030171_0.png resize: (103, 93) 1349782982 -2.930948833199747 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030194_0.png resize: (201, 202) 1349782983 -4.117290785696315 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030190_0.png resize: (501, 269) 1349782984 -4.739206900415816 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030203_0.png resize: (268, 265) 1349782985 -1.7894334400443535 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030193_0.png resize: (530, 463) 1349782986 -5.038197897560063 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030184_0.png resize: (425, 426) 1349782987 -3.172003889303761 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030186_0.png resize: (371, 137) 1349782988 -3.4460507137230927 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030178_0.png resize: (203, 272) 1349782990 -3.772502039829004 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030185_0.png resize: (459, 237) 1349782991 -1.4056378471873212 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030196_0.png resize: (425, 400) 1349782992 -4.3366658193951375 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030180_0.png resize: (462, 377) 1349782993 -4.085960224193602 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030183_0.png resize: (185, 360) 1349782994 -4.100388742888722 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030200_0.png resize: (77, 109) 1349782995 -3.2853185578644464 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030177_0.png resize: (151, 83) 1349782996 -1.8606807631297848 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030192_0.png resize: (213, 168) 1349782997 -1.381035113419911 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030182_0.png resize: (143, 201) 1349782998 -3.5653163150477165 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030201_0.png resize: (550, 662) 1349783000 -3.459375069433152 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030181_0.png resize: (287, 398) 1349783001 -3.4403777027465603 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030191_0.png resize: (151, 118) 1349783002 -3.663570013048119 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030187_0.png resize: (223, 191) 1349783003 -4.383109181496859 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030195_0.png resize: (234, 88) 1349783004 -2.1149531317918453 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030188_0.png resize: (195, 90) 1349783005 -4.272932634636267 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030214_0.png resize: (1305, 1413) 1349783006 -5.73019616601858 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030224_0.png resize: (200, 369) 1349783007 -3.9295441261510087 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030221_0.png resize: (166, 86) 1349783008 -2.2382444765457747 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030226_0.png resize: (263, 211) 1349783010 -4.276200391803366 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030223_0.png resize: (288, 215) 1349783011 -3.917566420520687 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030220_0.png resize: (130, 108) 1349783012 -2.326059575349168 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030206_0.png resize: (323, 343) 1349783013 -3.4787309442424075 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030222_0.png resize: (271, 285) 1349783014 -3.58914127677883 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030210_0.png resize: (258, 171) 1349783015 -3.837074433909341 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030207_0.png resize: (124, 249) 1349783016 -2.554323552351589 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030229_0.png resize: (229, 236) 1349783017 -4.732577195640769 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030213_0.png resize: (218, 196) 1349783019 -1.7831800088528005 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030205_0.png resize: (96, 229) 1349783020 -3.560171363753583 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030209_0.png resize: (201, 213) 1349783021 -3.6650911156787522 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030218_0.png resize: (199, 218) 1349783022 -3.765926715088349 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030228_0.png resize: (304, 270) 1349783023 -4.482143940263943 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030212_0.png resize: (217, 248) 1349783024 -3.8018997984014824 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030227_0.png resize: (157, 166) 1349783025 -3.325831403188393 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030219_0.png resize: (246, 95) 1349783026 -2.558159303609365 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030216_0.png resize: (190, 181) 1349783027 -3.039610138653563 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030211_0.png resize: (143, 170) 1349783028 -3.5669729937242107 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030242_0.png resize: (220, 218) 1349783029 -2.929132381254586 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030245_0.png resize: (149, 110) 1349783030 -2.0945423871562494 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030252_0.png resize: (346, 344) 1349783031 -4.84038737790398 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030236_0.png resize: (122, 145) 1349783032 -1.7693380517694963 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030243_0.png resize: (207, 203) 1349783033 -3.5788456212129054 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030235_0.png resize: (588, 487) 1349783034 -4.223711530054532 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030244_0.png resize: (259, 228) 1349783035 -3.817727201194697 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030240_0.png resize: (236, 403) 1349783036 -3.9141289363320304 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030237_0.png resize: (400, 413) 1349783037 -4.570782519131753 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030251_0.png resize: (149, 89) 1349783039 -1.9398599891394326 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030233_0.png resize: (153, 188) 1349783040 -3.180245561801556 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030253_0.png resize: (334, 182) 1349783041 -3.1188026709695302 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030231_0.png resize: (142, 155) 1349783042 -3.558795674408311 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030246_0.png resize: (372, 148) 1349783043 -3.734408601286712 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030230_0.png resize: (222, 252) 1349783044 -3.753707602634268 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030247_0.png resize: (148, 117) 1349783045 -2.918348572221249 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030234_0.png resize: (122, 348) 1349783046 -3.3279433344954015 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030269_0.png resize: (354, 387) 1349783047 -3.636475431726509 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030272_0.png resize: (247, 220) 1349783048 -4.064574546186436 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030265_0.png resize: (176, 114) 1349783049 -3.255524017519706 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030259_0.png resize: (107, 132) 1349783050 -3.448207011862611 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030261_0.png resize: (109, 101) 1349783051 -3.7718847131235034 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030256_0.png resize: (239, 272) 1349783052 -3.4773153821612657 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030255_0.png resize: (204, 230) 1349783053 -3.684961223302796 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030258_0.png resize: (151, 87) 1349783054 -3.623507811438283 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030271_0.png resize: (172, 111) 1349783055 -3.3386960963825802 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030264_0.png resize: (620, 422) 1349783056 -4.113015677390487 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030282_0.png resize: (141, 282) 1349783057 -3.941720834542875 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030284_0.png resize: (207, 167) 1349783058 -4.462777947859485 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030274_0.png resize: (139, 275) 1349783059 -2.977225643733452 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030289_0.png resize: (320, 255) 1349783060 -4.3994510579542245 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030280_0.png resize: (345, 295) 1349783061 -4.480635441268168 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030275_0.png resize: (202, 150) 1349783062 -3.4510729775247677 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030276_0.png resize: (199, 225) 1349783063 -3.9558549517132042 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030286_0.png resize: (225, 272) 1349783064 -3.3246517294958853 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030285_0.png resize: (414, 300) 1349783065 -3.2854415108034027 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030273_0.png resize: (237, 362) 1349783066 -2.9193394943857336 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030277_0.png resize: (208, 284) 1349783067 -3.4523153996668574 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030278_0.png resize: (187, 159) 1349783068 -3.814622670649729 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030281_0.png resize: (184, 235) 1349783069 -3.9012035636818183 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030283_0.png resize: (156, 151) 1349783070 -3.686834132902131 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030291_0.png resize: (286, 221) 1349783071 -4.298060546129561 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030301_0.png resize: (239, 211) 1349783072 -3.6973106266945095 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030297_0.png resize: (205, 80) 1349783073 -2.332401132773011 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030299_0.png resize: (115, 231) 1349783074 -4.265453820360597 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030300_0.png resize: (96, 58) 1349783075 -3.5860191131137786 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030292_0.png resize: (494, 381) 1349783076 -2.836022718471624 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030306_0.png resize: (310, 308) 1349783077 -3.477133963520157 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030295_0.png resize: (196, 276) 1349783078 -3.673871495850284 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030294_0.png resize: (147, 189) 1349783079 -3.443376307544221 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030304_0.png resize: (216, 264) 1349783080 -3.8072428253022252 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030293_0.png resize: (147, 425) 1349783081 -3.8788967079350543 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030290_0.png resize: (206, 282) 1349783083 -2.7225883315774446 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030298_0.png resize: (120, 122) 1349783084 -2.113359224698829 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030307_0.png resize: (225, 130) 1349783085 -3.441307220906604 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030303_0.png resize: (106, 38) 1349783086 -2.650601842289927 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030317_0.png resize: (111, 91) 1349783087 -2.910108317806415 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030315_0.png resize: (152, 166) 1349783088 -3.7191741614833878 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030312_0.png resize: (382, 396) 1349783090 -4.800317888621389 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030314_0.png resize: (100, 225) 1349783091 -3.0594507680663847 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030313_0.png resize: (289, 195) 1349783092 -4.447778384153975 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030319_0.png resize: (141, 114) 1349783093 -1.9414427097177267 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030310_0.png resize: (265, 309) 1349783094 -4.388122548949343 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030318_0.png resize: (280, 167) 1349783095 -4.331116431047024 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030309_0.png resize: (254, 252) 1349783096 -3.062615707498673 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030199_0.png resize: (125, 144) 1349783173 -3.2234746631515265 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030189_0.png resize: (381, 214) 1349783174 -3.5091596872048445 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030197_0.png resize: (287, 225) 1349783175 -3.621243434074649 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030179_0.png resize: (157, 238) 1349783176 -3.514834974341248 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030217_0.png resize: (252, 309) 1349783177 -3.486902021036414 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030225_0.png resize: (185, 249) 1349783178 -1.848695530265836 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030204_0.png resize: (164, 89) 1349783179 -2.274717182660394 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030249_0.png resize: (292, 419) 1349783180 -4.150166905279891 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030232_0.png resize: (201, 219) 1349783182 -3.1049953845017035 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030238_0.png resize: (152, 218) 1349783183 -2.178192624710701 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030239_0.png resize: (249, 221) 1349783184 -3.253411484257339 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030263_0.png resize: (148, 142) 1349783185 -2.5093492796688235 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030270_0.png resize: (189, 340) 1349783186 -3.918039398605699 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030260_0.png resize: (177, 124) 1349783187 -3.3231391682768514 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030262_0.png resize: (314, 164) 1349783188 -2.5783724988437497 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030268_0.png resize: (210, 146) 1349783189 -3.5814468389854968 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030266_0.png resize: (182, 126) 1349783190 -2.7105037054988466 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030257_0.png resize: (139, 127) 1349783191 -3.584449176334045 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030279_0.png resize: (171, 185) 1349783192 -3.471965038623149 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030287_0.png resize: (195, 191) 1349783193 -4.438466896690568 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030308_0.png resize: (165, 222) 1349783194 -3.4853657623427603 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030311_0.png resize: (91, 138) 1349783195 -1.3688775523165533 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030302_0.png resize: (184, 134) 1349783196 -3.5321206207719245 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030316_0.png resize: (87, 134) 1349783197 -3.678415228355085 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030167_0.png resize: (493, 229) 1349783308 -2.973482957043513 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030202_0.png resize: (541, 424) 1349783314 -4.43216808227557 treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030198_0.png resize: (348, 284) 1349783317 -4.0558870515619105 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030215_0.png resize: (597, 238) 1349783319 -2.782546330614861 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030241_0.png resize: (278, 329) 1349783321 -3.9123518470605623 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030250_0.png resize: (73, 89) 1349783323 -2.605575804690954 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030254_0.png resize: (617, 334) 1349783324 -4.386512127517777 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030296_0.png resize: (355, 313) 1349783325 -3.941756451649269 treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030320_0.png resize: (1756, 2521) 1349783326 -4.059127479034395 treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030156_0.png resize: (125, 118) 1349783331 -2.8500372529335887 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030174_0.png resize: (125, 121) 1349783332 -2.871781596544332 treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030172_0.png resize: (207, 171) 1349783333 -4.057473415278615 treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030208_0.png resize: (278, 404) 1349783334 -1.7269922407636207 treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030248_0.png resize: (308, 343) 1349783335 -3.3190085379342613 treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030267_0.png resize: (171, 258) 1349783336 -3.1290009924064686 treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030288_0.png resize: (182, 150) 1349783337 -3.2124251561590365 treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030305_0.png resize: (149, 128) 1349783338 -3.5459840765647486 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 177 time used for this insertion : 0.019539356231689453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 177 time used for this insertion : 0.03230714797973633 save missing photos in datou_result : time spend for datou_step_exec : 48.39686179161072 time spend to save output : 0.058234214782714844 total time spend for step 6 : 48.45509600639343 step7:brightness Thu Apr 3 10:57:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030.jpg treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37.jpg treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8.jpg treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b.jpg treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904.jpg treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473.jpg treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459.jpg treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83.jpg treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408.jpg treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030163_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030164_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030161_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030155_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030157_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030158_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030153_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030159_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030154_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030162_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030160_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030168_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030175_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030173_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030165_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030170_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030169_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030166_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030176_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030171_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030194_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030190_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030203_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030193_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030184_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030186_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030178_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030185_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030196_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030180_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030183_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030200_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030177_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030192_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030182_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030201_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030181_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030191_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030187_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030195_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030188_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030214_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030224_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030221_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030226_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030223_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030220_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030206_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030222_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030210_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030207_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030229_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030213_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030205_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030209_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030218_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030228_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030212_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030227_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030219_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030216_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030211_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030242_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030245_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030252_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030236_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030243_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030235_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030244_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030240_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030237_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030251_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030233_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030253_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030231_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030246_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030230_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030247_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030234_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030269_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030272_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030265_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030259_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030261_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030256_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030255_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030258_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030271_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030264_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030282_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030284_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030274_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030289_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030280_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030275_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030276_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030286_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030285_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030273_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030277_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030278_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030281_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030283_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030291_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030301_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030297_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030299_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030300_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030292_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030306_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030295_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030294_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030304_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030293_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030290_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030298_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030307_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030303_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030317_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030315_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030312_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030314_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030313_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030319_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030310_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030318_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030309_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030199_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030189_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030197_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030179_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030217_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030225_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030204_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030249_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030232_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030238_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030239_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030263_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030270_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030260_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030262_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030268_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030266_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030257_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030279_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030287_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030308_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030311_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030302_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030316_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030167_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030202_0.png treat image : temp/1743670251_2998039_1349750310_75dffc9a9d9f08b8efe57850e99c0cb8_rle_crop_3746030198_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030215_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030241_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030250_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030254_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030296_0.png treat image : temp/1743670251_2998039_1349750185_cc4fdab589a5884e5c2cee5952e5a408_rle_crop_3746030320_0.png treat image : temp/1743670251_2998039_1349750331_1b515ed4bd7ac6405da73d2e5316b030_rle_crop_3746030156_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030174_0.png treat image : temp/1743670251_2998039_1349750328_39c9865a3c8d3bbb139a7fdf5108cb37_rle_crop_3746030172_0.png treat image : temp/1743670251_2998039_1349750278_67e2b889bcd98a9976ff17d1cbb92c7b_rle_crop_3746030208_0.png treat image : temp/1743670251_2998039_1349750209_622af07b9dfdb81dd83ed393c64dc904_rle_crop_3746030248_0.png treat image : temp/1743670251_2998039_1349750207_26a39309e8079a2ba0c7da1771c8c473_rle_crop_3746030267_0.png treat image : temp/1743670251_2998039_1349750200_6d7d2173f56233cb8d962aafe3711459_rle_crop_3746030288_0.png treat image : temp/1743670251_2998039_1349750197_77b22133b264cff9e2b43dbed913ee83_rle_crop_3746030305_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 177 time used for this insertion : 0.09387826919555664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 177 time used for this insertion : 0.2039787769317627 save missing photos in datou_result : time spend for datou_step_exec : 10.884803295135498 time spend to save output : 0.3036191463470459 total time spend for step 7 : 11.188422441482544 step8:velours_tree Thu Apr 3 10:57:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.856450080871582 time spend to save output : 4.410743713378906e-05 total time spend for step 8 : 0.8564941883087158 step9:send_mail_cod Thu Apr 3 10:57:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22018590_03-04-2025_10_57_48.pdf 22019654 imagette220196541743670668 22019655 imagette220196551743670668 22019656 imagette220196561743670669 22019657 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220196571743670669 22019658 change filename to text .change filename to text .imagette220196581743670669 22019659 imagette220196591743670670 22019661 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220196611743670670 22019662 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220196621743670671 22019663 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220196631743670672 22019664 imagette220196641743670673 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22018590 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22019654,22019655,22019656,22019657,22019658,22019659,22019660,22019661,22019662,22019663,22019664?tags=background,pet_fonce,mal_croppe,pet_clair,metal,flou,environnement,papier,autre,carton,pehd args[1349750331] : ((1349750331, -3.6937624186911404, 492609224), (1349750331, -1.3130582457387996, 501862349), '0.158859015989369') We are sending mail with results at report@fotonower.com args[1349750328] : ((1349750328, -6.075785073644355, 492609224), (1349750328, -0.18437376679377646, 496442774), '0.158859015989369') We are sending mail with results at report@fotonower.com args[1349750310] : ((1349750310, -6.17295953365871, 492609224), (1349750310, 0.02834394328696522, 2107752395), '0.158859015989369') We are sending mail with results at report@fotonower.com args[1349750278] : ((1349750278, -6.205759984857397, 492609224), (1349750278, -0.14634904541933733, 496442774), '0.158859015989369') We are sending mail with results at report@fotonower.com args[1349750209] : ((1349750209, -6.22244965467113, 492609224), (1349750209, -0.07853796776721826, 496442774), '0.158859015989369') We are sending mail with results at report@fotonower.com args[1349750207] : ((1349750207, -6.24932721365245, 492609224), (1349750207, -0.17766202546108661, 496442774), '0.158859015989369') We are sending mail with results at report@fotonower.com args[1349750200] : ((1349750200, -6.265174900545275, 492609224), (1349750200, -0.28266527495891086, 496442774), '0.158859015989369') We are sending mail with results at report@fotonower.com args[1349750197] : ((1349750197, -5.545810959849826, 492609224), (1349750197, -0.35616833577912166, 496442774), '0.158859015989369') We are sending mail with results at report@fotonower.com args[1349750185] : ((1349750185, -3.4925748700683847, 492609224), (1349750185, -1.8467963446955655, 501862349), '0.158859015989369') We are sending mail with results at report@fotonower.com refus_total : 0.158859015989369 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22018590 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22018590_03-04-2025_10_57_48.pdf results_Auto_P22018590_03-04-2025_10_57_48.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22018590_03-04-2025_10_57_48.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22018590','results_Auto_P22018590_03-04-2025_10_57_48.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22018590_03-04-2025_10_57_48.pdf','pdf','','1.16','0.158859015989369') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22018590

https://www.fotonower.com/image?json=false&list_photos_id=1349750331
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349750328
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349750310
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349750278
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349750209
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349750207
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349750200
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349750197
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349750185
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.89%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22019657?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22019658?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22019661?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22019662?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22019663?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22018590_03-04-2025_10_57_48.pdf.

Lien vers velours :https://www.fotonower.com/velours/22019654,22019655,22019656,22019657,22019658,22019659,22019660,22019661,22019662,22019663,22019664?tags=background,pet_fonce,mal_croppe,pet_clair,metal,flou,environnement,papier,autre,carton,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 03 Apr 2025 08:57:56 GMT Content-Length: 0 Connection: close X-Message-Id: 6Ok1KBUDRoaEugpZ3ZS7SA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1349750331, 1349750328, 1349750310, 1349750278, 1349750209, 1349750207, 1349750200, 1349750197, 1349750185] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750331', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750328', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750310', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750278', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750209', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750207', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750200', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750197', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750185', None, None, None, None, None, '2720210') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014481544494628906 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.882794141769409 time spend to save output : 0.014751195907592773 total time spend for step 9 : 7.897545337677002 step10:split_time_score Thu Apr 3 10:57:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03042025 22018590 Nombre de photos uploadées : 9 / 23040 (0%) 03042025 22018590 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 03042025 22018590 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 4.5299530029296875e-06 elapsed_time : order_list_meta_photo_and_scores 1.3113021850585938e-05 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006120204925537109 elapsed_time : insert_dashboard_record_day_entry 0.0240170955657959 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.158859015989369 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22018590_03-04-2025_10_57_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22018590 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22018590 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22018591 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03042025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1349750331, 1349750328, 1349750310, 1349750278, 1349750209, 1349750207, 1349750200, 1349750197, 1349750185] Looping around the photos to save general results len do output : 1 /22018590Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750331', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750328', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750310', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750278', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750209', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750207', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750200', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750197', None, None, None, None, None, '2720210') ('3318', None, None, None, None, None, None, None, '2720210') ('3318', '22018590', '1349750185', None, None, None, None, None, '2720210') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014656305313110352 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.0894598960876465 time spend to save output : 0.014908552169799805 total time spend for step 10 : 1.1043684482574463 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 199.31user 159.58system 7:12.89elapsed 82%CPU (0avgtext+0avgdata 4719196maxresident)k 2360840inputs+202152outputs (40432major+17571531minor)pagefaults 0swaps