python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3989887 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2801596'] with mtr_portfolio_ids : ['22755885'] and first list_photo_ids : [] new path : /proc/3989887/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.4495196342468262 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 7 08:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10661 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-07 08:10:33.488882: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-07 08:10:33.515268: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-07 08:10:33.517212: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0868000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-07 08:10:33.517245: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-07 08:10:33.521437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-07 08:10:33.668069: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x277f7b90 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-07 08:10:33.668134: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-07 08:10:33.669403: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 08:10:33.669890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 08:10:33.673131: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 08:10:33.676270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 08:10:33.676748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 08:10:33.679500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 08:10:33.680959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 08:10:33.686578: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 08:10:33.688358: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 08:10:33.688457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 08:10:33.689254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 08:10:33.689271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 08:10:33.689280: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 08:10:33.694535: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9735 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-07 08:10:34.010156: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 08:10:34.010263: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 08:10:34.010284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 08:10:34.010304: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 08:10:34.010322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 08:10:34.010342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 08:10:34.010359: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 08:10:34.010378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 08:10:34.012031: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 08:10:34.013464: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 08:10:34.013570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 08:10:34.013595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 08:10:34.013614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 08:10:34.013634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 08:10:34.013654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 08:10:34.013669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 08:10:34.013683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 08:10:34.014971: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 08:10:34.015002: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 08:10:34.015011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 08:10:34.015019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 08:10:34.016338: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9735 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-07 08:10:48.479239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 08:10:48.701247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 08:10:50.106058: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.106665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.107253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.107801: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.108348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.108940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.109476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.109505: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.110264: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.110282: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.117324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.117348: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.117899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.117914: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.124406: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.124438: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.124975: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.124990: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.155703: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.155730: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.156266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.156281: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.162180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.162203: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.162768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.162789: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 08:10:50.196925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.197512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.199386: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.199941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.244265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.244844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.247092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.247666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.278303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.278880: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.280672: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.281245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.287767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.288338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.290253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.290819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.301688: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.302454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.304467: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.305202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.337742: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.338328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.338902: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.339454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.343635: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.344206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.362044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.362625: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.363201: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.363779: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.376402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.376989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.377560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.378123: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.382413: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.382999: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.387560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.388125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.400167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.400737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.404926: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.405530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.406148: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.406755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.407545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.408102: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.419020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.419639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.420275: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.420874: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.421438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.421992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.422573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.423161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.432485: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.433072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.439495: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.440118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.501160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.501769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.509783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.510381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.532649: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.533337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.533937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.534493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.538674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.539304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.539903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.540495: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.542656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.542686: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-07 08:10:50.552088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.552687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.561824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.562381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.563002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.563602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.564204: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 08:10:50.564761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 Detection mask done ! Trying to reset tf kernel 3990794 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9621 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 31350 time to create 1 rle with old method : 0.03484916687011719 length of segment : 219 time for calcul the mask position with numpy : 0.0026712417602539062 nb_pixel_total : 110666 time to create 1 rle with old method : 0.1278090476989746 length of segment : 380 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 17156 time to create 1 rle with old method : 0.019730806350708008 length of segment : 107 time for calcul the mask position with numpy : 0.0006277561187744141 nb_pixel_total : 37777 time to create 1 rle with old method : 0.04973196983337402 length of segment : 225 time for calcul the mask position with numpy : 0.0006875991821289062 nb_pixel_total : 38295 time to create 1 rle with old method : 0.04158926010131836 length of segment : 220 time for calcul the mask position with numpy : 0.0015130043029785156 nb_pixel_total : 78672 time to create 1 rle with old method : 0.08507347106933594 length of segment : 428 time for calcul the mask position with numpy : 0.0008373260498046875 nb_pixel_total : 51968 time to create 1 rle with old method : 0.057277679443359375 length of segment : 306 time for calcul the mask position with numpy : 0.0008399486541748047 nb_pixel_total : 37619 time to create 1 rle with old method : 0.04113149642944336 length of segment : 226 time for calcul the mask position with numpy : 0.0055539608001708984 nb_pixel_total : 288913 time to create 1 rle with new method : 0.01604151725769043 length of segment : 572 time for calcul the mask position with numpy : 0.0009090900421142578 nb_pixel_total : 69577 time to create 1 rle with old method : 0.0751492977142334 length of segment : 340 time for calcul the mask position with numpy : 0.0007333755493164062 nb_pixel_total : 41918 time to create 1 rle with old method : 0.04518270492553711 length of segment : 339 time for calcul the mask position with numpy : 0.0012733936309814453 nb_pixel_total : 67607 time to create 1 rle with old method : 0.07805180549621582 length of segment : 478 time for calcul the mask position with numpy : 0.0007245540618896484 nb_pixel_total : 39689 time to create 1 rle with old method : 0.043836116790771484 length of segment : 300 time for calcul the mask position with numpy : 0.001245260238647461 nb_pixel_total : 87076 time to create 1 rle with old method : 0.0980372428894043 length of segment : 270 time for calcul the mask position with numpy : 0.0008499622344970703 nb_pixel_total : 65379 time to create 1 rle with old method : 0.07529544830322266 length of segment : 246 time for calcul the mask position with numpy : 0.0010809898376464844 nb_pixel_total : 84609 time to create 1 rle with old method : 0.09379053115844727 length of segment : 388 time for calcul the mask position with numpy : 0.001016378402709961 nb_pixel_total : 72921 time to create 1 rle with old method : 0.08042407035827637 length of segment : 361 time for calcul the mask position with numpy : 0.0025649070739746094 nb_pixel_total : 167551 time to create 1 rle with new method : 0.009708166122436523 length of segment : 689 time for calcul the mask position with numpy : 0.0019414424896240234 nb_pixel_total : 103067 time to create 1 rle with old method : 0.16585874557495117 length of segment : 361 time for calcul the mask position with numpy : 0.0002999305725097656 nb_pixel_total : 19653 time to create 1 rle with old method : 0.023172378540039062 length of segment : 93 time for calcul the mask position with numpy : 0.0016825199127197266 nb_pixel_total : 122538 time to create 1 rle with old method : 0.15047836303710938 length of segment : 407 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 22577 time to create 1 rle with old method : 0.026151180267333984 length of segment : 125 time for calcul the mask position with numpy : 0.0023517608642578125 nb_pixel_total : 85078 time to create 1 rle with old method : 0.0949411392211914 length of segment : 382 time for calcul the mask position with numpy : 0.001020193099975586 nb_pixel_total : 67453 time to create 1 rle with old method : 0.07894420623779297 length of segment : 451 time for calcul the mask position with numpy : 0.0009753704071044922 nb_pixel_total : 24662 time to create 1 rle with old method : 0.027906179428100586 length of segment : 176 time for calcul the mask position with numpy : 0.0019180774688720703 nb_pixel_total : 41982 time to create 1 rle with old method : 0.04727649688720703 length of segment : 316 time for calcul the mask position with numpy : 0.0029506683349609375 nb_pixel_total : 94056 time to create 1 rle with old method : 0.1080772876739502 length of segment : 506 time for calcul the mask position with numpy : 0.0009548664093017578 nb_pixel_total : 32987 time to create 1 rle with old method : 0.03847908973693848 length of segment : 132 time for calcul the mask position with numpy : 0.0013272762298583984 nb_pixel_total : 20250 time to create 1 rle with old method : 0.022935152053833008 length of segment : 331 time for calcul the mask position with numpy : 0.0014269351959228516 nb_pixel_total : 33407 time to create 1 rle with old method : 0.03844046592712402 length of segment : 171 time for calcul the mask position with numpy : 0.003481149673461914 nb_pixel_total : 64492 time to create 1 rle with old method : 0.0953073501586914 length of segment : 207 time for calcul the mask position with numpy : 0.003982067108154297 nb_pixel_total : 108762 time to create 1 rle with old method : 0.12255167961120605 length of segment : 453 time for calcul the mask position with numpy : 0.004485130310058594 nb_pixel_total : 83239 time to create 1 rle with old method : 0.09334564208984375 length of segment : 336 time for calcul the mask position with numpy : 0.0014989376068115234 nb_pixel_total : 25336 time to create 1 rle with old method : 0.030919790267944336 length of segment : 248 time for calcul the mask position with numpy : 0.002552032470703125 nb_pixel_total : 68635 time to create 1 rle with old method : 0.08900761604309082 length of segment : 289 time for calcul the mask position with numpy : 0.006714344024658203 nb_pixel_total : 199406 time to create 1 rle with new method : 0.012522697448730469 length of segment : 620 time for calcul the mask position with numpy : 0.0024759769439697266 nb_pixel_total : 66830 time to create 1 rle with old method : 0.07737874984741211 length of segment : 236 time for calcul the mask position with numpy : 0.0011916160583496094 nb_pixel_total : 31638 time to create 1 rle with old method : 0.03617572784423828 length of segment : 206 time for calcul the mask position with numpy : 0.0016734600067138672 nb_pixel_total : 57143 time to create 1 rle with old method : 0.06531071662902832 length of segment : 191 time for calcul the mask position with numpy : 0.0025777816772460938 nb_pixel_total : 50968 time to create 1 rle with old method : 0.05691647529602051 length of segment : 465 time for calcul the mask position with numpy : 0.0012960433959960938 nb_pixel_total : 39651 time to create 1 rle with old method : 0.04329061508178711 length of segment : 138 time for calcul the mask position with numpy : 0.002035379409790039 nb_pixel_total : 52397 time to create 1 rle with old method : 0.05774879455566406 length of segment : 299 time for calcul the mask position with numpy : 0.0014886856079101562 nb_pixel_total : 46656 time to create 1 rle with old method : 0.05458569526672363 length of segment : 349 time for calcul the mask position with numpy : 0.00021791458129882812 nb_pixel_total : 7206 time to create 1 rle with old method : 0.010284423828125 length of segment : 128 time for calcul the mask position with numpy : 0.0012812614440917969 nb_pixel_total : 23568 time to create 1 rle with old method : 0.026955366134643555 length of segment : 149 time for calcul the mask position with numpy : 0.0006787776947021484 nb_pixel_total : 7217 time to create 1 rle with old method : 0.008631706237792969 length of segment : 135 time for calcul the mask position with numpy : 0.0019106864929199219 nb_pixel_total : 46867 time to create 1 rle with old method : 0.05168414115905762 length of segment : 290 time for calcul the mask position with numpy : 0.0007383823394775391 nb_pixel_total : 22874 time to create 1 rle with old method : 0.025705575942993164 length of segment : 141 time for calcul the mask position with numpy : 0.0012233257293701172 nb_pixel_total : 26127 time to create 1 rle with old method : 0.028841257095336914 length of segment : 245 time for calcul the mask position with numpy : 0.0019881725311279297 nb_pixel_total : 60009 time to create 1 rle with old method : 0.06809329986572266 length of segment : 168 time for calcul the mask position with numpy : 0.0013077259063720703 nb_pixel_total : 38127 time to create 1 rle with old method : 0.04153132438659668 length of segment : 231 time for calcul the mask position with numpy : 0.0012426376342773438 nb_pixel_total : 40160 time to create 1 rle with old method : 0.04471850395202637 length of segment : 256 time for calcul the mask position with numpy : 0.0011906623840332031 nb_pixel_total : 34864 time to create 1 rle with old method : 0.039345741271972656 length of segment : 255 time for calcul the mask position with numpy : 0.002337217330932617 nb_pixel_total : 85254 time to create 1 rle with old method : 0.09762215614318848 length of segment : 373 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 9177 time to create 1 rle with old method : 0.010696887969970703 length of segment : 116 time for calcul the mask position with numpy : 0.00113677978515625 nb_pixel_total : 34619 time to create 1 rle with old method : 0.04030013084411621 length of segment : 281 time for calcul the mask position with numpy : 0.0009729862213134766 nb_pixel_total : 19238 time to create 1 rle with old method : 0.022007465362548828 length of segment : 185 time for calcul the mask position with numpy : 0.0019004344940185547 nb_pixel_total : 63895 time to create 1 rle with old method : 0.06809687614440918 length of segment : 292 time for calcul the mask position with numpy : 0.00029730796813964844 nb_pixel_total : 5956 time to create 1 rle with old method : 0.0071506500244140625 length of segment : 71 time for calcul the mask position with numpy : 0.0005354881286621094 nb_pixel_total : 20810 time to create 1 rle with old method : 0.025741100311279297 length of segment : 236 time for calcul the mask position with numpy : 0.0027425289154052734 nb_pixel_total : 80531 time to create 1 rle with old method : 0.09835624694824219 length of segment : 341 time for calcul the mask position with numpy : 0.0014200210571289062 nb_pixel_total : 36605 time to create 1 rle with old method : 0.040923118591308594 length of segment : 232 time for calcul the mask position with numpy : 0.006633281707763672 nb_pixel_total : 180256 time to create 1 rle with new method : 0.011357784271240234 length of segment : 367 time for calcul the mask position with numpy : 0.001094818115234375 nb_pixel_total : 10263 time to create 1 rle with old method : 0.016937971115112305 length of segment : 199 time for calcul the mask position with numpy : 0.001657247543334961 nb_pixel_total : 32459 time to create 1 rle with old method : 0.045388221740722656 length of segment : 259 time for calcul the mask position with numpy : 0.000797271728515625 nb_pixel_total : 19178 time to create 1 rle with old method : 0.021930217742919922 length of segment : 166 time for calcul the mask position with numpy : 0.0021796226501464844 nb_pixel_total : 54174 time to create 1 rle with old method : 0.061136484146118164 length of segment : 239 time for calcul the mask position with numpy : 0.0008456707000732422 nb_pixel_total : 15348 time to create 1 rle with old method : 0.0172426700592041 length of segment : 213 time for calcul the mask position with numpy : 0.0019311904907226562 nb_pixel_total : 32409 time to create 1 rle with old method : 0.038652658462524414 length of segment : 314 time for calcul the mask position with numpy : 0.0008587837219238281 nb_pixel_total : 16976 time to create 1 rle with old method : 0.020494461059570312 length of segment : 188 time for calcul the mask position with numpy : 0.0014867782592773438 nb_pixel_total : 38765 time to create 1 rle with old method : 0.045389652252197266 length of segment : 144 time for calcul the mask position with numpy : 0.002647876739501953 nb_pixel_total : 50101 time to create 1 rle with old method : 0.07308244705200195 length of segment : 245 time for calcul the mask position with numpy : 0.0005528926849365234 nb_pixel_total : 12181 time to create 1 rle with old method : 0.01434779167175293 length of segment : 173 time for calcul the mask position with numpy : 0.002008676528930664 nb_pixel_total : 51757 time to create 1 rle with old method : 0.06096529960632324 length of segment : 278 time for calcul the mask position with numpy : 0.0009126663208007812 nb_pixel_total : 20975 time to create 1 rle with old method : 0.02385544776916504 length of segment : 166 time for calcul the mask position with numpy : 0.0035085678100585938 nb_pixel_total : 92602 time to create 1 rle with old method : 0.10377144813537598 length of segment : 280 time for calcul the mask position with numpy : 0.0017611980438232422 nb_pixel_total : 40039 time to create 1 rle with old method : 0.045395612716674805 length of segment : 314 time for calcul the mask position with numpy : 0.0012083053588867188 nb_pixel_total : 40881 time to create 1 rle with old method : 0.04756760597229004 length of segment : 208 time for calcul the mask position with numpy : 0.0011248588562011719 nb_pixel_total : 27031 time to create 1 rle with old method : 0.03292703628540039 length of segment : 245 time for calcul the mask position with numpy : 0.002704143524169922 nb_pixel_total : 61779 time to create 1 rle with old method : 0.07243967056274414 length of segment : 253 time for calcul the mask position with numpy : 0.0008032321929931641 nb_pixel_total : 10012 time to create 1 rle with old method : 0.012123823165893555 length of segment : 99 time for calcul the mask position with numpy : 0.0013492107391357422 nb_pixel_total : 32395 time to create 1 rle with old method : 0.037740468978881836 length of segment : 172 time for calcul the mask position with numpy : 0.00037097930908203125 nb_pixel_total : 3815 time to create 1 rle with old method : 0.004616975784301758 length of segment : 143 time for calcul the mask position with numpy : 0.003144979476928711 nb_pixel_total : 95895 time to create 1 rle with old method : 0.10619306564331055 length of segment : 389 time for calcul the mask position with numpy : 0.003471851348876953 nb_pixel_total : 66627 time to create 1 rle with old method : 0.07261252403259277 length of segment : 299 time for calcul the mask position with numpy : 0.0009071826934814453 nb_pixel_total : 12641 time to create 1 rle with old method : 0.014718770980834961 length of segment : 162 time for calcul the mask position with numpy : 0.005349397659301758 nb_pixel_total : 210212 time to create 1 rle with new method : 0.013078689575195312 length of segment : 456 time for calcul the mask position with numpy : 0.0021257400512695312 nb_pixel_total : 48385 time to create 1 rle with old method : 0.05471372604370117 length of segment : 227 time for calcul the mask position with numpy : 0.0005500316619873047 nb_pixel_total : 15138 time to create 1 rle with old method : 0.017187118530273438 length of segment : 136 time for calcul the mask position with numpy : 0.0009098052978515625 nb_pixel_total : 13956 time to create 1 rle with old method : 0.0158388614654541 length of segment : 216 time for calcul the mask position with numpy : 0.0015647411346435547 nb_pixel_total : 48512 time to create 1 rle with old method : 0.05832481384277344 length of segment : 160 time for calcul the mask position with numpy : 0.0005176067352294922 nb_pixel_total : 10978 time to create 1 rle with old method : 0.012321710586547852 length of segment : 154 time for calcul the mask position with numpy : 0.005613803863525391 nb_pixel_total : 118588 time to create 1 rle with old method : 0.1331486701965332 length of segment : 497 time for calcul the mask position with numpy : 0.0012326240539550781 nb_pixel_total : 33287 time to create 1 rle with old method : 0.03815579414367676 length of segment : 289 time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 15456 time to create 1 rle with old method : 0.01710200309753418 length of segment : 126 time for calcul the mask position with numpy : 0.004784584045410156 nb_pixel_total : 163914 time to create 1 rle with new method : 0.010222434997558594 length of segment : 625 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 8815 time to create 1 rle with old method : 0.010408639907836914 length of segment : 66 time for calcul the mask position with numpy : 0.0011510848999023438 nb_pixel_total : 22414 time to create 1 rle with old method : 0.026071548461914062 length of segment : 213 time for calcul the mask position with numpy : 0.0015201568603515625 nb_pixel_total : 45607 time to create 1 rle with old method : 0.05001664161682129 length of segment : 218 time for calcul the mask position with numpy : 0.0020606517791748047 nb_pixel_total : 41095 time to create 1 rle with old method : 0.04784250259399414 length of segment : 171 time for calcul the mask position with numpy : 0.0008089542388916016 nb_pixel_total : 27428 time to create 1 rle with old method : 0.03098130226135254 length of segment : 190 time for calcul the mask position with numpy : 0.000728607177734375 nb_pixel_total : 13610 time to create 1 rle with old method : 0.016269207000732422 length of segment : 123 time for calcul the mask position with numpy : 0.0006601810455322266 nb_pixel_total : 12576 time to create 1 rle with old method : 0.014486312866210938 length of segment : 152 time for calcul the mask position with numpy : 0.0009503364562988281 nb_pixel_total : 21340 time to create 1 rle with old method : 0.025056838989257812 length of segment : 173 time for calcul the mask position with numpy : 0.0009768009185791016 nb_pixel_total : 21652 time to create 1 rle with old method : 0.025191307067871094 length of segment : 185 time for calcul the mask position with numpy : 0.004067897796630859 nb_pixel_total : 117290 time to create 1 rle with old method : 0.12984633445739746 length of segment : 351 time for calcul the mask position with numpy : 0.0018808841705322266 nb_pixel_total : 52573 time to create 1 rle with old method : 0.05988121032714844 length of segment : 233 time for calcul the mask position with numpy : 0.001132965087890625 nb_pixel_total : 21960 time to create 1 rle with old method : 0.02486276626586914 length of segment : 258 time for calcul the mask position with numpy : 0.00042891502380371094 nb_pixel_total : 5473 time to create 1 rle with old method : 0.0067102909088134766 length of segment : 85 time for calcul the mask position with numpy : 0.0004515647888183594 nb_pixel_total : 7646 time to create 1 rle with old method : 0.008794784545898438 length of segment : 106 time for calcul the mask position with numpy : 0.010061025619506836 nb_pixel_total : 243137 time to create 1 rle with new method : 0.01817464828491211 length of segment : 596 time for calcul the mask position with numpy : 0.008544206619262695 nb_pixel_total : 211450 time to create 1 rle with new method : 0.01591801643371582 length of segment : 601 time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 17346 time to create 1 rle with old method : 0.019443035125732422 length of segment : 204 time for calcul the mask position with numpy : 0.003094196319580078 nb_pixel_total : 104272 time to create 1 rle with old method : 0.14182281494140625 length of segment : 338 time for calcul the mask position with numpy : 0.0005257129669189453 nb_pixel_total : 14529 time to create 1 rle with old method : 0.02430558204650879 length of segment : 130 time for calcul the mask position with numpy : 0.0010540485382080078 nb_pixel_total : 19915 time to create 1 rle with old method : 0.025012493133544922 length of segment : 174 time for calcul the mask position with numpy : 0.0012187957763671875 nb_pixel_total : 33890 time to create 1 rle with old method : 0.037789344787597656 length of segment : 253 time for calcul the mask position with numpy : 0.0012347698211669922 nb_pixel_total : 33684 time to create 1 rle with old method : 0.0377044677734375 length of segment : 208 time for calcul the mask position with numpy : 0.0009565353393554688 nb_pixel_total : 10298 time to create 1 rle with old method : 0.012287139892578125 length of segment : 168 time for calcul the mask position with numpy : 0.0008778572082519531 nb_pixel_total : 18286 time to create 1 rle with old method : 0.020778179168701172 length of segment : 205 time for calcul the mask position with numpy : 0.0009448528289794922 nb_pixel_total : 18938 time to create 1 rle with old method : 0.022665023803710938 length of segment : 171 time for calcul the mask position with numpy : 0.0020537376403808594 nb_pixel_total : 54622 time to create 1 rle with old method : 0.05984067916870117 length of segment : 363 time for calcul the mask position with numpy : 0.0011987686157226562 nb_pixel_total : 26242 time to create 1 rle with old method : 0.03132057189941406 length of segment : 223 time for calcul the mask position with numpy : 0.0006978511810302734 nb_pixel_total : 13445 time to create 1 rle with old method : 0.015846967697143555 length of segment : 90 time for calcul the mask position with numpy : 0.0014388561248779297 nb_pixel_total : 23730 time to create 1 rle with old method : 0.06516766548156738 length of segment : 181 time for calcul the mask position with numpy : 0.0034284591674804688 nb_pixel_total : 48184 time to create 1 rle with old method : 0.06762456893920898 length of segment : 277 time for calcul the mask position with numpy : 0.0011119842529296875 nb_pixel_total : 30448 time to create 1 rle with old method : 0.03429985046386719 length of segment : 182 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 7344 time to create 1 rle with old method : 0.008687257766723633 length of segment : 57 time for calcul the mask position with numpy : 0.0035049915313720703 nb_pixel_total : 103439 time to create 1 rle with old method : 0.11352133750915527 length of segment : 426 time for calcul the mask position with numpy : 0.0022478103637695312 nb_pixel_total : 61432 time to create 1 rle with old method : 0.08111572265625 length of segment : 225 time for calcul the mask position with numpy : 0.0024673938751220703 nb_pixel_total : 80756 time to create 1 rle with old method : 0.09030842781066895 length of segment : 307 time for calcul the mask position with numpy : 0.0014061927795410156 nb_pixel_total : 29353 time to create 1 rle with old method : 0.033557891845703125 length of segment : 263 time for calcul the mask position with numpy : 0.0012664794921875 nb_pixel_total : 37186 time to create 1 rle with old method : 0.04223966598510742 length of segment : 213 time for calcul the mask position with numpy : 0.0008168220520019531 nb_pixel_total : 24604 time to create 1 rle with old method : 0.02780318260192871 length of segment : 178 time for calcul the mask position with numpy : 0.0013480186462402344 nb_pixel_total : 38512 time to create 1 rle with old method : 0.05107736587524414 length of segment : 187 time for calcul the mask position with numpy : 0.0025415420532226562 nb_pixel_total : 69773 time to create 1 rle with old method : 0.0905158519744873 length of segment : 320 time for calcul the mask position with numpy : 0.001913309097290039 nb_pixel_total : 47755 time to create 1 rle with old method : 0.05509638786315918 length of segment : 236 time for calcul the mask position with numpy : 0.0025959014892578125 nb_pixel_total : 83487 time to create 1 rle with old method : 0.09541654586791992 length of segment : 331 time for calcul the mask position with numpy : 0.0011637210845947266 nb_pixel_total : 22904 time to create 1 rle with old method : 0.029454708099365234 length of segment : 217 time for calcul the mask position with numpy : 0.00418853759765625 nb_pixel_total : 119369 time to create 1 rle with old method : 0.1278235912322998 length of segment : 643 time for calcul the mask position with numpy : 0.0022611618041992188 nb_pixel_total : 37401 time to create 1 rle with old method : 0.04505276679992676 length of segment : 354 time for calcul the mask position with numpy : 0.0011668205261230469 nb_pixel_total : 22181 time to create 1 rle with old method : 0.0269010066986084 length of segment : 192 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 10951 time to create 1 rle with old method : 0.01332545280456543 length of segment : 160 time for calcul the mask position with numpy : 0.0010309219360351562 nb_pixel_total : 23619 time to create 1 rle with old method : 0.029045581817626953 length of segment : 148 time for calcul the mask position with numpy : 0.0026128292083740234 nb_pixel_total : 54466 time to create 1 rle with old method : 0.08655786514282227 length of segment : 240 time for calcul the mask position with numpy : 0.0037043094635009766 nb_pixel_total : 81967 time to create 1 rle with old method : 0.09406733512878418 length of segment : 313 time for calcul the mask position with numpy : 0.0033283233642578125 nb_pixel_total : 64173 time to create 1 rle with old method : 0.07716846466064453 length of segment : 413 time for calcul the mask position with numpy : 0.0037484169006347656 nb_pixel_total : 65027 time to create 1 rle with old method : 0.13567185401916504 length of segment : 230 time for calcul the mask position with numpy : 0.0011365413665771484 nb_pixel_total : 24192 time to create 1 rle with old method : 0.030546903610229492 length of segment : 193 time for calcul the mask position with numpy : 0.002241849899291992 nb_pixel_total : 60997 time to create 1 rle with old method : 0.06859374046325684 length of segment : 375 time for calcul the mask position with numpy : 0.004372119903564453 nb_pixel_total : 82122 time to create 1 rle with old method : 0.09657406806945801 length of segment : 387 time for calcul the mask position with numpy : 0.0004687309265136719 nb_pixel_total : 3360 time to create 1 rle with old method : 0.004051923751831055 length of segment : 157 time for calcul the mask position with numpy : 0.0003216266632080078 nb_pixel_total : 5779 time to create 1 rle with old method : 0.006959676742553711 length of segment : 99 time for calcul the mask position with numpy : 0.003662109375 nb_pixel_total : 75087 time to create 1 rle with old method : 0.08776712417602539 length of segment : 322 time for calcul the mask position with numpy : 0.001313924789428711 nb_pixel_total : 43135 time to create 1 rle with old method : 0.04801368713378906 length of segment : 228 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 4908 time to create 1 rle with old method : 0.005837202072143555 length of segment : 71 time for calcul the mask position with numpy : 0.0016286373138427734 nb_pixel_total : 42075 time to create 1 rle with old method : 0.0482785701751709 length of segment : 148 time for calcul the mask position with numpy : 0.001363515853881836 nb_pixel_total : 64599 time to create 1 rle with old method : 0.07405710220336914 length of segment : 369 time spent for convertir_results : 14.378017902374268 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 158 chid ids of type : 3594 Number RLEs to save : 40998 save missing photos in datou_result : time spend for datou_step_exec : 80.19064903259277 time spend to save output : 8.77315878868103 total time spend for step 1 : 88.9638078212738 step2:crop_condition Wed May 7 08:11:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 158 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 81 About to insert : list_path_to_insert length 81 new photo from crops ! About to upload 81 photos upload in portfolio : 3736932 init cache_photo without model_param we have 81 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746598335_3989887 we have uploaded 81 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.947574138641357 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746598356_3989887 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5207374095916748 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 70 About to insert : list_path_to_insert length 70 new photo from crops ! About to upload 70 photos upload in portfolio : 3736932 init cache_photo without model_param we have 70 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746598380_3989887 we have uploaded 70 photos in the portfolio 3736932 time of upload the photos Elapsed time : 17.84593152999878 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746598400_3989887 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.639676570892334 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356615713, 1356615708, 1356615702, 1356615698, 1356615665, 1356615622, 1356615614, 1356615607, 1356615603, 1356615600] Looping around the photos to save general results len do output : 158 /1356622834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356622999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356623066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615713', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615708', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615702', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615698', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615665', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615622', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615614', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615607', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615603', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615600', None, None, None, None, None, '2801596') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 484 time used for this insertion : 0.7241630554199219 save_final save missing photos in datou_result : time spend for datou_step_exec : 82.20720291137695 time spend to save output : 0.7298533916473389 total time spend for step 2 : 82.93705630302429 step3:rle_unique_nms_with_priority Wed May 7 08:13:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 158 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 3.972667932510376 time for calcul the mask position with numpy : 0.7540013790130615 nb_pixel_total : 6178722 time to create 1 rle with new method : 0.9405310153961182 time for calcul the mask position with numpy : 0.022526025772094727 nb_pixel_total : 67607 time to create 1 rle with old method : 0.07475733757019043 time for calcul the mask position with numpy : 0.024556398391723633 nb_pixel_total : 41918 time to create 1 rle with old method : 0.05092120170593262 time for calcul the mask position with numpy : 0.023209333419799805 nb_pixel_total : 69577 time to create 1 rle with old method : 0.07743334770202637 time for calcul the mask position with numpy : 0.021836519241333008 nb_pixel_total : 288913 time to create 1 rle with new method : 0.598684549331665 time for calcul the mask position with numpy : 0.02293086051940918 nb_pixel_total : 37619 time to create 1 rle with old method : 0.042714595794677734 time for calcul the mask position with numpy : 0.02173447608947754 nb_pixel_total : 51968 time to create 1 rle with old method : 0.056798696517944336 time for calcul the mask position with numpy : 0.02263331413269043 nb_pixel_total : 78672 time to create 1 rle with old method : 0.08483672142028809 time for calcul the mask position with numpy : 0.021642208099365234 nb_pixel_total : 38295 time to create 1 rle with old method : 0.041753292083740234 time for calcul the mask position with numpy : 0.02126455307006836 nb_pixel_total : 37777 time to create 1 rle with old method : 0.04073953628540039 time for calcul the mask position with numpy : 0.02050304412841797 nb_pixel_total : 17156 time to create 1 rle with old method : 0.01887798309326172 time for calcul the mask position with numpy : 0.021284103393554688 nb_pixel_total : 110666 time to create 1 rle with old method : 0.12573766708374023 time for calcul the mask position with numpy : 0.021578550338745117 nb_pixel_total : 31350 time to create 1 rle with old method : 0.051543474197387695 create new chi : 3.280653953552246 time to delete rle : 0.026763439178466797 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 9840 TO DO : save crop sub photo not yet done ! save time : 1.9924488067626953 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 5.148715019226074 time for calcul the mask position with numpy : 0.653710126876831 nb_pixel_total : 6179871 time to create 1 rle with new method : 1.09401535987854 time for calcul the mask position with numpy : 0.020461320877075195 nb_pixel_total : 231 time to create 1 rle with old method : 0.000499725341796875 time for calcul the mask position with numpy : 0.021309375762939453 nb_pixel_total : 85078 time to create 1 rle with old method : 0.0955970287322998 time for calcul the mask position with numpy : 0.02364659309387207 nb_pixel_total : 22577 time to create 1 rle with old method : 0.027072906494140625 time for calcul the mask position with numpy : 0.02795267105102539 nb_pixel_total : 122538 time to create 1 rle with old method : 0.16280269622802734 time for calcul the mask position with numpy : 0.02176833152770996 nb_pixel_total : 19653 time to create 1 rle with old method : 0.02165842056274414 time for calcul the mask position with numpy : 0.02330183982849121 nb_pixel_total : 103067 time to create 1 rle with old method : 0.11650204658508301 time for calcul the mask position with numpy : 0.025126934051513672 nb_pixel_total : 167551 time to create 1 rle with new method : 1.2958447933197021 time for calcul the mask position with numpy : 0.023380517959594727 nb_pixel_total : 72921 time to create 1 rle with old method : 0.07886552810668945 time for calcul the mask position with numpy : 0.026995420455932617 nb_pixel_total : 84609 time to create 1 rle with old method : 0.10880804061889648 time for calcul the mask position with numpy : 0.02600860595703125 nb_pixel_total : 65379 time to create 1 rle with old method : 0.07628273963928223 time for calcul the mask position with numpy : 0.021482229232788086 nb_pixel_total : 87076 time to create 1 rle with old method : 0.09456133842468262 time for calcul the mask position with numpy : 0.021106481552124023 nb_pixel_total : 39689 time to create 1 rle with old method : 0.04275083541870117 create new chi : 4.212085723876953 time to delete rle : 0.001321554183959961 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9435 TO DO : save crop sub photo not yet done ! save time : 2.046724557876587 nb_obj : 23 nb_hashtags : 2 time to prepare the origin masks : 10.431976318359375 time for calcul the mask position with numpy : 0.6085994243621826 nb_pixel_total : 5822885 time to create 1 rle with new method : 0.7515459060668945 time for calcul the mask position with numpy : 0.021251916885375977 nb_pixel_total : 46867 time to create 1 rle with old method : 0.0517268180847168 time for calcul the mask position with numpy : 0.02273082733154297 nb_pixel_total : 7217 time to create 1 rle with old method : 0.012600421905517578 time for calcul the mask position with numpy : 0.02278923988342285 nb_pixel_total : 23568 time to create 1 rle with old method : 0.03865218162536621 time for calcul the mask position with numpy : 0.024476051330566406 nb_pixel_total : 7206 time to create 1 rle with old method : 0.008017539978027344 time for calcul the mask position with numpy : 0.021800994873046875 nb_pixel_total : 46656 time to create 1 rle with old method : 0.05700516700744629 time for calcul the mask position with numpy : 0.021832942962646484 nb_pixel_total : 52397 time to create 1 rle with old method : 0.0606074333190918 time for calcul the mask position with numpy : 0.021120071411132812 nb_pixel_total : 39651 time to create 1 rle with old method : 0.044149160385131836 time for calcul the mask position with numpy : 0.021491527557373047 nb_pixel_total : 50968 time to create 1 rle with old method : 0.060500144958496094 time for calcul the mask position with numpy : 0.027322769165039062 nb_pixel_total : 57143 time to create 1 rle with old method : 0.06341075897216797 time for calcul the mask position with numpy : 0.023195505142211914 nb_pixel_total : 31638 time to create 1 rle with old method : 0.0350494384765625 time for calcul the mask position with numpy : 0.0215299129486084 nb_pixel_total : 66830 time to create 1 rle with old method : 0.07351875305175781 time for calcul the mask position with numpy : 0.023682594299316406 nb_pixel_total : 199406 time to create 1 rle with new method : 1.1576611995697021 time for calcul the mask position with numpy : 0.04287981986999512 nb_pixel_total : 68635 time to create 1 rle with old method : 0.09071803092956543 time for calcul the mask position with numpy : 0.021921157836914062 nb_pixel_total : 25336 time to create 1 rle with old method : 0.027588844299316406 time for calcul the mask position with numpy : 0.021814823150634766 nb_pixel_total : 83239 time to create 1 rle with old method : 0.09219241142272949 time for calcul the mask position with numpy : 0.023768186569213867 nb_pixel_total : 108762 time to create 1 rle with old method : 0.12069177627563477 time for calcul the mask position with numpy : 0.021157264709472656 nb_pixel_total : 64492 time to create 1 rle with old method : 0.07037973403930664 time for calcul the mask position with numpy : 0.022188663482666016 nb_pixel_total : 33407 time to create 1 rle with old method : 0.03761696815490723 time for calcul the mask position with numpy : 0.022284269332885742 nb_pixel_total : 20250 time to create 1 rle with old method : 0.022475004196166992 time for calcul the mask position with numpy : 0.02176499366760254 nb_pixel_total : 32987 time to create 1 rle with old method : 0.035280466079711914 time for calcul the mask position with numpy : 0.02302718162536621 nb_pixel_total : 94056 time to create 1 rle with old method : 0.10440659523010254 time for calcul the mask position with numpy : 0.025175094604492188 nb_pixel_total : 41982 time to create 1 rle with old method : 0.06091761589050293 time for calcul the mask position with numpy : 0.026723623275756836 nb_pixel_total : 24662 time to create 1 rle with old method : 0.028574228286743164 create new chi : 4.3433756828308105 time to delete rle : 0.002275705337524414 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 14882 TO DO : save crop sub photo not yet done ! save time : 2.3906075954437256 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 6.360516786575317 time for calcul the mask position with numpy : 0.7035074234008789 nb_pixel_total : 6527155 time to create 1 rle with new method : 0.5759057998657227 time for calcul the mask position with numpy : 0.02357029914855957 nb_pixel_total : 80531 time to create 1 rle with old method : 0.11817383766174316 time for calcul the mask position with numpy : 0.03568696975708008 nb_pixel_total : 2255 time to create 1 rle with old method : 0.002850770950317383 time for calcul the mask position with numpy : 0.036342620849609375 nb_pixel_total : 5956 time to create 1 rle with old method : 0.0067901611328125 time for calcul the mask position with numpy : 0.03481745719909668 nb_pixel_total : 63895 time to create 1 rle with old method : 0.07176899909973145 time for calcul the mask position with numpy : 0.02576279640197754 nb_pixel_total : 19237 time to create 1 rle with old method : 0.02400040626525879 time for calcul the mask position with numpy : 0.02407670021057129 nb_pixel_total : 34619 time to create 1 rle with old method : 0.03875613212585449 time for calcul the mask position with numpy : 0.022767066955566406 nb_pixel_total : 9177 time to create 1 rle with old method : 0.010487794876098633 time for calcul the mask position with numpy : 0.02278280258178711 nb_pixel_total : 85254 time to create 1 rle with old method : 0.09550905227661133 time for calcul the mask position with numpy : 0.022980213165283203 nb_pixel_total : 34864 time to create 1 rle with old method : 0.03892111778259277 time for calcul the mask position with numpy : 0.02303338050842285 nb_pixel_total : 40160 time to create 1 rle with old method : 0.045212507247924805 time for calcul the mask position with numpy : 0.02337932586669922 nb_pixel_total : 38127 time to create 1 rle with old method : 0.04272913932800293 time for calcul the mask position with numpy : 0.024087190628051758 nb_pixel_total : 60009 time to create 1 rle with old method : 0.06857824325561523 time for calcul the mask position with numpy : 0.02417778968811035 nb_pixel_total : 26127 time to create 1 rle with old method : 0.04032707214355469 time for calcul the mask position with numpy : 0.023686885833740234 nb_pixel_total : 22874 time to create 1 rle with old method : 0.03286266326904297 create new chi : 2.329069137573242 time to delete rle : 0.0012865066528320312 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8303 TO DO : save crop sub photo not yet done ! save time : 0.9667551517486572 nb_obj : 27 nb_hashtags : 2 time to prepare the origin masks : 4.07416296005249 time for calcul the mask position with numpy : 0.7429380416870117 nb_pixel_total : 5736480 time to create 1 rle with new method : 0.7964940071105957 time for calcul the mask position with numpy : 0.02797985076904297 nb_pixel_total : 38765 time to create 1 rle with old method : 0.040564775466918945 time for calcul the mask position with numpy : 0.027637720108032227 nb_pixel_total : 180256 time to create 1 rle with new method : 0.527890682220459 time for calcul the mask position with numpy : 0.028905868530273438 nb_pixel_total : 210211 time to create 1 rle with new method : 0.5211942195892334 time for calcul the mask position with numpy : 0.026252269744873047 nb_pixel_total : 12641 time to create 1 rle with old method : 0.012991666793823242 time for calcul the mask position with numpy : 0.02677464485168457 nb_pixel_total : 20975 time to create 1 rle with old method : 0.022574901580810547 time for calcul the mask position with numpy : 0.027753114700317383 nb_pixel_total : 3815 time to create 1 rle with old method : 0.003994941711425781 time for calcul the mask position with numpy : 0.02671074867248535 nb_pixel_total : 12181 time to create 1 rle with old method : 0.012545347213745117 time for calcul the mask position with numpy : 0.026508808135986328 nb_pixel_total : 50101 time to create 1 rle with old method : 0.05188703536987305 time for calcul the mask position with numpy : 0.027448654174804688 nb_pixel_total : 40881 time to create 1 rle with old method : 0.04228973388671875 time for calcul the mask position with numpy : 0.027538537979125977 nb_pixel_total : 36605 time to create 1 rle with old method : 0.039433956146240234 time for calcul the mask position with numpy : 0.0279848575592041 nb_pixel_total : 48385 time to create 1 rle with old method : 0.05191159248352051 time for calcul the mask position with numpy : 0.027511119842529297 nb_pixel_total : 10263 time to create 1 rle with old method : 0.010792732238769531 time for calcul the mask position with numpy : 0.027482986450195312 nb_pixel_total : 92602 time to create 1 rle with old method : 0.09992432594299316 time for calcul the mask position with numpy : 0.028288841247558594 nb_pixel_total : 32395 time to create 1 rle with old method : 0.03644752502441406 time for calcul the mask position with numpy : 0.028917312622070312 nb_pixel_total : 32409 time to create 1 rle with old method : 0.03604912757873535 time for calcul the mask position with numpy : 0.02818894386291504 nb_pixel_total : 15348 time to create 1 rle with old method : 0.01663994789123535 time for calcul the mask position with numpy : 0.028189420700073242 nb_pixel_total : 54174 time to create 1 rle with old method : 0.0590667724609375 time for calcul the mask position with numpy : 0.02786707878112793 nb_pixel_total : 27031 time to create 1 rle with old method : 0.030060768127441406 time for calcul the mask position with numpy : 0.028931856155395508 nb_pixel_total : 40039 time to create 1 rle with old method : 0.044530391693115234 time for calcul the mask position with numpy : 0.028469085693359375 nb_pixel_total : 95895 time to create 1 rle with old method : 0.12122654914855957 time for calcul the mask position with numpy : 0.03271484375 nb_pixel_total : 51757 time to create 1 rle with old method : 0.055548906326293945 time for calcul the mask position with numpy : 0.02873969078063965 nb_pixel_total : 66627 time to create 1 rle with old method : 0.07152915000915527 time for calcul the mask position with numpy : 0.02775716781616211 nb_pixel_total : 19178 time to create 1 rle with old method : 0.02031111717224121 time for calcul the mask position with numpy : 0.027709245681762695 nb_pixel_total : 61779 time to create 1 rle with old method : 0.06598734855651855 time for calcul the mask position with numpy : 0.028149127960205078 nb_pixel_total : 32459 time to create 1 rle with old method : 0.03524470329284668 time for calcul the mask position with numpy : 0.02843499183654785 nb_pixel_total : 16976 time to create 1 rle with old method : 0.01850104331970215 time for calcul the mask position with numpy : 0.02760481834411621 nb_pixel_total : 10012 time to create 1 rle with old method : 0.010344982147216797 create new chi : 4.436066627502441 time to delete rle : 0.0020172595977783203 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 15018 TO DO : save crop sub photo not yet done ! save time : 2.1549501419067383 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 4.086491107940674 time for calcul the mask position with numpy : 1.0110280513763428 nb_pixel_total : 6485135 time to create 1 rle with new method : 1.0301001071929932 time for calcul the mask position with numpy : 0.021627187728881836 nb_pixel_total : 27428 time to create 1 rle with old method : 0.03014349937438965 time for calcul the mask position with numpy : 0.021255970001220703 nb_pixel_total : 41095 time to create 1 rle with old method : 0.04540848731994629 time for calcul the mask position with numpy : 0.02141857147216797 nb_pixel_total : 45607 time to create 1 rle with old method : 0.04896211624145508 time for calcul the mask position with numpy : 0.020722389221191406 nb_pixel_total : 22414 time to create 1 rle with old method : 0.024580955505371094 time for calcul the mask position with numpy : 0.021208763122558594 nb_pixel_total : 8815 time to create 1 rle with old method : 0.009335041046142578 time for calcul the mask position with numpy : 0.0225369930267334 nb_pixel_total : 163914 time to create 1 rle with new method : 0.7292385101318359 time for calcul the mask position with numpy : 0.021960020065307617 nb_pixel_total : 15373 time to create 1 rle with old method : 0.017233610153198242 time for calcul the mask position with numpy : 0.020981550216674805 nb_pixel_total : 33287 time to create 1 rle with old method : 0.03575849533081055 time for calcul the mask position with numpy : 0.022153615951538086 nb_pixel_total : 118588 time to create 1 rle with old method : 0.1240537166595459 time for calcul the mask position with numpy : 0.02123570442199707 nb_pixel_total : 10978 time to create 1 rle with old method : 0.01150822639465332 time for calcul the mask position with numpy : 0.021511554718017578 nb_pixel_total : 48512 time to create 1 rle with old method : 0.050641775131225586 time for calcul the mask position with numpy : 0.02115178108215332 nb_pixel_total : 13956 time to create 1 rle with old method : 0.014973640441894531 time for calcul the mask position with numpy : 0.021558046340942383 nb_pixel_total : 15138 time to create 1 rle with old method : 0.015934228897094727 create new chi : 3.5363683700561523 time to delete rle : 0.0012083053588867188 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8271 TO DO : save crop sub photo not yet done ! save time : 1.777299404144287 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 4.81266713142395 time for calcul the mask position with numpy : 0.6658756732940674 nb_pixel_total : 6186071 time to create 1 rle with new method : 0.7771368026733398 time for calcul the mask position with numpy : 0.03436875343322754 nb_pixel_total : 14529 time to create 1 rle with old method : 0.01574254035949707 time for calcul the mask position with numpy : 0.0206906795501709 nb_pixel_total : 103587 time to create 1 rle with old method : 0.11365675926208496 time for calcul the mask position with numpy : 0.02109837532043457 nb_pixel_total : 17346 time to create 1 rle with old method : 0.019551753997802734 time for calcul the mask position with numpy : 0.023290395736694336 nb_pixel_total : 211450 time to create 1 rle with new method : 0.5998320579528809 time for calcul the mask position with numpy : 0.022916078567504883 nb_pixel_total : 243137 time to create 1 rle with new method : 0.5408604145050049 time for calcul the mask position with numpy : 0.023183584213256836 nb_pixel_total : 7646 time to create 1 rle with old method : 0.010680913925170898 time for calcul the mask position with numpy : 0.023529529571533203 nb_pixel_total : 5473 time to create 1 rle with old method : 0.006301403045654297 time for calcul the mask position with numpy : 0.0222628116607666 nb_pixel_total : 21960 time to create 1 rle with old method : 0.024526119232177734 time for calcul the mask position with numpy : 0.022269487380981445 nb_pixel_total : 52573 time to create 1 rle with old method : 0.05716371536254883 time for calcul the mask position with numpy : 0.022596359252929688 nb_pixel_total : 117290 time to create 1 rle with old method : 0.12926840782165527 time for calcul the mask position with numpy : 0.02220010757446289 nb_pixel_total : 21652 time to create 1 rle with old method : 0.03700065612792969 time for calcul the mask position with numpy : 0.025356769561767578 nb_pixel_total : 21340 time to create 1 rle with old method : 0.0410304069519043 time for calcul the mask position with numpy : 0.030809879302978516 nb_pixel_total : 12576 time to create 1 rle with old method : 0.017266035079956055 time for calcul the mask position with numpy : 0.026269912719726562 nb_pixel_total : 13610 time to create 1 rle with old method : 0.015340328216552734 create new chi : 3.501852035522461 time to delete rle : 0.0013463497161865234 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9197 TO DO : save crop sub photo not yet done ! save time : 0.7333080768585205 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 3.937814235687256 time for calcul the mask position with numpy : 0.5776453018188477 nb_pixel_total : 6797190 time to create 1 rle with new method : 0.8393630981445312 time for calcul the mask position with numpy : 0.023092985153198242 nb_pixel_total : 23730 time to create 1 rle with old method : 0.02671504020690918 time for calcul the mask position with numpy : 0.0233154296875 nb_pixel_total : 13445 time to create 1 rle with old method : 0.01525568962097168 time for calcul the mask position with numpy : 0.02322864532470703 nb_pixel_total : 26242 time to create 1 rle with old method : 0.029401063919067383 time for calcul the mask position with numpy : 0.024425506591796875 nb_pixel_total : 54622 time to create 1 rle with old method : 0.06167864799499512 time for calcul the mask position with numpy : 0.02369379997253418 nb_pixel_total : 18938 time to create 1 rle with old method : 0.021225690841674805 time for calcul the mask position with numpy : 0.021953821182250977 nb_pixel_total : 18286 time to create 1 rle with old method : 0.020369291305541992 time for calcul the mask position with numpy : 0.024392366409301758 nb_pixel_total : 10298 time to create 1 rle with old method : 0.011649370193481445 time for calcul the mask position with numpy : 0.02236461639404297 nb_pixel_total : 33684 time to create 1 rle with old method : 0.037450313568115234 time for calcul the mask position with numpy : 0.0233154296875 nb_pixel_total : 33890 time to create 1 rle with old method : 0.037782907485961914 time for calcul the mask position with numpy : 0.024658203125 nb_pixel_total : 19915 time to create 1 rle with old method : 0.02234506607055664 create new chi : 1.97798752784729 time to delete rle : 0.0011153221130371094 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 6232 TO DO : save crop sub photo not yet done ! save time : 0.6616325378417969 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 5.379340648651123 time for calcul the mask position with numpy : 0.6824355125427246 nb_pixel_total : 6365063 time to create 1 rle with new method : 0.6782314777374268 time for calcul the mask position with numpy : 0.02353668212890625 nb_pixel_total : 22904 time to create 1 rle with old method : 0.02689671516418457 time for calcul the mask position with numpy : 0.021600008010864258 nb_pixel_total : 83487 time to create 1 rle with old method : 0.09189295768737793 time for calcul the mask position with numpy : 0.02169322967529297 nb_pixel_total : 47755 time to create 1 rle with old method : 0.05364346504211426 time for calcul the mask position with numpy : 0.02400803565979004 nb_pixel_total : 69773 time to create 1 rle with old method : 0.10399174690246582 time for calcul the mask position with numpy : 0.021371841430664062 nb_pixel_total : 38512 time to create 1 rle with old method : 0.04291558265686035 time for calcul the mask position with numpy : 0.02177119255065918 nb_pixel_total : 24604 time to create 1 rle with old method : 0.027225017547607422 time for calcul the mask position with numpy : 0.02212357521057129 nb_pixel_total : 37186 time to create 1 rle with old method : 0.0482485294342041 time for calcul the mask position with numpy : 0.024550914764404297 nb_pixel_total : 29353 time to create 1 rle with old method : 0.04456782341003418 time for calcul the mask position with numpy : 0.023273944854736328 nb_pixel_total : 80756 time to create 1 rle with old method : 0.09268665313720703 time for calcul the mask position with numpy : 0.02452254295349121 nb_pixel_total : 61432 time to create 1 rle with old method : 0.0749349594116211 time for calcul the mask position with numpy : 0.02140641212463379 nb_pixel_total : 103439 time to create 1 rle with old method : 0.11194038391113281 time for calcul the mask position with numpy : 0.020017147064208984 nb_pixel_total : 7344 time to create 1 rle with old method : 0.008150577545166016 time for calcul the mask position with numpy : 0.02170705795288086 nb_pixel_total : 30448 time to create 1 rle with old method : 0.03375411033630371 time for calcul the mask position with numpy : 0.02223992347717285 nb_pixel_total : 48184 time to create 1 rle with old method : 0.052094459533691406 create new chi : 2.528602123260498 time to delete rle : 0.0013241767883300781 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8998 TO DO : save crop sub photo not yet done ! save time : 1.9713678359985352 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 6.251985549926758 time for calcul the mask position with numpy : 0.7610855102539062 nb_pixel_total : 6225163 time to create 1 rle with new method : 0.36214518547058105 time for calcul the mask position with numpy : 0.020029306411743164 nb_pixel_total : 4288 time to create 1 rle with old method : 0.005062580108642578 time for calcul the mask position with numpy : 0.020075082778930664 nb_pixel_total : 42075 time to create 1 rle with old method : 0.04585123062133789 time for calcul the mask position with numpy : 0.021892309188842773 nb_pixel_total : 4908 time to create 1 rle with old method : 0.0055582523345947266 time for calcul the mask position with numpy : 0.022680044174194336 nb_pixel_total : 43135 time to create 1 rle with old method : 0.0485231876373291 time for calcul the mask position with numpy : 0.023398637771606445 nb_pixel_total : 75087 time to create 1 rle with old method : 0.0841071605682373 time for calcul the mask position with numpy : 0.022729873657226562 nb_pixel_total : 5779 time to create 1 rle with old method : 0.006349802017211914 time for calcul the mask position with numpy : 0.021016836166381836 nb_pixel_total : 3340 time to create 1 rle with old method : 0.003926992416381836 time for calcul the mask position with numpy : 0.02167201042175293 nb_pixel_total : 82122 time to create 1 rle with old method : 0.09334874153137207 time for calcul the mask position with numpy : 0.024640321731567383 nb_pixel_total : 60997 time to create 1 rle with old method : 0.08259344100952148 time for calcul the mask position with numpy : 0.02304220199584961 nb_pixel_total : 24192 time to create 1 rle with old method : 0.026395797729492188 time for calcul the mask position with numpy : 0.020935773849487305 nb_pixel_total : 65027 time to create 1 rle with old method : 0.07500576972961426 time for calcul the mask position with numpy : 0.02719736099243164 nb_pixel_total : 64173 time to create 1 rle with old method : 0.07126688957214355 time for calcul the mask position with numpy : 0.023110628128051758 nb_pixel_total : 81967 time to create 1 rle with old method : 0.08948898315429688 time for calcul the mask position with numpy : 0.021494150161743164 nb_pixel_total : 54466 time to create 1 rle with old method : 0.060034990310668945 time for calcul the mask position with numpy : 0.021831750869750977 nb_pixel_total : 23619 time to create 1 rle with old method : 0.026519298553466797 time for calcul the mask position with numpy : 0.023938655853271484 nb_pixel_total : 10951 time to create 1 rle with old method : 0.01220393180847168 time for calcul the mask position with numpy : 0.021674633026123047 nb_pixel_total : 22181 time to create 1 rle with old method : 0.02445387840270996 time for calcul the mask position with numpy : 0.03432655334472656 nb_pixel_total : 37401 time to create 1 rle with old method : 0.04076266288757324 time for calcul the mask position with numpy : 0.03402400016784668 nb_pixel_total : 119369 time to create 1 rle with old method : 0.13237690925598145 create new chi : 2.5459845066070557 time to delete rle : 0.0021026134490966797 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 11964 TO DO : save crop sub photo not yet done ! save time : 1.6326277256011963 map_output_result : {1356615713: (0.0, 'Should be the crop_list due to order', 0), 1356615708: (0.0, 'Should be the crop_list due to order', 0), 1356615702: (0.0, 'Should be the crop_list due to order', 0), 1356615698: (0.0, 'Should be the crop_list due to order', 0), 1356615665: (0.0, 'Should be the crop_list due to order', 0), 1356615622: (0.0, 'Should be the crop_list due to order', 0), 1356615614: (0.0, 'Should be the crop_list due to order', 0), 1356615607: (0.0, 'Should be the crop_list due to order', 0), 1356615603: (0.0, 'Should be the crop_list due to order', 0), 1356615600: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356615713, 1356615708, 1356615702, 1356615698, 1356615665, 1356615622, 1356615614, 1356615607, 1356615603, 1356615600] Looping around the photos to save general results len do output : 10 /1356615713.Didn't retrieve data . /1356615708.Didn't retrieve data . /1356615702.Didn't retrieve data . /1356615698.Didn't retrieve data . /1356615665.Didn't retrieve data . /1356615622.Didn't retrieve data . /1356615614.Didn't retrieve data . /1356615607.Didn't retrieve data . /1356615603.Didn't retrieve data . /1356615600.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615713', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615708', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615702', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615698', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615665', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615622', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615614', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615607', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615603', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615600', None, None, None, None, None, '2801596') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.016099214553833008 save_final save missing photos in datou_result : time spend for datou_step_exec : 104.6283791065216 time spend to save output : 0.021534204483032227 total time spend for step 3 : 104.64991331100464 step4:ventilate_hashtags_in_portfolio Wed May 7 08:15:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22755885 get user id for portfolio 22755885 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22755885 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_clair','background','pehd','autre','pet_fonce','flou','carton','environnement','papier','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22755885 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_clair','background','pehd','autre','pet_fonce','flou','carton','environnement','papier','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22755885 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_clair','background','pehd','autre','pet_fonce','flou','carton','environnement','papier','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22756239,22756240,22756241,22756242,22756243,22756244,22756245,22756246,22756247,22756248,22756249?tags=metal,pet_clair,background,pehd,autre,pet_fonce,flou,carton,environnement,papier,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356615713, 1356615708, 1356615702, 1356615698, 1356615665, 1356615622, 1356615614, 1356615607, 1356615603, 1356615600] Looping around the photos to save general results len do output : 1 /22755885. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615713', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615708', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615702', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615698', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615665', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615622', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615614', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615607', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615603', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615600', None, None, None, None, None, '2801596') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014206886291503906 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.649785041809082 time spend to save output : 0.014622688293457031 total time spend for step 4 : 1.664407730102539 step5:final Wed May 7 08:15:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356615713: ('0.11345237892610745',), 1356615708: ('0.11345237892610745',), 1356615702: ('0.11345237892610745',), 1356615698: ('0.11345237892610745',), 1356615665: ('0.11345237892610745',), 1356615622: ('0.11345237892610745',), 1356615614: ('0.11345237892610745',), 1356615607: ('0.11345237892610745',), 1356615603: ('0.11345237892610745',), 1356615600: ('0.11345237892610745',)} new output for save of step final : {1356615713: ('0.11345237892610745',), 1356615708: ('0.11345237892610745',), 1356615702: ('0.11345237892610745',), 1356615698: ('0.11345237892610745',), 1356615665: ('0.11345237892610745',), 1356615622: ('0.11345237892610745',), 1356615614: ('0.11345237892610745',), 1356615607: ('0.11345237892610745',), 1356615603: ('0.11345237892610745',), 1356615600: ('0.11345237892610745',)} [1356615713, 1356615708, 1356615702, 1356615698, 1356615665, 1356615622, 1356615614, 1356615607, 1356615603, 1356615600] Looping around the photos to save general results len do output : 10 /1356615713.Didn't retrieve data . /1356615708.Didn't retrieve data . /1356615702.Didn't retrieve data . /1356615698.Didn't retrieve data . /1356615665.Didn't retrieve data . /1356615622.Didn't retrieve data . /1356615614.Didn't retrieve data . /1356615607.Didn't retrieve data . /1356615603.Didn't retrieve data . /1356615600.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615713', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615708', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615702', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615698', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615665', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615622', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615614', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615607', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615603', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615600', None, None, None, None, None, '2801596') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013823986053466797 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11678409576416016 time spend to save output : 0.014340877532958984 total time spend for step 5 : 0.13112497329711914 step6:blur_detection Wed May 7 08:15:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46.jpg resize: (2160, 3264) 1356615713 -1.233977431544455 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad.jpg resize: (2160, 3264) 1356615708 -1.6654316454319218 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56.jpg resize: (2160, 3264) 1356615702 -3.5502800552266134 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad.jpg resize: (2160, 3264) 1356615698 -4.006858155893469 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d.jpg resize: (2160, 3264) 1356615665 -2.8749163734636607 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900.jpg resize: (2160, 3264) 1356615622 -1.5028991961294162 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8.jpg resize: (2160, 3264) 1356615614 -1.7713194828274186 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0.jpg resize: (2160, 3264) 1356615607 -1.7773744696449172 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4.jpg resize: (2160, 3264) 1356615603 -1.7212433505597875 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2.jpg resize: (2160, 3264) 1356615600 -1.727207987738903 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091703_0.png resize: (431, 222) 1356622834 -1.8448145849247106 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091697_0.png resize: (427, 244) 1356622836 -0.8461426585210194 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091699_0.png resize: (217, 221) 1356622837 -1.3729921950652744 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091698_0.png resize: (302, 315) 1356622838 -0.7432782312904088 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091692_0.png resize: (210, 262) 1356622839 0.03770066816823672 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091715_0.png resize: (271, 366) 1356622840 -1.8711855583229993 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091704_0.png resize: (266, 252) 1356622841 -0.28963843352881047 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091720_0.png resize: (308, 139) 1356622842 -2.15248237381972 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091730_0.png resize: (184, 428) 1356622843 -1.055873203592098 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091735_0.png resize: (128, 70) 1356622844 0.9545519209733607 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091736_0.png resize: (149, 240) 1356622845 -1.6810270836073558 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091716_0.png resize: (176, 212) 1356622846 0.2607220805418162 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091725_0.png resize: (226, 265) 1356622847 -0.8107088954306065 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091731_0.png resize: (410, 314) 1356622848 -1.2662851888065363 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091717_0.png resize: (316, 255) 1356622849 0.3675767665249572 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091739_0.png resize: (141, 213) 1356622850 -2.070641619989542 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091740_0.png resize: (245, 184) 1356622851 -2.0413783155802574 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091743_0.png resize: (256, 243) 1356622852 -0.9861188151424942 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091742_0.png resize: (231, 269) 1356622853 -3.9603769344434188 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091744_0.png resize: (252, 171) 1356622855 -0.25051283362692534 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091748_0.png resize: (185, 171) 1356622856 -2.0327550739587754 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091746_0.png resize: (115, 122) 1356622857 -1.2546458593015477 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091773_0.png resize: (170, 286) 1356622858 -2.073568478611337 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091753_0.png resize: (220, 221) 1356622860 -0.939954804240912 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091777_0.png resize: (159, 187) 1356622861 -1.5000250304904905 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091763_0.png resize: (203, 403) 1356622862 -1.5042114993435811 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091757_0.png resize: (166, 165) 1356622864 -1.4899054107765541 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091764_0.png resize: (167, 116) 1356622865 -1.4402415448498995 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091774_0.png resize: (116, 112) 1356622866 -2.6330428905519456 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091766_0.png resize: (165, 160) 1356622867 -0.13586477975359548 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091770_0.png resize: (193, 220) 1356622870 -2.0255332968557678 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091758_0.png resize: (185, 454) 1356622871 -1.603963708792656 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091761_0.png resize: (187, 124) 1356622872 -1.1400056817149025 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091776_0.png resize: (288, 392) 1356622874 -1.8081883196753823 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091755_0.png resize: (199, 111) 1356622875 -1.8792189040199103 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091768_0.png resize: (233, 234) 1356622876 -1.8255203335373358 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091759_0.png resize: (213, 111) 1356622877 -2.1051190223548217 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091772_0.png resize: (98, 203) 1356622878 -2.0569098305986704 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091765_0.png resize: (253, 296) 1356622879 -1.5024088854744164 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091754_0.png resize: (362, 798) 1356622881 -1.9950449440918578 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091756_0.png resize: (221, 235) 1356622882 -2.1721525596112907 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091771_0.png resize: (219, 454) 1356622883 -2.9588914558708135 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091760_0.png resize: (240, 242) 1356622884 -2.6041940705037803 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091791_0.png resize: (168, 385) 1356622885 -1.7942013406592254 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091788_0.png resize: (65, 167) 1356622886 -0.19222520493758746 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091783_0.png resize: (151, 92) 1356622887 -0.34939185778545234 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091780_0.png resize: (136, 141) 1356622888 -0.8267283183315632 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091792_0.png resize: (190, 185) 1356622889 -1.172670533003703 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091782_0.png resize: (156, 434) 1356622890 -1.2994947534952999 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091781_0.png resize: (207, 114) 1356622891 -1.3805618774485349 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091786_0.png resize: (125, 148) 1356622892 0.8984018401265543 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091785_0.png resize: (243, 183) 1356622893 -0.5695556838079808 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091794_0.png resize: (152, 110) 1356622894 -0.6468141685218607 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091806_0.png resize: (127, 149) 1356622895 -1.4898246135668949 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091803_0.png resize: (482, 627) 1356622896 -1.277253160773202 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091796_0.png resize: (183, 152) 1356622897 0.4216031962292198 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091799_0.png resize: (256, 129) 1356622898 -1.343746329259395 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091793_0.png resize: (123, 155) 1356622899 0.30317717580414055 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091801_0.png resize: (106, 119) 1356622900 0.8686787294630595 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091809_0.png resize: (184, 234) 1356622901 -0.771399115015097 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091813_0.png resize: (359, 211) 1356622902 -1.2034890876125242 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091816_0.png resize: (181, 169) 1356622903 -0.8944387286249394 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091808_0.png resize: (244, 167) 1356622904 -0.2554100978666583 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091811_0.png resize: (200, 126) 1356622905 -0.3551265762658838 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091807_0.png resize: (174, 155) 1356622906 -0.24144159158842307 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091810_0.png resize: (168, 198) 1356622907 -1.1210907372487469 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091823_0.png resize: (263, 226) 1356622908 -1.6686260614722463 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091818_0.png resize: (179, 260) 1356622909 -1.0327460049044144 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091824_0.png resize: (206, 248) 1356622910 -1.0820973832613274 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091830_0.png resize: (217, 268) 1356622911 -1.5996412942302691 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091826_0.png resize: (186, 343) 1356622912 -1.8820197544472115 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091848_0.png resize: (145, 359) 1356622913 -0.7813501080665315 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091839_0.png resize: (222, 343) 1356622914 -0.1388930259590169 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091844_0.png resize: (98, 85) 1356622915 -1.1488019190499505 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091834_0.png resize: (160, 93) 1356622916 -0.6653911007445117 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091843_0.png resize: (112, 137) 1356622917 -2.3816086433731183 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091847_0.png resize: (71, 87) 1356622918 0.9566820276542795 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091838_0.png resize: (194, 558) 1356622919 -2.0200729456189643 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091842_0.png resize: (387, 536) 1356622920 -0.9436941445129954 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091837_0.png resize: (303, 394) 1356622921 -1.82695053908252 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091841_0.png resize: (372, 284) 1356622922 -1.7415065957590208 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091747_0.png resize: (280, 171) 1356622925 -1.1204901725815386 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091795_0.png resize: (166, 171) 1356622926 -1.520832845312192 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091828_0.png resize: (184, 554) 1356622927 -1.2494117178558213 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091701_0.png resize: (241, 385) 1356622967 -1.7648157438957468 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091702_0.png resize: (337, 204) 1356622968 -1.5088634182545364 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091693_0.png resize: (375, 484) 1356622969 -0.5724815683411919 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091695_0.png resize: (207, 242) 1356622970 -1.1374336452699043 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091700_0.png resize: (496, 804) 1356622971 -0.7385687363845682 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091694_0.png resize: (104, 236) 1356622972 -2.4292274550354227 treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091696_0.png resize: (215, 245) 1356622973 -2.1224925880845738 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091710_0.png resize: (353, 363) 1356622974 -2.413277783194693 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091714_0.png resize: (312, 393) 1356622975 -1.2168979588763156 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091709_0.png resize: (689, 436) 1356622976 -1.124018069270509 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091712_0.png resize: (407, 468) 1356622977 -1.9580772630741499 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091705_0.png resize: (208, 564) 1356622978 -0.9506866729891202 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091708_0.png resize: (347, 259) 1356622979 -0.8831817325759982 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091707_0.png resize: (358, 297) 1356622980 -2.5776714052695584 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091711_0.png resize: (92, 264) 1356622981 2.2962035475610767 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091713_0.png resize: (124, 280) 1356622982 -0.08772867172038258 treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091706_0.png resize: (240, 346) 1356622983 -0.9136821087697927 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091727_0.png resize: (601, 454) 1356622985 -0.44256415154380857 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091724_0.png resize: (333, 528) 1356622986 -2.0883058230498004 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091723_0.png resize: (444, 329) 1356622987 -2.5037082645736533 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091737_0.png resize: (133, 202) 1356622988 -2.250959800476319 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091738_0.png resize: (200, 421) 1356622989 -3.044563259285299 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091722_0.png resize: (199, 461) 1356622990 -2.4631511627418945 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091721_0.png resize: (170, 246) 1356622991 1.983168684805997 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091729_0.png resize: (204, 236) 1356622992 -2.005381006652934 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091732_0.png resize: (132, 361) 1356622993 -3.5010909622130435 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091719_0.png resize: (124, 307) 1356622994 -1.5099738359108008 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091726_0.png resize: (288, 298) 1356622995 -3.037356424956589 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091733_0.png resize: (299, 299) 1356622996 -3.299147307529476 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091734_0.png resize: (349, 156) 1356622997 -0.20026674678087333 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091728_0.png resize: (233, 392) 1356622998 -3.9132598410153947 treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091718_0.png resize: (501, 213) 1356622999 -3.5162797218849633 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091752_0.png resize: (341, 339) 1356623000 -3.2241191520566983 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091741_0.png resize: (161, 548) 1356623001 -2.2861214795067246 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091749_0.png resize: (283, 312) 1356623002 -2.2388696529611054 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091751_0.png resize: (219, 171) 1356623003 -2.1789806332288637 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091745_0.png resize: (308, 404) 1356623004 -3.71249738852082 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091769_0.png resize: (207, 254) 1356623005 -1.1591570986128052 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091762_0.png resize: (142, 374) 1356623006 -1.2443547040602547 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091767_0.png resize: (271, 476) 1356623007 -1.3517968601600576 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091778_0.png resize: (455, 636) 1356623008 -1.3661566308224713 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091775_0.png resize: (298, 426) 1356623009 -2.0650683671005012 treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091779_0.png resize: (198, 361) 1356623010 -2.3980699944917494 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091790_0.png resize: (215, 326) 1356623011 -1.4754109174365404 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091789_0.png resize: (165, 218) 1356623012 -1.6750479213965404 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091784_0.png resize: (437, 448) 1356623013 -1.342423877612248 treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091787_0.png resize: (575, 446) 1356623014 -0.8820156153180548 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091804_0.png resize: (199, 159) 1356623015 -2.2737928606951723 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091798_0.png resize: (218, 342) 1356623016 -1.2998130216582744 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091797_0.png resize: (334, 473) 1356623017 -0.4478158896567369 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091800_0.png resize: (71, 156) 1356623018 -1.501579197745759 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091802_0.png resize: (564, 748) 1356623019 -2.9586648915360505 treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091805_0.png resize: (327, 508) 1356623020 -1.0273419590218245 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091814_0.png resize: (223, 220) 1356623022 -1.554591161172733 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091815_0.png resize: (79, 233) 1356623023 -1.3225695286164507 treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091812_0.png resize: (171, 195) 1356623024 -3.255380258300899 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091820_0.png resize: (381, 425) 1356623025 -1.2955124557651911 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091819_0.png resize: (57, 146) 1356623026 2.928836759366676 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091817_0.png resize: (277, 244) 1356623027 -3.509013666515155 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091822_0.png resize: (303, 362) 1356623028 -0.6364545229058858 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091821_0.png resize: (224, 335) 1356623029 -3.955698086765157 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091827_0.png resize: (318, 293) 1356623030 -0.8696039620445337 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091836_0.png resize: (236, 257) 1356623031 -0.029811924281359033 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091846_0.png resize: (226, 213) 1356623032 -1.185715715073008 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091845_0.png resize: (319, 312) 1356623033 -1.2936566688962574 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091835_0.png resize: (106, 286) 1356623034 -1.76442102117526 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091831_0.png resize: (576, 273) 1356623035 -1.4381734324780926 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091832_0.png resize: (336, 199) 1356623036 -1.8247087681149377 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091840_0.png resize: (190, 169) 1356623037 -0.964643427418521 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091849_0.png resize: (369, 309) 1356623038 -1.7633933973745748 treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091750_0.png resize: (71, 104) 1356623062 -0.5491055793531213 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091829_0.png resize: (330, 346) 1356623063 -1.3989145642921093 treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091825_0.png resize: (178, 184) 1356623064 -0.8822177271947839 treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091833_0.png resize: (192, 163) 1356623066 -0.837593367657104 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 168 time used for this insertion : 0.02071070671081543 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 168 time used for this insertion : 0.7593660354614258 save missing photos in datou_result : time spend for datou_step_exec : 35.80121469497681 time spend to save output : 0.7856721878051758 total time spend for step 6 : 36.58688688278198 step7:brightness Wed May 7 08:15:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46.jpg treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad.jpg treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56.jpg treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad.jpg treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d.jpg treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900.jpg treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8.jpg treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0.jpg treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4.jpg treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2.jpg treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091703_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091697_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091699_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091698_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091692_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091715_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091704_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091720_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091730_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091735_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091736_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091716_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091725_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091731_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091717_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091739_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091740_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091743_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091742_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091744_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091748_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091746_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091773_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091753_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091777_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091763_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091757_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091764_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091774_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091766_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091770_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091758_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091761_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091776_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091755_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091768_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091759_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091772_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091765_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091754_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091756_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091771_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091760_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091791_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091788_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091783_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091780_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091792_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091782_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091781_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091786_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091785_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091794_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091806_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091803_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091796_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091799_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091793_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091801_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091809_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091813_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091816_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091808_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091811_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091807_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091810_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091823_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091818_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091824_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091830_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091826_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091848_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091839_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091844_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091834_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091843_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091847_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091838_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091842_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091837_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091841_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091747_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091795_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091828_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091701_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091702_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091693_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091695_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091700_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091694_0.png treat image : temp/1746598229_3989887_1356615713_9b0090350cd7f54e60a9012c8ba8bf46_rle_crop_3788091696_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091710_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091714_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091709_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091712_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091705_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091708_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091707_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091711_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091713_0.png treat image : temp/1746598229_3989887_1356615708_2f3c0adac4b05f2b59cb3eb0659fd2ad_rle_crop_3788091706_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091727_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091724_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091723_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091737_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091738_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091722_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091721_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091729_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091732_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091719_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091726_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091733_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091734_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091728_0.png treat image : temp/1746598229_3989887_1356615702_fe42a72521304686966cab9d36557e56_rle_crop_3788091718_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091752_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091741_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091749_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091751_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091745_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091769_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091762_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091767_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091778_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091775_0.png treat image : temp/1746598229_3989887_1356615665_77b23b98998cea15e1995a9aeac2d43d_rle_crop_3788091779_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091790_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091789_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091784_0.png treat image : temp/1746598229_3989887_1356615622_65e871c572ab51dd3146baabb9da5900_rle_crop_3788091787_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091804_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091798_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091797_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091800_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091802_0.png treat image : temp/1746598229_3989887_1356615614_a31021448865907f96cc921ac65f65f8_rle_crop_3788091805_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091814_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091815_0.png treat image : temp/1746598229_3989887_1356615607_422bef3d8b30beb0fb92c731c8f346c0_rle_crop_3788091812_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091820_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091819_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091817_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091822_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091821_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091827_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091836_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091846_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091845_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091835_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091831_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091832_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091840_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091849_0.png treat image : temp/1746598229_3989887_1356615698_6983b7f6f9d2857d523fbab47f8664ad_rle_crop_3788091750_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091829_0.png treat image : temp/1746598229_3989887_1356615603_ffd4a7371f66c2a50cd4ed29865c87e4_rle_crop_3788091825_0.png treat image : temp/1746598229_3989887_1356615600_f9bdfdb8a3ed01756e873b5c8cb6d3b2_rle_crop_3788091833_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 168 time used for this insertion : 0.024128198623657227 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 168 time used for this insertion : 0.041959285736083984 save missing photos in datou_result : time spend for datou_step_exec : 11.511508464813232 time spend to save output : 0.07199430465698242 total time spend for step 7 : 11.583502769470215 step8:velours_tree Wed May 7 08:15:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.414043664932251 time spend to save output : 0.0001513957977294922 total time spend for step 8 : 0.41419506072998047 step9:send_mail_cod Wed May 7 08:15:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22755885_07-05-2025_08_15_57.pdf 22756239 imagette227562391746598557 22756240 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227562401746598557 22756241 imagette227562411746598559 22756242 imagette227562421746598559 22756243 change filename to text .change filename to text .change filename to text .change filename to text .imagette227562431746598559 22756244 imagette227562441746598559 22756245 imagette227562451746598559 22756246 change filename to text .change filename to text .change filename to text .imagette227562461746598559 22756248 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227562481746598559 22756249 imagette227562491746598560 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22755885 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22756239,22756240,22756241,22756242,22756243,22756244,22756245,22756246,22756247,22756248,22756249?tags=metal,pet_clair,background,pehd,autre,pet_fonce,flou,carton,environnement,papier,mal_croppe args[1356615713] : ((1356615713, -1.233977431544455, 492688767), (1356615713, 0.11164491985728435, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615708] : ((1356615708, -1.6654316454319218, 492688767), (1356615708, 0.08305206960276701, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615702] : ((1356615702, -3.5502800552266134, 492609224), (1356615702, 0.4368678427742248, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615698] : ((1356615698, -4.006858155893469, 492609224), (1356615698, 0.09733441121301603, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615665] : ((1356615665, -2.8749163734636607, 492609224), (1356615665, 0.007871759315843375, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615622] : ((1356615622, -1.5028991961294162, 492688767), (1356615622, 0.045037404426014345, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615614] : ((1356615614, -1.7713194828274186, 492688767), (1356615614, 0.20930256467943065, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615607] : ((1356615607, -1.7773744696449172, 492688767), (1356615607, 0.28955834451154444, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615603] : ((1356615603, -1.7212433505597875, 492688767), (1356615603, 0.19992202046234553, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com args[1356615600] : ((1356615600, -1.727207987738903, 492688767), (1356615600, 0.0029782201585672992, 2107752395), '0.11345237892610745') We are sending mail with results at report@fotonower.com refus_total : 0.11345237892610745 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22755885 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22755885_07-05-2025_08_15_57.pdf results_Auto_P22755885_07-05-2025_08_15_57.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22755885_07-05-2025_08_15_57.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22755885','results_Auto_P22755885_07-05-2025_08_15_57.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22755885_07-05-2025_08_15_57.pdf','pdf','','0.58','0.11345237892610745') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22755885

https://www.fotonower.com/image?json=false&list_photos_id=1356615713
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615708
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615702
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615698
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615665
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615622
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615614
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615607
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615603
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356615600
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.35%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22756240?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22756243?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22756246?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22756248?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22755885_07-05-2025_08_15_57.pdf.

Lien vers velours :https://www.fotonower.com/velours/22756239,22756240,22756241,22756242,22756243,22756244,22756245,22756246,22756247,22756248,22756249?tags=metal,pet_clair,background,pehd,autre,pet_fonce,flou,carton,environnement,papier,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 07 May 2025 06:16:04 GMT Content-Length: 0 Connection: close X-Message-Id: JabBqxKeSw-TqlqFcuYCug Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356615713, 1356615708, 1356615702, 1356615698, 1356615665, 1356615622, 1356615614, 1356615607, 1356615603, 1356615600] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615713', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615708', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615702', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615698', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615665', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615622', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615614', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615607', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615603', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615600', None, None, None, None, None, '2801596') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.09301090240478516 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.8090903759002686 time spend to save output : 0.09330010414123535 total time spend for step 9 : 6.902390480041504 step10:split_time_score Wed May 7 08:16:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07052025 22755885 Nombre de photos uploadées : 10 / 23040 (0%) 07052025 22755885 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 07052025 22755885 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.000339508056640625 elapsed_time : insert_dashboard_record_day_entry 0.0276336669921875 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.11345237892610745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22755885_07-05-2025_08_15_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22755885 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22755885 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07052025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356615713, 1356615708, 1356615702, 1356615698, 1356615665, 1356615622, 1356615614, 1356615607, 1356615603, 1356615600] Looping around the photos to save general results len do output : 1 /22755885Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615713', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615708', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615702', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615698', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615665', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615622', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615614', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615607', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615603', None, None, None, None, None, '2801596') ('3318', None, None, None, None, None, None, None, '2801596') ('3318', '22755885', '1356615600', None, None, None, None, None, '2801596') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.03855705261230469 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3333134651184082 time spend to save output : 0.03884291648864746 total time spend for step 10 : 0.37215638160705566 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 146.78user 125.87system 5:40.60elapsed 80%CPU (0avgtext+0avgdata 5692996maxresident)k 623912inputs+83816outputs (8514major+13323894minor)pagefaults 0swaps