python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2077933 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3678213'] with mtr_portfolio_ids : ['26639471'] and first list_photo_ids : [] new path : /proc/2077933/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 21 ; length of list_pids : 21 ; length of list_args : 21 time to download the photos : 2.6754562854766846 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Sep 8 13:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10373 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-08 13:10:33.910600: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-08 13:10:33.936595: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-08 13:10:33.938919: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4508000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-08 13:10:33.938988: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-08 13:10:33.943207: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-08 13:10:34.086269: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x18f7e180 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-08 13:10:34.086355: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-08 13:10:34.087586: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-08 13:10:34.088029: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-08 13:10:34.090552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-08 13:10:34.093018: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-08 13:10:34.093438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-08 13:10:34.095986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-08 13:10:34.097381: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-08 13:10:34.104214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-08 13:10:34.105970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-08 13:10:34.106109: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-08 13:10:34.106928: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-08 13:10:34.106947: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-08 13:10:34.106956: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-08 13:10:34.108845: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9608 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-08 13:10:34.443569: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-08 13:10:34.443645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-08 13:10:34.443662: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-08 13:10:34.443681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-08 13:10:34.443696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-08 13:10:34.443710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-08 13:10:34.443724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-08 13:10:34.443740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-08 13:10:34.445050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-08 13:10:34.446295: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-08 13:10:34.446333: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-08 13:10:34.446349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-08 13:10:34.446363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-08 13:10:34.446377: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-08 13:10:34.446391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-08 13:10:34.446405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-08 13:10:34.446419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-08 13:10:34.447679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-08 13:10:34.447713: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-08 13:10:34.447722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-08 13:10:34.447729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-08 13:10:34.449074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9608 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-08 13:10:44.126728: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-08 13:10:44.390222: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-08 13:10:46.151319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.152026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.152644: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.153253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.153867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.154449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.155045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.155095: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.156025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.156048: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.164677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.164712: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.165302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.165320: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.173989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.174103: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.174763: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.174788: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.216790: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.216881: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.217482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.217500: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.226799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.226853: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.227468: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.227487: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-08 13:10:46.275974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.276651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.279953: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.280600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.325053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.325809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.330031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.330653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.364480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.365249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.367528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.368163: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.377976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.378713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.381656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.382353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.390623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.391202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.392997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.393634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.433624: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.434301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.434917: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.435527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.440288: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.440911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.459134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.459827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.460460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.461072: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.476598: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.477266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.477859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.478444: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.483307: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.484028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.488638: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.489238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.502010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.502604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.506897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.507555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.508153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.508782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.509837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.510450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.521421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.522042: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.522654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.523242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.523824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.524388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.524976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.525574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.536942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.537551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.543836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.544395: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.607638: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.608276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.608886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.609473: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.619244: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.619852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.649471: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.650167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.650915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.651659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.657500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.658285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.659086: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.659682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.661497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.661540: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-08 13:10:46.672454: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.673080: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.683867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.684471: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.685122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.685722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.686302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-08 13:10:46.686851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 21 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 2078428 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 433 tf kernel not reseted sub process len(results) : 21 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 21 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1626 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010654926300048828 nb_pixel_total : 12432 time to create 1 rle with old method : 0.03617262840270996 length of segment : 135 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 20675 time to create 1 rle with old method : 0.038858652114868164 length of segment : 132 time for calcul the mask position with numpy : 0.0016417503356933594 nb_pixel_total : 60274 time to create 1 rle with old method : 0.07528448104858398 length of segment : 300 time for calcul the mask position with numpy : 0.00020837783813476562 nb_pixel_total : 5036 time to create 1 rle with old method : 0.006133556365966797 length of segment : 76 time for calcul the mask position with numpy : 0.00043129920959472656 nb_pixel_total : 12031 time to create 1 rle with old method : 0.014215230941772461 length of segment : 129 time for calcul the mask position with numpy : 0.00026154518127441406 nb_pixel_total : 10695 time to create 1 rle with old method : 0.013097524642944336 length of segment : 95 time for calcul the mask position with numpy : 0.0002739429473876953 nb_pixel_total : 11902 time to create 1 rle with old method : 0.01394510269165039 length of segment : 133 time for calcul the mask position with numpy : 0.0001399517059326172 nb_pixel_total : 3944 time to create 1 rle with old method : 0.004927396774291992 length of segment : 60 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 6601 time to create 1 rle with old method : 0.007812738418579102 length of segment : 111 time for calcul the mask position with numpy : 0.0004074573516845703 nb_pixel_total : 9847 time to create 1 rle with old method : 0.011594533920288086 length of segment : 156 time for calcul the mask position with numpy : 0.0004508495330810547 nb_pixel_total : 23922 time to create 1 rle with old method : 0.027700185775756836 length of segment : 150 time for calcul the mask position with numpy : 0.0006458759307861328 nb_pixel_total : 16670 time to create 1 rle with old method : 0.019873619079589844 length of segment : 195 time for calcul the mask position with numpy : 0.0004048347473144531 nb_pixel_total : 9130 time to create 1 rle with old method : 0.011002779006958008 length of segment : 123 time for calcul the mask position with numpy : 0.0010013580322265625 nb_pixel_total : 35477 time to create 1 rle with old method : 0.0413813591003418 length of segment : 173 time for calcul the mask position with numpy : 0.000885009765625 nb_pixel_total : 20532 time to create 1 rle with old method : 0.023782968521118164 length of segment : 294 time for calcul the mask position with numpy : 0.0004680156707763672 nb_pixel_total : 15529 time to create 1 rle with old method : 0.018270254135131836 length of segment : 121 time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 6420 time to create 1 rle with old method : 0.00771021842956543 length of segment : 146 time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 5745 time to create 1 rle with old method : 0.006975650787353516 length of segment : 106 time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 6900 time to create 1 rle with old method : 0.008200645446777344 length of segment : 180 time for calcul the mask position with numpy : 0.00024008750915527344 nb_pixel_total : 8295 time to create 1 rle with old method : 0.009950876235961914 length of segment : 115 time for calcul the mask position with numpy : 0.0002467632293701172 nb_pixel_total : 9199 time to create 1 rle with old method : 0.011177778244018555 length of segment : 144 time for calcul the mask position with numpy : 0.00011944770812988281 nb_pixel_total : 3393 time to create 1 rle with old method : 0.004157543182373047 length of segment : 76 time for calcul the mask position with numpy : 0.0002989768981933594 nb_pixel_total : 12275 time to create 1 rle with old method : 0.014787912368774414 length of segment : 131 time for calcul the mask position with numpy : 0.0007064342498779297 nb_pixel_total : 36855 time to create 1 rle with old method : 0.042514801025390625 length of segment : 296 time for calcul the mask position with numpy : 0.00045013427734375 nb_pixel_total : 9976 time to create 1 rle with old method : 0.01208043098449707 length of segment : 103 time for calcul the mask position with numpy : 0.0013015270233154297 nb_pixel_total : 17569 time to create 1 rle with old method : 0.021033048629760742 length of segment : 186 time for calcul the mask position with numpy : 0.0005390644073486328 nb_pixel_total : 15282 time to create 1 rle with old method : 0.018291473388671875 length of segment : 129 time for calcul the mask position with numpy : 0.0003323554992675781 nb_pixel_total : 8938 time to create 1 rle with old method : 0.01089024543762207 length of segment : 86 time for calcul the mask position with numpy : 0.003170013427734375 nb_pixel_total : 105722 time to create 1 rle with old method : 0.1204371452331543 length of segment : 531 time for calcul the mask position with numpy : 0.001003265380859375 nb_pixel_total : 41500 time to create 1 rle with old method : 0.0475153923034668 length of segment : 255 time for calcul the mask position with numpy : 0.0005776882171630859 nb_pixel_total : 21849 time to create 1 rle with old method : 0.025594711303710938 length of segment : 206 time for calcul the mask position with numpy : 0.0004565715789794922 nb_pixel_total : 22847 time to create 1 rle with old method : 0.030945539474487305 length of segment : 145 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 6596 time to create 1 rle with old method : 0.009197235107421875 length of segment : 93 time for calcul the mask position with numpy : 0.012134790420532227 nb_pixel_total : 454338 time to create 1 rle with new method : 0.028481483459472656 length of segment : 1455 time for calcul the mask position with numpy : 0.00024366378784179688 nb_pixel_total : 4974 time to create 1 rle with old method : 0.00594019889831543 length of segment : 86 time for calcul the mask position with numpy : 0.0007719993591308594 nb_pixel_total : 28147 time to create 1 rle with old method : 0.03493618965148926 length of segment : 243 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 11623 time to create 1 rle with old method : 0.013782024383544922 length of segment : 94 time for calcul the mask position with numpy : 0.00019598007202148438 nb_pixel_total : 1960 time to create 1 rle with old method : 0.002505064010620117 length of segment : 61 time for calcul the mask position with numpy : 0.0024390220642089844 nb_pixel_total : 83361 time to create 1 rle with old method : 0.09807085990905762 length of segment : 410 time for calcul the mask position with numpy : 0.0007002353668212891 nb_pixel_total : 21750 time to create 1 rle with old method : 0.025462865829467773 length of segment : 142 time for calcul the mask position with numpy : 0.010323047637939453 nb_pixel_total : 366897 time to create 1 rle with new method : 0.01813673973083496 length of segment : 1738 time for calcul the mask position with numpy : 0.0003428459167480469 nb_pixel_total : 9157 time to create 1 rle with old method : 0.01092672348022461 length of segment : 71 time for calcul the mask position with numpy : 0.00043654441833496094 nb_pixel_total : 8164 time to create 1 rle with old method : 0.0097503662109375 length of segment : 147 time for calcul the mask position with numpy : 0.0006101131439208984 nb_pixel_total : 13036 time to create 1 rle with old method : 0.015251874923706055 length of segment : 192 time for calcul the mask position with numpy : 0.0012400150299072266 nb_pixel_total : 33496 time to create 1 rle with old method : 0.0397493839263916 length of segment : 243 time for calcul the mask position with numpy : 0.0006930828094482422 nb_pixel_total : 17403 time to create 1 rle with old method : 0.020691871643066406 length of segment : 204 time for calcul the mask position with numpy : 0.0007681846618652344 nb_pixel_total : 19705 time to create 1 rle with old method : 0.023247957229614258 length of segment : 170 time for calcul the mask position with numpy : 0.0031850337982177734 nb_pixel_total : 103452 time to create 1 rle with old method : 0.11693716049194336 length of segment : 504 time for calcul the mask position with numpy : 0.0002551078796386719 nb_pixel_total : 3762 time to create 1 rle with old method : 0.004576206207275391 length of segment : 74 time for calcul the mask position with numpy : 0.0003845691680908203 nb_pixel_total : 6079 time to create 1 rle with old method : 0.0075452327728271484 length of segment : 83 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 16622 time to create 1 rle with old method : 0.022089481353759766 length of segment : 165 time for calcul the mask position with numpy : 0.0012078285217285156 nb_pixel_total : 29326 time to create 1 rle with old method : 0.035152435302734375 length of segment : 167 time for calcul the mask position with numpy : 0.0003018379211425781 nb_pixel_total : 10215 time to create 1 rle with old method : 0.012477397918701172 length of segment : 94 time for calcul the mask position with numpy : 0.003366231918334961 nb_pixel_total : 103845 time to create 1 rle with old method : 0.11917901039123535 length of segment : 527 time for calcul the mask position with numpy : 0.0006620883941650391 nb_pixel_total : 14584 time to create 1 rle with old method : 0.0176393985748291 length of segment : 116 time for calcul the mask position with numpy : 0.0006906986236572266 nb_pixel_total : 18243 time to create 1 rle with old method : 0.023303747177124023 length of segment : 187 time for calcul the mask position with numpy : 0.0005810260772705078 nb_pixel_total : 9379 time to create 1 rle with old method : 0.011223316192626953 length of segment : 150 time for calcul the mask position with numpy : 0.0010390281677246094 nb_pixel_total : 19240 time to create 1 rle with old method : 0.022431612014770508 length of segment : 299 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 9684 time to create 1 rle with old method : 0.01168203353881836 length of segment : 92 time for calcul the mask position with numpy : 0.0010223388671875 nb_pixel_total : 20074 time to create 1 rle with old method : 0.024110078811645508 length of segment : 217 time for calcul the mask position with numpy : 0.0004677772521972656 nb_pixel_total : 9901 time to create 1 rle with old method : 0.011899709701538086 length of segment : 114 time for calcul the mask position with numpy : 0.001024484634399414 nb_pixel_total : 29259 time to create 1 rle with old method : 0.03434300422668457 length of segment : 165 time for calcul the mask position with numpy : 0.0003757476806640625 nb_pixel_total : 6081 time to create 1 rle with old method : 0.007292032241821289 length of segment : 101 time for calcul the mask position with numpy : 0.00046133995056152344 nb_pixel_total : 13681 time to create 1 rle with old method : 0.015772342681884766 length of segment : 218 time for calcul the mask position with numpy : 0.0007719993591308594 nb_pixel_total : 27247 time to create 1 rle with old method : 0.03509044647216797 length of segment : 283 time for calcul the mask position with numpy : 0.0005614757537841797 nb_pixel_total : 16109 time to create 1 rle with old method : 0.018973588943481445 length of segment : 193 time for calcul the mask position with numpy : 0.0005931854248046875 nb_pixel_total : 16414 time to create 1 rle with old method : 0.01893472671508789 length of segment : 227 time for calcul the mask position with numpy : 0.0005507469177246094 nb_pixel_total : 18055 time to create 1 rle with old method : 0.021231889724731445 length of segment : 198 time for calcul the mask position with numpy : 0.0007143020629882812 nb_pixel_total : 25171 time to create 1 rle with old method : 0.029694080352783203 length of segment : 187 time for calcul the mask position with numpy : 0.0003542900085449219 nb_pixel_total : 9027 time to create 1 rle with old method : 0.010718107223510742 length of segment : 80 time for calcul the mask position with numpy : 0.0009698867797851562 nb_pixel_total : 24677 time to create 1 rle with old method : 0.028373241424560547 length of segment : 251 time for calcul the mask position with numpy : 0.00019431114196777344 nb_pixel_total : 3553 time to create 1 rle with old method : 0.004312038421630859 length of segment : 73 time for calcul the mask position with numpy : 0.0010294914245605469 nb_pixel_total : 36547 time to create 1 rle with old method : 0.0440526008605957 length of segment : 237 time for calcul the mask position with numpy : 0.00045871734619140625 nb_pixel_total : 11522 time to create 1 rle with old method : 0.013666629791259766 length of segment : 152 time for calcul the mask position with numpy : 0.0007123947143554688 nb_pixel_total : 21460 time to create 1 rle with old method : 0.025391101837158203 length of segment : 174 time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 17323 time to create 1 rle with old method : 0.01996445655822754 length of segment : 137 time for calcul the mask position with numpy : 0.00042748451232910156 nb_pixel_total : 12612 time to create 1 rle with old method : 0.02183246612548828 length of segment : 197 time for calcul the mask position with numpy : 0.0007841587066650391 nb_pixel_total : 8637 time to create 1 rle with old method : 0.01606011390686035 length of segment : 213 time for calcul the mask position with numpy : 0.0007081031799316406 nb_pixel_total : 24011 time to create 1 rle with old method : 0.03029346466064453 length of segment : 138 time for calcul the mask position with numpy : 0.0002338886260986328 nb_pixel_total : 4094 time to create 1 rle with old method : 0.005190610885620117 length of segment : 86 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 3769 time to create 1 rle with old method : 0.0046269893646240234 length of segment : 73 time for calcul the mask position with numpy : 0.00028228759765625 nb_pixel_total : 6539 time to create 1 rle with old method : 0.007767200469970703 length of segment : 95 time for calcul the mask position with numpy : 0.0009071826934814453 nb_pixel_total : 32545 time to create 1 rle with old method : 0.03733181953430176 length of segment : 222 time for calcul the mask position with numpy : 0.0008425712585449219 nb_pixel_total : 19196 time to create 1 rle with old method : 0.02219676971435547 length of segment : 333 time for calcul the mask position with numpy : 0.0020427703857421875 nb_pixel_total : 40445 time to create 1 rle with old method : 0.0538792610168457 length of segment : 216 time for calcul the mask position with numpy : 0.0006043910980224609 nb_pixel_total : 11206 time to create 1 rle with old method : 0.01419520378112793 length of segment : 145 time for calcul the mask position with numpy : 0.00015044212341308594 nb_pixel_total : 2675 time to create 1 rle with old method : 0.0033273696899414062 length of segment : 63 time for calcul the mask position with numpy : 0.0004718303680419922 nb_pixel_total : 10281 time to create 1 rle with old method : 0.012947559356689453 length of segment : 108 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 10212 time to create 1 rle with old method : 0.012379169464111328 length of segment : 135 time for calcul the mask position with numpy : 0.0003399848937988281 nb_pixel_total : 17503 time to create 1 rle with old method : 0.021180391311645508 length of segment : 113 time for calcul the mask position with numpy : 0.00049591064453125 nb_pixel_total : 8572 time to create 1 rle with old method : 0.010566473007202148 length of segment : 118 time for calcul the mask position with numpy : 0.00033855438232421875 nb_pixel_total : 9877 time to create 1 rle with old method : 0.011975526809692383 length of segment : 122 time for calcul the mask position with numpy : 0.005040168762207031 nb_pixel_total : 107672 time to create 1 rle with old method : 0.19224929809570312 length of segment : 525 time for calcul the mask position with numpy : 0.000690460205078125 nb_pixel_total : 16524 time to create 1 rle with old method : 0.03086376190185547 length of segment : 126 time for calcul the mask position with numpy : 0.0007121562957763672 nb_pixel_total : 15200 time to create 1 rle with old method : 0.028411865234375 length of segment : 224 time for calcul the mask position with numpy : 0.0006191730499267578 nb_pixel_total : 12158 time to create 1 rle with old method : 0.023070335388183594 length of segment : 160 time for calcul the mask position with numpy : 0.0030317306518554688 nb_pixel_total : 94809 time to create 1 rle with old method : 0.13675951957702637 length of segment : 473 time for calcul the mask position with numpy : 0.0004055500030517578 nb_pixel_total : 6376 time to create 1 rle with old method : 0.010515928268432617 length of segment : 145 time for calcul the mask position with numpy : 0.0003848075866699219 nb_pixel_total : 11764 time to create 1 rle with old method : 0.014141321182250977 length of segment : 126 time for calcul the mask position with numpy : 0.0006349086761474609 nb_pixel_total : 25921 time to create 1 rle with old method : 0.03159308433532715 length of segment : 148 time spent for convertir_results : 7.037566661834717 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 100 chid ids of type : 3594 Number RLEs to save : 20336 save missing photos in datou_result : time spend for datou_step_exec : 48.60386633872986 time spend to save output : 1.290123462677002 total time spend for step 1 : 49.89398980140686 step2:crop_condition Mon Sep 8 13:11:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 21 ! batch 1 Loaded 100 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757329883_2077933 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.27068829536438 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757329895_2077933 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.322984218597412 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757329899_2077933 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2832379341125488 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3736932 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757329906_2077933 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 42 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.085804224014282 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757329920_2077933 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.731687068939209 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757329924_2077933 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0649645328521729 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757329925_2077933 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0160496234893799 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1382527596, 1382527554, 1382527526, 1382527499, 1382527470, 1382527442, 1382526860, 1382526844, 1382526841, 1382526839, 1382526837, 1382526834, 1382526756, 1382526754, 1382526746, 1382526743, 1382526717, 1382526706, 1382526628, 1382526616, 1382526614] Looping around the photos to save general results len do output : 100 /1382530362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382530476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527596', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527554', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527526', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527499', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527470', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527442', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526860', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526844', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526841', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526839', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526837', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526834', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526756', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526754', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526746', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526743', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526717', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526706', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526628', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526616', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526614', None, None, None, None, None, '3678213') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 321 time used for this insertion : 0.03168940544128418 save_final save missing photos in datou_result : time spend for datou_step_exec : 45.697707414627075 time spend to save output : 0.0351717472076416 total time spend for step 2 : 45.73287916183472 step3:rle_unique_nms_with_priority Mon Sep 8 13:12:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 100 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.14115142822265625 time for calcul the mask position with numpy : 0.03431963920593262 nb_pixel_total : 1980219 time to create 1 rle with new method : 0.05389857292175293 time for calcul the mask position with numpy : 0.007149696350097656 nb_pixel_total : 60274 time to create 1 rle with old method : 0.06829547882080078 time for calcul the mask position with numpy : 0.007065534591674805 nb_pixel_total : 20675 time to create 1 rle with old method : 0.023729801177978516 time for calcul the mask position with numpy : 0.0073206424713134766 nb_pixel_total : 12432 time to create 1 rle with old method : 0.01409459114074707 create new chi : 0.21661949157714844 time to delete rle : 0.013909339904785156 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2214 TO DO : save crop sub photo not yet done ! save time : 0.18180274963378906 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04697370529174805 time for calcul the mask position with numpy : 0.02356410026550293 nb_pixel_total : 2056533 time to create 1 rle with new method : 0.03288006782531738 time for calcul the mask position with numpy : 0.00672602653503418 nb_pixel_total : 12031 time to create 1 rle with old method : 0.013670921325683594 time for calcul the mask position with numpy : 0.006668806076049805 nb_pixel_total : 5036 time to create 1 rle with old method : 0.0064563751220703125 create new chi : 0.09038615226745605 time to delete rle : 0.0002872943878173828 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1490 TO DO : save crop sub photo not yet done ! save time : 0.12975740432739258 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.09143352508544922 time for calcul the mask position with numpy : 0.029622316360473633 nb_pixel_total : 2006689 time to create 1 rle with new method : 0.060105085372924805 time for calcul the mask position with numpy : 0.0067021846771240234 nb_pixel_total : 23922 time to create 1 rle with old method : 0.029462337493896484 time for calcul the mask position with numpy : 0.0066890716552734375 nb_pixel_total : 9847 time to create 1 rle with old method : 0.012495279312133789 time for calcul the mask position with numpy : 0.006802558898925781 nb_pixel_total : 6601 time to create 1 rle with old method : 0.008687734603881836 time for calcul the mask position with numpy : 0.006656646728515625 nb_pixel_total : 3944 time to create 1 rle with old method : 0.005089759826660156 time for calcul the mask position with numpy : 0.006906270980834961 nb_pixel_total : 11902 time to create 1 rle with old method : 0.014936208724975586 time for calcul the mask position with numpy : 0.006424427032470703 nb_pixel_total : 10695 time to create 1 rle with old method : 0.013806343078613281 create new chi : 0.21497082710266113 time to delete rle : 0.0004589557647705078 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2490 TO DO : save crop sub photo not yet done ! save time : 0.1925334930419922 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.045633554458618164 time for calcul the mask position with numpy : 0.025527238845825195 nb_pixel_total : 2047800 time to create 1 rle with new method : 0.03340911865234375 time for calcul the mask position with numpy : 0.006763935089111328 nb_pixel_total : 9130 time to create 1 rle with old method : 0.010575532913208008 time for calcul the mask position with numpy : 0.006550312042236328 nb_pixel_total : 16670 time to create 1 rle with old method : 0.01996779441833496 create new chi : 0.10317111015319824 time to delete rle : 0.0003266334533691406 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1716 TO DO : save crop sub photo not yet done ! save time : 0.13863325119018555 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.049896955490112305 time for calcul the mask position with numpy : 0.023578166961669922 nb_pixel_total : 2017591 time to create 1 rle with new method : 0.03464221954345703 time for calcul the mask position with numpy : 0.006708383560180664 nb_pixel_total : 20532 time to create 1 rle with old method : 0.023878097534179688 time for calcul the mask position with numpy : 0.006732463836669922 nb_pixel_total : 35477 time to create 1 rle with old method : 0.04006075859069824 create new chi : 0.13600993156433105 time to delete rle : 0.0003991127014160156 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 2014 TO DO : save crop sub photo not yet done ! save time : 0.16317319869995117 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0510869026184082 time for calcul the mask position with numpy : 0.021872997283935547 nb_pixel_total : 2051651 time to create 1 rle with new method : 0.037481069564819336 time for calcul the mask position with numpy : 0.006837129592895508 nb_pixel_total : 6420 time to create 1 rle with old method : 0.00746464729309082 time for calcul the mask position with numpy : 0.006937503814697266 nb_pixel_total : 15529 time to create 1 rle with old method : 0.017769575119018555 create new chi : 0.0987863540649414 time to delete rle : 0.0003376007080078125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1614 TO DO : save crop sub photo not yet done ! save time : 0.13850140571594238 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.08751583099365234 time for calcul the mask position with numpy : 0.02040886878967285 nb_pixel_total : 2028542 time to create 1 rle with new method : 0.03209280967712402 time for calcul the mask position with numpy : 0.006662130355834961 nb_pixel_total : 12275 time to create 1 rle with old method : 0.014223337173461914 time for calcul the mask position with numpy : 0.0068929195404052734 nb_pixel_total : 2644 time to create 1 rle with old method : 0.003117799758911133 time for calcul the mask position with numpy : 0.00664520263671875 nb_pixel_total : 9199 time to create 1 rle with old method : 0.010747194290161133 time for calcul the mask position with numpy : 0.006651639938354492 nb_pixel_total : 8295 time to create 1 rle with old method : 0.009721994400024414 time for calcul the mask position with numpy : 0.006783008575439453 nb_pixel_total : 6900 time to create 1 rle with old method : 0.00806283950805664 time for calcul the mask position with numpy : 0.0068416595458984375 nb_pixel_total : 5745 time to create 1 rle with old method : 0.009271621704101562 create new chi : 0.14876174926757812 time to delete rle : 0.0008358955383300781 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2532 TO DO : save crop sub photo not yet done ! save time : 0.19932079315185547 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.13090252876281738 time for calcul the mask position with numpy : 0.020333528518676758 nb_pixel_total : 1984980 time to create 1 rle with new method : 0.034719228744506836 time for calcul the mask position with numpy : 0.006376028060913086 nb_pixel_total : 8938 time to create 1 rle with old method : 0.010228872299194336 time for calcul the mask position with numpy : 0.006364107131958008 nb_pixel_total : 15282 time to create 1 rle with old method : 0.017493009567260742 time for calcul the mask position with numpy : 0.007312774658203125 nb_pixel_total : 17569 time to create 1 rle with old method : 0.02109694480895996 time for calcul the mask position with numpy : 0.006388425827026367 nb_pixel_total : 9976 time to create 1 rle with old method : 0.01148843765258789 time for calcul the mask position with numpy : 0.006737470626831055 nb_pixel_total : 36855 time to create 1 rle with old method : 0.04222440719604492 create new chi : 0.19140958786010742 time to delete rle : 0.0005631446838378906 batch 1 Loaded 11 chid ids of type : 3594 +++++++++Number RLEs to save : 2680 TO DO : save crop sub photo not yet done ! save time : 0.21727991104125977 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06763386726379395 time for calcul the mask position with numpy : 0.020277976989746094 nb_pixel_total : 1881682 time to create 1 rle with new method : 0.03259849548339844 time for calcul the mask position with numpy : 0.006493806838989258 nb_pixel_total : 22847 time to create 1 rle with old method : 0.026429176330566406 time for calcul the mask position with numpy : 0.006481170654296875 nb_pixel_total : 21849 time to create 1 rle with old method : 0.024660587310791016 time for calcul the mask position with numpy : 0.006441354751586914 nb_pixel_total : 41500 time to create 1 rle with old method : 0.04726243019104004 time for calcul the mask position with numpy : 0.007344961166381836 nb_pixel_total : 105722 time to create 1 rle with old method : 0.12470316886901855 create new chi : 0.30331993103027344 time to delete rle : 0.0005702972412109375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3354 TO DO : save crop sub photo not yet done ! save time : 0.24258947372436523 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.08997249603271484 time for calcul the mask position with numpy : 0.017917156219482422 nb_pixel_total : 1565962 time to create 1 rle with new method : 0.03770279884338379 time for calcul the mask position with numpy : 0.0063152313232421875 nb_pixel_total : 1960 time to create 1 rle with old method : 0.0022766590118408203 time for calcul the mask position with numpy : 0.006154775619506836 nb_pixel_total : 11623 time to create 1 rle with old method : 0.013279438018798828 time for calcul the mask position with numpy : 0.006209611892700195 nb_pixel_total : 28147 time to create 1 rle with old method : 0.03224682807922363 time for calcul the mask position with numpy : 0.006473064422607422 nb_pixel_total : 4974 time to create 1 rle with old method : 0.0057108402252197266 time for calcul the mask position with numpy : 0.00928497314453125 nb_pixel_total : 454338 time to create 1 rle with new method : 0.030208110809326172 time for calcul the mask position with numpy : 0.006219148635864258 nb_pixel_total : 6596 time to create 1 rle with old method : 0.007483243942260742 create new chi : 0.18830513954162598 time to delete rle : 0.0008475780487060547 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 5144 TO DO : save crop sub photo not yet done ! save time : 0.3334794044494629 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.07554364204406738 time for calcul the mask position with numpy : 0.021149158477783203 nb_pixel_total : 1584271 time to create 1 rle with new method : 0.032947540283203125 time for calcul the mask position with numpy : 0.006354570388793945 nb_pixel_total : 8164 time to create 1 rle with old method : 0.009213685989379883 time for calcul the mask position with numpy : 0.006192922592163086 nb_pixel_total : 9157 time to create 1 rle with old method : 0.010494709014892578 time for calcul the mask position with numpy : 0.009749889373779297 nb_pixel_total : 366897 time to create 1 rle with new method : 0.030045270919799805 time for calcul the mask position with numpy : 0.006413936614990234 nb_pixel_total : 21750 time to create 1 rle with old method : 0.024671554565429688 time for calcul the mask position with numpy : 0.006722211837768555 nb_pixel_total : 83361 time to create 1 rle with old method : 0.09987902641296387 create new chi : 0.2648186683654785 time to delete rle : 0.001065969467163086 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 6096 TO DO : save crop sub photo not yet done ! save time : 0.4022352695465088 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 0.08919548988342285 time for calcul the mask position with numpy : 0.01720261573791504 nb_pixel_total : 1860045 time to create 1 rle with new method : 0.03693413734436035 time for calcul the mask position with numpy : 0.006188869476318359 nb_pixel_total : 16622 time to create 1 rle with old method : 0.01909613609313965 time for calcul the mask position with numpy : 0.006542205810546875 nb_pixel_total : 6079 time to create 1 rle with old method : 0.007077455520629883 time for calcul the mask position with numpy : 0.006727933883666992 nb_pixel_total : 3762 time to create 1 rle with old method : 0.004387617111206055 time for calcul the mask position with numpy : 0.008008480072021484 nb_pixel_total : 103452 time to create 1 rle with old method : 0.11705231666564941 time for calcul the mask position with numpy : 0.006831645965576172 nb_pixel_total : 19705 time to create 1 rle with old method : 0.022238731384277344 time for calcul the mask position with numpy : 0.006473064422607422 nb_pixel_total : 17403 time to create 1 rle with old method : 0.019945621490478516 time for calcul the mask position with numpy : 0.006872653961181641 nb_pixel_total : 33496 time to create 1 rle with old method : 0.038255929946899414 time for calcul the mask position with numpy : 0.006903648376464844 nb_pixel_total : 13036 time to create 1 rle with old method : 0.015003681182861328 create new chi : 0.35282444953918457 time to delete rle : 0.0008566379547119141 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++++Number RLEs to save : 4350 TO DO : save crop sub photo not yet done ! save time : 0.31619811058044434 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 0.0919640064239502 time for calcul the mask position with numpy : 0.01823711395263672 nb_pixel_total : 1869003 time to create 1 rle with new method : 0.03168654441833496 time for calcul the mask position with numpy : 0.006142377853393555 nb_pixel_total : 9684 time to create 1 rle with old method : 0.010897397994995117 time for calcul the mask position with numpy : 0.006083965301513672 nb_pixel_total : 19002 time to create 1 rle with old method : 0.021593809127807617 time for calcul the mask position with numpy : 0.00605320930480957 nb_pixel_total : 9379 time to create 1 rle with old method : 0.010594844818115234 time for calcul the mask position with numpy : 0.00622248649597168 nb_pixel_total : 18243 time to create 1 rle with old method : 0.020717620849609375 time for calcul the mask position with numpy : 0.0062713623046875 nb_pixel_total : 14584 time to create 1 rle with old method : 0.016706466674804688 time for calcul the mask position with numpy : 0.0076215267181396484 nb_pixel_total : 103845 time to create 1 rle with old method : 0.12391328811645508 time for calcul the mask position with numpy : 0.00686192512512207 nb_pixel_total : 534 time to create 1 rle with old method : 0.0010869503021240234 time for calcul the mask position with numpy : 0.006928920745849609 nb_pixel_total : 29326 time to create 1 rle with old method : 0.03399372100830078 create new chi : 0.34249258041381836 time to delete rle : 0.0008122920989990234 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 4150 TO DO : save crop sub photo not yet done ! save time : 0.2945537567138672 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.041491031646728516 time for calcul the mask position with numpy : 0.021570444107055664 nb_pixel_total : 2043625 time to create 1 rle with new method : 0.03066730499267578 time for calcul the mask position with numpy : 0.0070858001708984375 nb_pixel_total : 9901 time to create 1 rle with old method : 0.01211404800415039 time for calcul the mask position with numpy : 0.006571531295776367 nb_pixel_total : 20074 time to create 1 rle with old method : 0.02277517318725586 create new chi : 0.10111665725708008 time to delete rle : 0.0002875328063964844 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1742 TO DO : save crop sub photo not yet done ! save time : 0.14512324333190918 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.10921692848205566 time for calcul the mask position with numpy : 0.02186417579650879 nb_pixel_total : 1923462 time to create 1 rle with new method : 0.031929731369018555 time for calcul the mask position with numpy : 0.006298065185546875 nb_pixel_total : 25171 time to create 1 rle with old method : 0.03013896942138672 time for calcul the mask position with numpy : 0.0061838626861572266 nb_pixel_total : 16176 time to create 1 rle with old method : 0.01837158203125 time for calcul the mask position with numpy : 0.006409883499145508 nb_pixel_total : 16414 time to create 1 rle with old method : 0.018412113189697266 time for calcul the mask position with numpy : 0.006488323211669922 nb_pixel_total : 16109 time to create 1 rle with old method : 0.018283843994140625 time for calcul the mask position with numpy : 0.007693052291870117 nb_pixel_total : 27247 time to create 1 rle with old method : 0.030733346939086914 time for calcul the mask position with numpy : 0.006557464599609375 nb_pixel_total : 13681 time to create 1 rle with old method : 0.015500783920288086 time for calcul the mask position with numpy : 0.006337165832519531 nb_pixel_total : 6081 time to create 1 rle with old method : 0.006991386413574219 time for calcul the mask position with numpy : 0.006396770477294922 nb_pixel_total : 29259 time to create 1 rle with old method : 0.03316020965576172 create new chi : 0.2785072326660156 time to delete rle : 0.0007030963897705078 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 4118 TO DO : save crop sub photo not yet done ! save time : 0.27883005142211914 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04729294776916504 time for calcul the mask position with numpy : 0.021034955978393555 nb_pixel_total : 2039896 time to create 1 rle with new method : 0.03096175193786621 time for calcul the mask position with numpy : 0.006645917892456055 nb_pixel_total : 24677 time to create 1 rle with old method : 0.028249502182006836 time for calcul the mask position with numpy : 0.006513833999633789 nb_pixel_total : 9027 time to create 1 rle with old method : 0.010282278060913086 create new chi : 0.10406208038330078 time to delete rle : 0.0003771781921386719 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 1742 TO DO : save crop sub photo not yet done ! save time : 0.1546030044555664 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.07605314254760742 time for calcul the mask position with numpy : 0.01869678497314453 nb_pixel_total : 1970583 time to create 1 rle with new method : 0.030605077743530273 time for calcul the mask position with numpy : 0.0061223506927490234 nb_pixel_total : 12612 time to create 1 rle with old method : 0.014574527740478516 time for calcul the mask position with numpy : 0.006075382232666016 nb_pixel_total : 17323 time to create 1 rle with old method : 0.019968032836914062 time for calcul the mask position with numpy : 0.006146907806396484 nb_pixel_total : 21460 time to create 1 rle with old method : 0.0242617130279541 time for calcul the mask position with numpy : 0.006181001663208008 nb_pixel_total : 11522 time to create 1 rle with old method : 0.013133764266967773 time for calcul the mask position with numpy : 0.0061969757080078125 nb_pixel_total : 36547 time to create 1 rle with old method : 0.04098820686340332 time for calcul the mask position with numpy : 0.005990028381347656 nb_pixel_total : 3553 time to create 1 rle with old method : 0.00400090217590332 create new chi : 0.20346307754516602 time to delete rle : 0.0004985332489013672 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 3020 TO DO : save crop sub photo not yet done ! save time : 0.21939325332641602 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.05526876449584961 time for calcul the mask position with numpy : 0.01960897445678711 nb_pixel_total : 2033089 time to create 1 rle with new method : 0.030916929244995117 time for calcul the mask position with numpy : 0.006063222885131836 nb_pixel_total : 3769 time to create 1 rle with old method : 0.004288434982299805 time for calcul the mask position with numpy : 0.006280660629272461 nb_pixel_total : 4094 time to create 1 rle with old method : 0.0046389102935791016 time for calcul the mask position with numpy : 0.0063555240631103516 nb_pixel_total : 24011 time to create 1 rle with old method : 0.026950359344482422 time for calcul the mask position with numpy : 0.006024360656738281 nb_pixel_total : 8637 time to create 1 rle with old method : 0.009674549102783203 create new chi : 0.12118816375732422 time to delete rle : 0.00035762786865234375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2100 TO DO : save crop sub photo not yet done ! save time : 0.1717376708984375 nb_obj : 7 nb_hashtags : 5 time to prepare the origin masks : 0.07882523536682129 time for calcul the mask position with numpy : 0.019559383392333984 nb_pixel_total : 1950713 time to create 1 rle with new method : 0.03048396110534668 time for calcul the mask position with numpy : 0.006195545196533203 nb_pixel_total : 10281 time to create 1 rle with old method : 0.01183629035949707 time for calcul the mask position with numpy : 0.00626373291015625 nb_pixel_total : 2675 time to create 1 rle with old method : 0.0030908584594726562 time for calcul the mask position with numpy : 0.006266355514526367 nb_pixel_total : 11206 time to create 1 rle with old method : 0.012944459915161133 time for calcul the mask position with numpy : 0.006433725357055664 nb_pixel_total : 40445 time to create 1 rle with old method : 0.04610085487365723 time for calcul the mask position with numpy : 0.006329536437988281 nb_pixel_total : 19196 time to create 1 rle with old method : 0.022263765335083008 time for calcul the mask position with numpy : 0.0063533782958984375 nb_pixel_total : 32545 time to create 1 rle with old method : 0.037671566009521484 time for calcul the mask position with numpy : 0.006293773651123047 nb_pixel_total : 6539 time to create 1 rle with old method : 0.009000301361083984 create new chi : 0.23770546913146973 time to delete rle : 0.0005860328674316406 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 3444 TO DO : save crop sub photo not yet done ! save time : 0.23965096473693848 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.09988665580749512 time for calcul the mask position with numpy : 0.019410371780395508 nb_pixel_total : 1875882 time to create 1 rle with new method : 0.031159400939941406 time for calcul the mask position with numpy : 0.006150484085083008 nb_pixel_total : 12158 time to create 1 rle with old method : 0.01405954360961914 time for calcul the mask position with numpy : 0.008233785629272461 nb_pixel_total : 15200 time to create 1 rle with old method : 0.01727294921875 time for calcul the mask position with numpy : 0.006323575973510742 nb_pixel_total : 16524 time to create 1 rle with old method : 0.01875162124633789 time for calcul the mask position with numpy : 0.0068929195404052734 nb_pixel_total : 107672 time to create 1 rle with old method : 0.1250743865966797 time for calcul the mask position with numpy : 0.006596565246582031 nb_pixel_total : 9877 time to create 1 rle with old method : 0.011187314987182617 time for calcul the mask position with numpy : 0.006366729736328125 nb_pixel_total : 8572 time to create 1 rle with old method : 0.009812593460083008 time for calcul the mask position with numpy : 0.00688624382019043 nb_pixel_total : 17503 time to create 1 rle with old method : 0.01983642578125 time for calcul the mask position with numpy : 0.0063283443450927734 nb_pixel_total : 10212 time to create 1 rle with old method : 0.012974739074707031 create new chi : 0.33431291580200195 time to delete rle : 0.0009984970092773438 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 4126 TO DO : save crop sub photo not yet done ! save time : 0.2831990718841553 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.06821322441101074 time for calcul the mask position with numpy : 0.020758867263793945 nb_pixel_total : 1934730 time to create 1 rle with new method : 0.03245401382446289 time for calcul the mask position with numpy : 0.006456851959228516 nb_pixel_total : 25921 time to create 1 rle with old method : 0.030001163482666016 time for calcul the mask position with numpy : 0.006507158279418945 nb_pixel_total : 11764 time to create 1 rle with old method : 0.017885446548461914 time for calcul the mask position with numpy : 0.0062389373779296875 nb_pixel_total : 6376 time to create 1 rle with old method : 0.007645130157470703 time for calcul the mask position with numpy : 0.006644725799560547 nb_pixel_total : 94809 time to create 1 rle with old method : 0.10803818702697754 create new chi : 0.24315595626831055 time to delete rle : 0.0004417896270751953 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2864 TO DO : save crop sub photo not yet done ! save time : 0.21057605743408203 map_output_result : {1382527596: (0.0, 'Should be the crop_list due to order', 0), 1382527554: (0.0, 'Should be the crop_list due to order', 0), 1382527526: (0.0, 'Should be the crop_list due to order', 0), 1382527499: (0.0, 'Should be the crop_list due to order', 0), 1382527470: (0.0, 'Should be the crop_list due to order', 0), 1382527442: (0.0, 'Should be the crop_list due to order', 0), 1382526860: (0.0, 'Should be the crop_list due to order', 0), 1382526844: (0.0, 'Should be the crop_list due to order', 0), 1382526841: (0.0, 'Should be the crop_list due to order', 0), 1382526839: (0.0, 'Should be the crop_list due to order', 0), 1382526837: (0.0, 'Should be the crop_list due to order', 0), 1382526834: (0.0, 'Should be the crop_list due to order', 0), 1382526756: (0.0, 'Should be the crop_list due to order', 0), 1382526754: (0.0, 'Should be the crop_list due to order', 0), 1382526746: (0.0, 'Should be the crop_list due to order', 0), 1382526743: (0.0, 'Should be the crop_list due to order', 0), 1382526717: (0.0, 'Should be the crop_list due to order', 0), 1382526706: (0.0, 'Should be the crop_list due to order', 0), 1382526628: (0.0, 'Should be the crop_list due to order', 0), 1382526616: (0.0, 'Should be the crop_list due to order', 0), 1382526614: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1382527596, 1382527554, 1382527526, 1382527499, 1382527470, 1382527442, 1382526860, 1382526844, 1382526841, 1382526839, 1382526837, 1382526834, 1382526756, 1382526754, 1382526746, 1382526743, 1382526717, 1382526706, 1382526628, 1382526616, 1382526614] Looping around the photos to save general results len do output : 21 /1382527596.Didn't retrieve data . /1382527554.Didn't retrieve data . /1382527526.Didn't retrieve data . /1382527499.Didn't retrieve data . /1382527470.Didn't retrieve data . /1382527442.Didn't retrieve data . /1382526860.Didn't retrieve data . /1382526844.Didn't retrieve data . /1382526841.Didn't retrieve data . /1382526839.Didn't retrieve data . /1382526837.Didn't retrieve data . /1382526834.Didn't retrieve data . /1382526756.Didn't retrieve data . /1382526754.Didn't retrieve data . /1382526746.Didn't retrieve data . /1382526743.Didn't retrieve data . /1382526717.Didn't retrieve data . /1382526706.Didn't retrieve data . /1382526628.Didn't retrieve data . /1382526616.Didn't retrieve data . /1382526614.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527596', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527554', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527526', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527499', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527470', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527442', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526860', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526844', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526841', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526839', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526837', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526834', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526756', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526754', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526746', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526743', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526717', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526706', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526628', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526616', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526614', None, None, None, None, None, '3678213') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 63 time used for this insertion : 0.015346765518188477 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.252733707427979 time spend to save output : 0.016293048858642578 total time spend for step 3 : 11.269026756286621 step4:ventilate_hashtags_in_portfolio Mon Sep 8 13:12:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26639471 get user id for portfolio 26639471 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26639471 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','autre','background','pet_fonce','pet_clair','pehd','mal_croppe','environnement','carton','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26639471 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','autre','background','pet_fonce','pet_clair','pehd','mal_croppe','environnement','carton','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26639471 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','autre','background','pet_fonce','pet_clair','pehd','mal_croppe','environnement','carton','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26639515,26639516,26639517,26639518,26639519,26639520,26639521,26639522,26639523,26639524,26639525?tags=papier,flou,autre,background,pet_fonce,pet_clair,pehd,mal_croppe,environnement,carton,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1382527596, 1382527554, 1382527526, 1382527499, 1382527470, 1382527442, 1382526860, 1382526844, 1382526841, 1382526839, 1382526837, 1382526834, 1382526756, 1382526754, 1382526746, 1382526743, 1382526717, 1382526706, 1382526628, 1382526616, 1382526614] Looping around the photos to save general results len do output : 1 /26639471. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527596', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527554', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527526', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527499', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527470', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527442', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526860', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526844', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526841', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526839', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526837', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526834', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526756', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526754', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526746', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526743', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526717', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526706', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526628', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526616', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526614', None, None, None, None, None, '3678213') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 22 time used for this insertion : 0.01883554458618164 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6315386295318604 time spend to save output : 0.01922130584716797 total time spend for step 4 : 1.6507599353790283 step5:final Mon Sep 8 13:12:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1382527596: ('0.06518803277483833',), 1382527554: ('0.06518803277483833',), 1382527526: ('0.06518803277483833',), 1382527499: ('0.06518803277483833',), 1382527470: ('0.06518803277483833',), 1382527442: ('0.06518803277483833',), 1382526860: ('0.06518803277483833',), 1382526844: ('0.06518803277483833',), 1382526841: ('0.06518803277483833',), 1382526839: ('0.06518803277483833',), 1382526837: ('0.06518803277483833',), 1382526834: ('0.06518803277483833',), 1382526756: ('0.06518803277483833',), 1382526754: ('0.06518803277483833',), 1382526746: ('0.06518803277483833',), 1382526743: ('0.06518803277483833',), 1382526717: ('0.06518803277483833',), 1382526706: ('0.06518803277483833',), 1382526628: ('0.06518803277483833',), 1382526616: ('0.06518803277483833',), 1382526614: ('0.06518803277483833',)} new output for save of step final : {1382527596: ('0.06518803277483833',), 1382527554: ('0.06518803277483833',), 1382527526: ('0.06518803277483833',), 1382527499: ('0.06518803277483833',), 1382527470: ('0.06518803277483833',), 1382527442: ('0.06518803277483833',), 1382526860: ('0.06518803277483833',), 1382526844: ('0.06518803277483833',), 1382526841: ('0.06518803277483833',), 1382526839: ('0.06518803277483833',), 1382526837: ('0.06518803277483833',), 1382526834: ('0.06518803277483833',), 1382526756: ('0.06518803277483833',), 1382526754: ('0.06518803277483833',), 1382526746: ('0.06518803277483833',), 1382526743: ('0.06518803277483833',), 1382526717: ('0.06518803277483833',), 1382526706: ('0.06518803277483833',), 1382526628: ('0.06518803277483833',), 1382526616: ('0.06518803277483833',), 1382526614: ('0.06518803277483833',)} [1382527596, 1382527554, 1382527526, 1382527499, 1382527470, 1382527442, 1382526860, 1382526844, 1382526841, 1382526839, 1382526837, 1382526834, 1382526756, 1382526754, 1382526746, 1382526743, 1382526717, 1382526706, 1382526628, 1382526616, 1382526614] Looping around the photos to save general results len do output : 21 /1382527596.Didn't retrieve data . /1382527554.Didn't retrieve data . /1382527526.Didn't retrieve data . /1382527499.Didn't retrieve data . /1382527470.Didn't retrieve data . /1382527442.Didn't retrieve data . /1382526860.Didn't retrieve data . /1382526844.Didn't retrieve data . /1382526841.Didn't retrieve data . /1382526839.Didn't retrieve data . /1382526837.Didn't retrieve data . /1382526834.Didn't retrieve data . /1382526756.Didn't retrieve data . /1382526754.Didn't retrieve data . /1382526746.Didn't retrieve data . /1382526743.Didn't retrieve data . /1382526717.Didn't retrieve data . /1382526706.Didn't retrieve data . /1382526628.Didn't retrieve data . /1382526616.Didn't retrieve data . /1382526614.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527596', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527554', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527526', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527499', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527470', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527442', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526860', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526844', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526841', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526839', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526837', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526834', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526756', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526754', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526746', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526743', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526717', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526706', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526628', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526616', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526614', None, None, None, None, None, '3678213') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 63 time used for this insertion : 0.015447378158569336 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11683011054992676 time spend to save output : 0.016369342803955078 total time spend for step 5 : 0.13319945335388184 step6:blur_detection Mon Sep 8 13:12:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757329828_2077933_1382527596_36532731462bc657a81b035f1b61fe00.jpg resize: (1080, 1920) 1382527596 1.3987291085192952 treat image : temp/1757329828_2077933_1382527554_82af4ac31b4138e87d7fe9962919da8e.jpg resize: (1080, 1920) 1382527554 -2.3207717956110723 treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd.jpg resize: (1080, 1920) 1382527526 -0.7824939726202599 treat image : temp/1757329828_2077933_1382527499_8621ab94c35c2771d9f0b91a552d5839.jpg resize: (1080, 1920) 1382527499 2.056002361517531 treat image : temp/1757329828_2077933_1382527470_f7a5a65a66c5778c8035a3adf2f8f1f4.jpg resize: (1080, 1920) 1382527470 -3.3142018029215707 treat image : temp/1757329828_2077933_1382527442_386d4804f1d5219d9917693d201a4c1d.jpg resize: (1080, 1920) 1382527442 1.0703214530127056 treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5.jpg resize: (1080, 1920) 1382526860 -0.03460468058537715 treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24.jpg resize: (1080, 1920) 1382526844 -2.9376666231917397 treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520.jpg resize: (1080, 1920) 1382526841 0.6124507331873332 treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54.jpg resize: (1080, 1920) 1382526839 0.9635620532988425 treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049.jpg resize: (1080, 1920) 1382526837 0.8549542744194405 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836.jpg resize: (1080, 1920) 1382526834 -1.205228641502606 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796.jpg resize: (1080, 1920) 1382526756 2.8667690953717777 treat image : temp/1757329828_2077933_1382526754_d2fb9038a6066077f3ceedc807325ad0.jpg resize: (1080, 1920) 1382526754 0.1844745423938349 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6.jpg resize: (1080, 1920) 1382526746 2.0826008320715124 treat image : temp/1757329828_2077933_1382526743_f23b4274494c085626077f68d97b09d4.jpg resize: (1080, 1920) 1382526743 0.8489105914687375 treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf.jpg resize: (1080, 1920) 1382526717 0.36080041137830243 treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263.jpg resize: (1080, 1920) 1382526706 2.199797036936888 treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e.jpg resize: (1080, 1920) 1382526628 2.6275376724167527 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a.jpg resize: (1080, 1920) 1382526616 1.8422134798269072 treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6.jpg resize: (1080, 1920) 1382526614 1.6327860821136915 treat image : temp/1757329828_2077933_1382527596_36532731462bc657a81b035f1b61fe00_rle_crop_3950815644_0.png resize: (135, 161) 1382530362 -0.11479069176202022 treat image : temp/1757329828_2077933_1382527596_36532731462bc657a81b035f1b61fe00_rle_crop_3950815646_0.png resize: (239, 426) 1382530363 -1.1300821815421092 treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815652_0.png resize: (105, 90) 1382530364 0.8135568765087188 treat image : temp/1757329828_2077933_1382527499_8621ab94c35c2771d9f0b91a552d5839_rle_crop_3950815656_0.png resize: (121, 149) 1382530365 -0.2843812972095018 treat image : temp/1757329828_2077933_1382527470_f7a5a65a66c5778c8035a3adf2f8f1f4_rle_crop_3950815657_0.png resize: (170, 312) 1382530366 -3.296544496341295 treat image : temp/1757329828_2077933_1382527442_386d4804f1d5219d9917693d201a4c1d_rle_crop_3950815660_0.png resize: (146, 85) 1382530367 -1.4550313117824467 treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815661_0.png resize: (102, 66) 1382530368 7.8547213240244345 treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815662_0.png resize: (148, 84) 1382530369 -2.0187544892151714 treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815663_0.png resize: (115, 107) 1382530370 -1.299707068532896 treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815664_0.png resize: (106, 138) 1382530371 -2.0316947084277723 treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815665_0.png resize: (76, 62) 1382530372 -0.12096278991404695 treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815667_0.png resize: (216, 319) 1382530373 -3.1314232337251995 treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815668_0.png resize: (94, 163) 1382530374 -3.493385924211695 treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815670_0.png resize: (129, 190) 1382530375 -3.701335641643219 treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815671_0.png resize: (81, 136) 1382530376 -2.5025031545379344 treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815680_0.png resize: (91, 149) 1382530377 1.6100800654786234 treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815681_0.png resize: (61, 50) 1382530378 -1.1112502112726481 treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815683_0.png resize: (138, 182) 1382530379 0.8785998169423062 treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815686_0.png resize: (146, 80) 1382530380 -1.01632903644171 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815689_0.png resize: (148, 180) 1382530381 -3.886722387306047 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815696_0.png resize: (89, 176) 1382530382 -1.7677226785538709 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815699_0.png resize: (187, 153) 1382530383 -0.6115442407504238 treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815715_0.png resize: (73, 63) 1382530384 0.9947890955266356 treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263_rle_crop_3950815721_0.png resize: (213, 113) 1382530385 -1.4933071643543288 treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815725_0.png resize: (92, 98) 1382530386 0.5837850554817727 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815732_0.png resize: (135, 102) 1382530387 2.77850423671391 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815734_0.png resize: (109, 126) 1382530388 -1.5435600046133264 treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6_rle_crop_3950815741_0.png resize: (145, 76) 1382530389 -1.9452058171727153 treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6_rle_crop_3950815742_0.png resize: (125, 155) 1382530390 -1.1199547540388903 treat image : temp/1757329828_2077933_1382527470_f7a5a65a66c5778c8035a3adf2f8f1f4_rle_crop_3950815658_0.png resize: (256, 135) 1382530396 -1.981322770131197 treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815677_0.png resize: (916, 872) 1382530397 -0.5121144007766449 treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815682_0.png resize: (410, 279) 1382530398 -1.0290757254041931 treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815684_0.png resize: (902, 841) 1382530399 -0.8226242604407865 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815687_0.png resize: (186, 104) 1382530400 -1.886683445936098 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815690_0.png resize: (162, 174) 1382530401 -1.9903734086124667 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815695_0.png resize: (141, 340) 1382530402 -1.437888502571683 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815700_0.png resize: (150, 76) 1382530403 -0.14778235126032285 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815701_0.png resize: (290, 122) 1382530404 -2.394039831548199 treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263_rle_crop_3950815723_0.png resize: (86, 60) 1382530405 2.044896367403086 treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815727_0.png resize: (251, 105) 1382530406 -1.7285190679794655 treat image : temp/1757329828_2077933_1382526754_d2fb9038a6066077f3ceedc807325ad0_rle_crop_3950815704_0.png resize: (114, 105) 1382530407 0.21130938575077776 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815709_0.png resize: (192, 106) 1382530408 -0.09463772270127305 treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815729_0.png resize: (145, 110) 1382530409 -0.9504953854426937 treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815730_0.png resize: (61, 58) 1382530410 0.22134902311260987 treat image : temp/1757329828_2077933_1382527596_36532731462bc657a81b035f1b61fe00_rle_crop_3950815645_0.png resize: (132, 190) 1382530417 -0.3066740316134754 treat image : temp/1757329828_2077933_1382527554_82af4ac31b4138e87d7fe9962919da8e_rle_crop_3950815648_0.png resize: (125, 122) 1382530418 -2.372003677705663 treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815649_0.png resize: (87, 162) 1382530419 -2.1910121957022217 treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815650_0.png resize: (129, 128) 1382530420 -2.92740074152563 treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815653_0.png resize: (155, 93) 1382530421 -2.6230264828856638 treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815654_0.png resize: (147, 188) 1382530422 -1.1521908519703785 treat image : temp/1757329828_2077933_1382527499_8621ab94c35c2771d9f0b91a552d5839_rle_crop_3950815655_0.png resize: (192, 152) 1382530423 -2.8241345774800406 treat image : temp/1757329828_2077933_1382527442_386d4804f1d5219d9917693d201a4c1d_rle_crop_3950815659_0.png resize: (121, 159) 1382530424 -0.91137282290253 treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815669_0.png resize: (139, 337) 1382530425 -2.2786318662041065 treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520_rle_crop_3950815672_0.png resize: (531, 327) 1382530426 -0.49843386063285455 treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520_rle_crop_3950815673_0.png resize: (245, 237) 1382530427 -1.0996072989908556 treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520_rle_crop_3950815675_0.png resize: (145, 201) 1382530428 -0.5931777969715079 treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815678_0.png resize: (84, 74) 1382530429 -1.5658857159788635 treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815679_0.png resize: (229, 158) 1382530430 -0.3257749289662255 treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815685_0.png resize: (71, 173) 1382530431 1.2938078255000174 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815688_0.png resize: (168, 325) 1382530432 -1.8092501457427466 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815691_0.png resize: (504, 328) 1382530433 0.2113822152991899 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815692_0.png resize: (72, 64) 1382530434 0.07060359311477729 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815694_0.png resize: (165, 178) 1382530435 -1.427173893648726 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815697_0.png resize: (525, 326) 1382530436 0.14515165941004668 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815702_0.png resize: (92, 144) 1382530437 -0.8401596991085399 treat image : temp/1757329828_2077933_1382526754_d2fb9038a6066077f3ceedc807325ad0_rle_crop_3950815703_0.png resize: (150, 231) 1382530438 -2.1782563127929198 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815705_0.png resize: (153, 277) 1382530439 -0.2841957346528335 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815706_0.png resize: (101, 73) 1382530440 -0.19908274711543084 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815707_0.png resize: (215, 85) 1382530441 0.4115067650437009 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815708_0.png resize: (283, 143) 1382530442 -0.3495197384519252 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815710_0.png resize: (227, 94) 1382530443 -0.3829099170805805 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815711_0.png resize: (188, 229) 1382530444 -0.9736165748889967 treat image : temp/1757329828_2077933_1382526743_f23b4274494c085626077f68d97b09d4_rle_crop_3950815713_0.png resize: (78, 150) 1382530445 1.5344626496323441 treat image : temp/1757329828_2077933_1382526743_f23b4274494c085626077f68d97b09d4_rle_crop_3950815714_0.png resize: (227, 164) 1382530446 -2.145828230591637 treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815716_0.png resize: (213, 264) 1382530447 -2.5882460745147875 treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815717_0.png resize: (139, 140) 1382530448 -2.000850419523882 treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815718_0.png resize: (152, 221) 1382530449 -1.4104614939998434 treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263_rle_crop_3950815722_0.png resize: (137, 219) 1382530450 0.7567391990601223 treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263_rle_crop_3950815724_0.png resize: (73, 75) 1382530451 -0.9440412906578577 treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815728_0.png resize: (215, 247) 1382530452 -0.3548883177491472 treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815731_0.png resize: (104, 138) 1382530453 1.3611555512147593 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815733_0.png resize: (111, 192) 1382530454 0.3265867217620526 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815735_0.png resize: (120, 113) 1382530455 -2.3343334541233673 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815736_0.png resize: (523, 323) 1382530456 0.3456128005983811 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815738_0.png resize: (224, 101) 1382530457 -1.6084219661295345 treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6_rle_crop_3950815740_0.png resize: (472, 322) 1382530458 -0.39717208173527563 treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815651_0.png resize: (60, 82) 1382530460 2.0686190247959195 treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815666_0.png resize: (131, 132) 1382530461 -2.008611186750525 treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815676_0.png resize: (90, 88) 1382530462 1.1523279944451872 treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815698_0.png resize: (115, 158) 1382530463 -0.8965288427512387 treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815712_0.png resize: (187, 173) 1382530464 -0.5622876864602969 treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815719_0.png resize: (137, 144) 1382530465 0.983144420523111 treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815720_0.png resize: (197, 79) 1382530466 0.21191342619799444 treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815726_0.png resize: (222, 191) 1382530467 -1.1587061197182105 treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6_rle_crop_3950815743_0.png resize: (148, 216) 1382530468 -0.16448032443583807 treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520_rle_crop_3950815674_0.png resize: (193, 140) 1382530470 0.010014608265748407 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815737_0.png resize: (126, 172) 1382530471 0.5014279131020879 treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815739_0.png resize: (160, 127) 1382530472 0.15608795677773893 treat image : temp/1757329828_2077933_1382527554_82af4ac31b4138e87d7fe9962919da8e_rle_crop_3950815647_0.png resize: (75, 88) 1382530475 -3.3094129502257936 treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815693_0.png resize: (83, 102) 1382530476 -3.043296397367722 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 121 time used for this insertion : 0.01999950408935547 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 121 time used for this insertion : 0.03690385818481445 save missing photos in datou_result : time spend for datou_step_exec : 18.81264019012451 time spend to save output : 0.06154656410217285 total time spend for step 6 : 18.874186754226685 step7:brightness Mon Sep 8 13:12:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757329828_2077933_1382527596_36532731462bc657a81b035f1b61fe00.jpg treat image : temp/1757329828_2077933_1382527554_82af4ac31b4138e87d7fe9962919da8e.jpg treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd.jpg treat image : temp/1757329828_2077933_1382527499_8621ab94c35c2771d9f0b91a552d5839.jpg treat image : temp/1757329828_2077933_1382527470_f7a5a65a66c5778c8035a3adf2f8f1f4.jpg treat image : temp/1757329828_2077933_1382527442_386d4804f1d5219d9917693d201a4c1d.jpg treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5.jpg treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24.jpg treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520.jpg treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54.jpg treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049.jpg treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836.jpg treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796.jpg treat image : temp/1757329828_2077933_1382526754_d2fb9038a6066077f3ceedc807325ad0.jpg treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6.jpg treat image : temp/1757329828_2077933_1382526743_f23b4274494c085626077f68d97b09d4.jpg treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf.jpg treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263.jpg treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e.jpg treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a.jpg treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6.jpg treat image : temp/1757329828_2077933_1382527596_36532731462bc657a81b035f1b61fe00_rle_crop_3950815644_0.png treat image : temp/1757329828_2077933_1382527596_36532731462bc657a81b035f1b61fe00_rle_crop_3950815646_0.png treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815652_0.png treat image : temp/1757329828_2077933_1382527499_8621ab94c35c2771d9f0b91a552d5839_rle_crop_3950815656_0.png treat image : temp/1757329828_2077933_1382527470_f7a5a65a66c5778c8035a3adf2f8f1f4_rle_crop_3950815657_0.png treat image : temp/1757329828_2077933_1382527442_386d4804f1d5219d9917693d201a4c1d_rle_crop_3950815660_0.png treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815661_0.png treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815662_0.png treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815663_0.png treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815664_0.png treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815665_0.png treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815667_0.png treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815668_0.png treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815670_0.png treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815671_0.png treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815680_0.png treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815681_0.png treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815683_0.png treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815686_0.png treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815689_0.png treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815696_0.png treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815699_0.png treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815715_0.png treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263_rle_crop_3950815721_0.png treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815725_0.png treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815732_0.png treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815734_0.png treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6_rle_crop_3950815741_0.png treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6_rle_crop_3950815742_0.png treat image : temp/1757329828_2077933_1382527470_f7a5a65a66c5778c8035a3adf2f8f1f4_rle_crop_3950815658_0.png treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815677_0.png treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815682_0.png treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815684_0.png treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815687_0.png treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815690_0.png treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815695_0.png treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815700_0.png treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815701_0.png treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263_rle_crop_3950815723_0.png treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815727_0.png treat image : temp/1757329828_2077933_1382526754_d2fb9038a6066077f3ceedc807325ad0_rle_crop_3950815704_0.png treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815709_0.png treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815729_0.png treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815730_0.png treat image : temp/1757329828_2077933_1382527596_36532731462bc657a81b035f1b61fe00_rle_crop_3950815645_0.png treat image : temp/1757329828_2077933_1382527554_82af4ac31b4138e87d7fe9962919da8e_rle_crop_3950815648_0.png treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815649_0.png treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815650_0.png treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815653_0.png treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815654_0.png treat image : temp/1757329828_2077933_1382527499_8621ab94c35c2771d9f0b91a552d5839_rle_crop_3950815655_0.png treat image : temp/1757329828_2077933_1382527442_386d4804f1d5219d9917693d201a4c1d_rle_crop_3950815659_0.png treat image : temp/1757329828_2077933_1382526844_519ecc35574c7561e8a47a4adba20e24_rle_crop_3950815669_0.png treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520_rle_crop_3950815672_0.png treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520_rle_crop_3950815673_0.png treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520_rle_crop_3950815675_0.png treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815678_0.png treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815679_0.png treat image : temp/1757329828_2077933_1382526837_89d4ae9b66551af5bee9908c808a6049_rle_crop_3950815685_0.png treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815688_0.png treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815691_0.png treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815692_0.png treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815694_0.png treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815697_0.png treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815702_0.png treat image : temp/1757329828_2077933_1382526754_d2fb9038a6066077f3ceedc807325ad0_rle_crop_3950815703_0.png treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815705_0.png treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815706_0.png treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815707_0.png treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815708_0.png treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815710_0.png treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815711_0.png treat image : temp/1757329828_2077933_1382526743_f23b4274494c085626077f68d97b09d4_rle_crop_3950815713_0.png treat image : temp/1757329828_2077933_1382526743_f23b4274494c085626077f68d97b09d4_rle_crop_3950815714_0.png treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815716_0.png treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815717_0.png treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815718_0.png treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263_rle_crop_3950815722_0.png treat image : temp/1757329828_2077933_1382526706_efb0d03ecc5e04ba328485d3017a2263_rle_crop_3950815724_0.png treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815728_0.png treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815731_0.png treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815733_0.png treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815735_0.png treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815736_0.png treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815738_0.png treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6_rle_crop_3950815740_0.png treat image : temp/1757329828_2077933_1382527526_9dac66ff883423c04460635bd6d9f7cd_rle_crop_3950815651_0.png treat image : temp/1757329828_2077933_1382526860_507c86ebe6eb194cf13f0705bbb94dc5_rle_crop_3950815666_0.png treat image : temp/1757329828_2077933_1382526839_dbde81563769ee32ace4c54d91c1bb54_rle_crop_3950815676_0.png treat image : temp/1757329828_2077933_1382526756_7dd10a0ec234a24e07c9f1f340c69796_rle_crop_3950815698_0.png treat image : temp/1757329828_2077933_1382526746_6c2c0282b78b87d53e3094db9f2336b6_rle_crop_3950815712_0.png treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815719_0.png treat image : temp/1757329828_2077933_1382526717_29bfd1df5aa727aa27d0f27ebf364cdf_rle_crop_3950815720_0.png treat image : temp/1757329828_2077933_1382526628_3d1e66d28ffe16856152a1d0447bbf2e_rle_crop_3950815726_0.png treat image : temp/1757329828_2077933_1382526614_ffa0ad37bd5f3bf9e41f110f8ddabac6_rle_crop_3950815743_0.png treat image : temp/1757329828_2077933_1382526841_49c21104586293d05b1097fdb8d55520_rle_crop_3950815674_0.png treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815737_0.png treat image : temp/1757329828_2077933_1382526616_548773a8de0d3d4a83642e0b20b2a03a_rle_crop_3950815739_0.png treat image : temp/1757329828_2077933_1382527554_82af4ac31b4138e87d7fe9962919da8e_rle_crop_3950815647_0.png treat image : temp/1757329828_2077933_1382526834_8b59685f75c5a054b587a20db48e9836_rle_crop_3950815693_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 121 time used for this insertion : 0.020433425903320312 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 121 time used for this insertion : 0.03314065933227539 save missing photos in datou_result : time spend for datou_step_exec : 5.199347496032715 time spend to save output : 0.058765411376953125 total time spend for step 7 : 5.258112907409668 step8:velours_tree Mon Sep 8 13:12:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.30965304374694824 time spend to save output : 5.936622619628906e-05 total time spend for step 8 : 0.30971240997314453 step9:send_mail_cod Mon Sep 8 13:12:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26639471_08-09-2025_13_12_44.pdf 26639515 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266395151757329964 26639516 imagette266395161757329965 26639517 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266395171757329965 26639518 imagette266395181757329965 26639519 change filename to text .change filename to text .imagette266395191757329965 26639520 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266395201757329965 26639521 change filename to text .change filename to text .change filename to text .imagette266395211757329967 26639522 imagette266395221757329967 26639524 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266395241757329967 26639525 change filename to text .change filename to text .change filename to text .change filename to text .imagette266395251757329968 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26639471 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26639515,26639516,26639517,26639518,26639519,26639520,26639521,26639522,26639523,26639524,26639525?tags=papier,flou,autre,background,pet_fonce,pet_clair,pehd,mal_croppe,environnement,carton,metal args[1382527596] : ((1382527596, 1.3987291085192952, 492688767), (1382527596, 0.26994194013437783, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382527554] : ((1382527554, -2.3207717956110723, 492609224), (1382527554, 0.3225970556695605, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382527526] : ((1382527526, -0.7824939726202599, 492688767), (1382527526, 0.24337680900707012, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382527499] : ((1382527499, 2.056002361517531, 492688767), (1382527499, 0.6645501946880891, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382527470] : ((1382527470, -3.3142018029215707, 492609224), (1382527470, 0.39032298144111705, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382527442] : ((1382527442, 1.0703214530127056, 492688767), (1382527442, 0.635878949713, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526860] : ((1382526860, -0.03460468058537715, 492688767), (1382526860, 0.7845261123825651, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526844] : ((1382526844, -2.9376666231917397, 492609224), (1382526844, 0.384259207083258, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526841] : ((1382526841, 0.6124507331873332, 492688767), (1382526841, 0.7488029553423179, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526839] : ((1382526839, 0.9635620532988425, 492688767), (1382526839, 0.7485492945355448, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526837] : ((1382526837, 0.8549542744194405, 492688767), (1382526837, 0.7924116723278438, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526834] : ((1382526834, -1.205228641502606, 492688767), (1382526834, 0.35467611284674644, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526756] : ((1382526756, 2.8667690953717777, 492688767), (1382526756, 0.3529646262881087, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526754] : ((1382526754, 0.1844745423938349, 492688767), (1382526754, 0.6138513853865644, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526746] : ((1382526746, 2.0826008320715124, 492688767), (1382526746, 0.7841211708777278, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526743] : ((1382526743, 0.8489105914687375, 492688767), (1382526743, 0.357886930515223, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526717] : ((1382526717, 0.36080041137830243, 492688767), (1382526717, 0.5561043463899318, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526706] : ((1382526706, 2.199797036936888, 492688767), (1382526706, 0.5212826321938248, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526628] : ((1382526628, 2.6275376724167527, 492688767), (1382526628, 0.4467630229513917, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526616] : ((1382526616, 1.8422134798269072, 492688767), (1382526616, 0.28919774961470185, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com args[1382526614] : ((1382526614, 1.6327860821136915, 492688767), (1382526614, 0.3946066761952836, 2107752395), '0.06518803277483833') We are sending mail with results at report@fotonower.com refus_total : 0.06518803277483833 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26639471 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26639471_08-09-2025_13_12_44.pdf results_Auto_P26639471_08-09-2025_13_12_44.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26639471_08-09-2025_13_12_44.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26639471','results_Auto_P26639471_08-09-2025_13_12_44.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26639471_08-09-2025_13_12_44.pdf','pdf','','0.4','0.06518803277483833') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26639471

https://www.fotonower.com/image?json=false&list_photos_id=1382527596
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3987291085192952)
https://www.fotonower.com/image?json=false&list_photos_id=1382527554
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382527526
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382527499
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.056002361517531)
https://www.fotonower.com/image?json=false&list_photos_id=1382527470
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382527442
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0703214530127056)
https://www.fotonower.com/image?json=false&list_photos_id=1382526860
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526844
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526841
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526839
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526837
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526834
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526756
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.8667690953717777)
https://www.fotonower.com/image?json=false&list_photos_id=1382526754
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526746
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.0826008320715124)
https://www.fotonower.com/image?json=false&list_photos_id=1382526743
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526717
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382526706
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.199797036936888)
https://www.fotonower.com/image?json=false&list_photos_id=1382526628
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.6275376724167527)
https://www.fotonower.com/image?json=false&list_photos_id=1382526616
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.8422134798269072)
https://www.fotonower.com/image?json=false&list_photos_id=1382526614
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.6327860821136915)

Dans ces conditions,le taux de refus est: 6.52%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/26639515?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26639517?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26639519?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26639520?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/26639521?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26639524?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26639525?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26639471_08-09-2025_13_12_44.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26639515,26639516,26639517,26639518,26639519,26639520,26639521,26639522,26639523,26639524,26639525?tags=papier,flou,autre,background,pet_fonce,pet_clair,pehd,mal_croppe,environnement,carton,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 08 Sep 2025 11:12:50 GMT Content-Length: 0 Connection: close X-Message-Id: oW3tvEVTSo6qYTFcjTMCZQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1382527596, 1382527554, 1382527526, 1382527499, 1382527470, 1382527442, 1382526860, 1382526844, 1382526841, 1382526839, 1382526837, 1382526834, 1382526756, 1382526754, 1382526746, 1382526743, 1382526717, 1382526706, 1382526628, 1382526616, 1382526614] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527596', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527554', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527526', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527499', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527470', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527442', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526860', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526844', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526841', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526839', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526837', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526834', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526756', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526754', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526746', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526743', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526717', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526706', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526628', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526616', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526614', None, None, None, None, None, '3678213') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.018978595733642578 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.593461036682129 time spend to save output : 0.019359827041625977 total time spend for step 9 : 6.612820863723755 step10:split_time_score Mon Sep 8 13:12:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 21),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08092025 26639471 Nombre de photos uploadées : 21 / 23040 (0%) 08092025 26639471 Nombre de photos taguées (types de déchets): 0 / 21 (0%) 08092025 26639471 Nombre de photos taguées (volume) : 0 / 21 (0%) elapsed_time : load_data_split_time_score 1.049041748046875e-05 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0012917518615722656 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20097851753234863 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1588576630015432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26629339_08-09-2025_08_56_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26629339 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26629339 AND mptpi.`type`=3594 To do Qualite : 0.21931737075617283 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26629340_08-09-2025_08_52_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26629340 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26629340 AND mptpi.`type`=3594 To do Qualite : 0.17503380155723905 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26629342_08-09-2025_08_41_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26629342 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26629342 AND mptpi.`type`=3594 To do Qualite : 0.04856762322984748 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26631054_08-09-2025_09_42_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26631054 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26631054 AND mptpi.`type`=3594 To do Qualite : 0.12406641830632716 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26638960_08-09-2025_12_51_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26638960 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26638960 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26638961 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26639467 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26639469 order by id desc limit 1 Qualite : 0.06518803277483833 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26639471_08-09-2025_13_12_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26639471 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26639471 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08092025': {'nb_upload': 21, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1382527596, 1382527554, 1382527526, 1382527499, 1382527470, 1382527442, 1382526860, 1382526844, 1382526841, 1382526839, 1382526837, 1382526834, 1382526756, 1382526754, 1382526746, 1382526743, 1382526717, 1382526706, 1382526628, 1382526616, 1382526614] Looping around the photos to save general results len do output : 1 /26639471Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527596', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527554', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527526', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527499', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527470', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382527442', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526860', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526844', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526841', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526839', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526837', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526834', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526756', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526754', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526746', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526743', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526717', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526706', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526628', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526616', None, None, None, None, None, '3678213') ('3318', None, None, None, None, None, None, None, '3678213') ('3318', '26639471', '1382526614', None, None, None, None, None, '3678213') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 22 time used for this insertion : 0.015318155288696289 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.6203553676605225 time spend to save output : 0.015656709671020508 total time spend for step 10 : 3.636012077331543 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 21 set_done_treatment 73.91user 33.58system 2:29.05elapsed 72%CPU (0avgtext+0avgdata 2577608maxresident)k 1138080inputs+32664outputs (30763major+2069226minor)pagefaults 0swaps