python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2341597 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3447819'] with mtr_portfolio_ids : ['25678966'] and first list_photo_ids : [] new path : /proc/2341597/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 24 ; length of list_pids : 24 ; length of list_args : 24 time to download the photos : 2.8754537105560303 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Aug 5 11:30:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3469 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-05 11:30:36.274982: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-05 11:30:36.303500: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-05 11:30:36.305643: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2330000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-05 11:30:36.305699: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-05 11:30:36.309638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-05 11:30:36.455785: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x15323260 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-05 11:30:36.455832: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-05 11:30:36.456907: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 11:30:36.457469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 11:30:36.461033: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 11:30:36.464005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 11:30:36.464402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 11:30:36.467988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 11:30:36.469644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 11:30:36.475298: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 11:30:36.476354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 11:30:36.476419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 11:30:36.476978: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-05 11:30:36.476993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-05 11:30:36.477002: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-05 11:30:36.477975: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3018 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-05 11:30:36.812074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 11:30:36.812191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 11:30:36.812213: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 11:30:36.812232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 11:30:36.812250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 11:30:36.812268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 11:30:36.812285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 11:30:36.812302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 11:30:36.813432: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 11:30:36.814902: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 11:30:36.814980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 11:30:36.815000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 11:30:36.815017: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 11:30:36.815034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 11:30:36.815051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 11:30:36.815068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 11:30:36.815085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 11:30:36.816209: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 11:30:36.816255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-05 11:30:36.816267: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-05 11:30:36.816277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-05 11:30:36.817395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3018 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-05 11:30:44.602931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 11:30:44.792430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 11:30:46.125097: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.125733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.20G (2366019840 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.125760: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.126293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.126308: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.133309: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.133330: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.133857: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.133872: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.140433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.140456: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.141022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.141039: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.171957: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.172013: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.172590: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.172606: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.178511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.178535: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.179110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.179128: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-05 11:30:46.213122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.213719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.215605: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.216184: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.260078: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.260679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.263061: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.263983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.291427: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.292920: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.295431: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.296289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.302316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.303053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.304904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.305528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.311166: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.311749: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.313302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.313882: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.340144: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.340729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.341301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.341873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.345419: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.345998: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.361368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.361947: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.362517: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.363087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.375430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.376008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.376579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.377147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.381512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.382087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.386772: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.387365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.399818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.400396: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.404591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.405167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.405735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.406304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.407029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.407626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.418354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.418927: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.419531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.420101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.420668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.421305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.436457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.437030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.487743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.488353: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.488922: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.489477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.497364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.497923: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.517939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.518559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.519114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.519692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.523982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.524569: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.525107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.525643: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.527616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.527646: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-08-05 11:30:46.537139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.537704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.546744: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.547321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.547940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.548507: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.549050: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-05 11:30:46.549581: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2628911104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 24 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 68.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 52.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 2342213 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2276 tf kernel not reseted sub process len(results) : 24 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 24 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3469 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005550384521484375 nb_pixel_total : 13761 time to create 1 rle with old method : 0.01854395866394043 length of segment : 229 time for calcul the mask position with numpy : 0.002018451690673828 nb_pixel_total : 111078 time to create 1 rle with old method : 0.1280663013458252 length of segment : 539 time for calcul the mask position with numpy : 0.0007016658782958984 nb_pixel_total : 51576 time to create 1 rle with old method : 0.06903624534606934 length of segment : 296 time for calcul the mask position with numpy : 0.0004203319549560547 nb_pixel_total : 30401 time to create 1 rle with old method : 0.0412750244140625 length of segment : 244 time for calcul the mask position with numpy : 0.00018095970153808594 nb_pixel_total : 11763 time to create 1 rle with old method : 0.014521598815917969 length of segment : 89 time for calcul the mask position with numpy : 0.0001404285430908203 nb_pixel_total : 6968 time to create 1 rle with old method : 0.009652853012084961 length of segment : 85 time for calcul the mask position with numpy : 0.0008885860443115234 nb_pixel_total : 58029 time to create 1 rle with old method : 0.06456780433654785 length of segment : 323 time for calcul the mask position with numpy : 0.0002849102020263672 nb_pixel_total : 18607 time to create 1 rle with old method : 0.02072310447692871 length of segment : 194 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1501 time to create 1 rle with old method : 0.0017936229705810547 length of segment : 46 time for calcul the mask position with numpy : 0.029207229614257812 nb_pixel_total : 670463 time to create 1 rle with new method : 0.05828452110290527 length of segment : 992 time for calcul the mask position with numpy : 0.00029349327087402344 nb_pixel_total : 16642 time to create 1 rle with old method : 0.018772363662719727 length of segment : 152 time for calcul the mask position with numpy : 0.00020265579223632812 nb_pixel_total : 14041 time to create 1 rle with old method : 0.01582789421081543 length of segment : 142 time for calcul the mask position with numpy : 0.002298593521118164 nb_pixel_total : 175198 time to create 1 rle with new method : 0.00736689567565918 length of segment : 394 time for calcul the mask position with numpy : 0.00023245811462402344 nb_pixel_total : 15631 time to create 1 rle with old method : 0.023994922637939453 length of segment : 151 time for calcul the mask position with numpy : 0.002819538116455078 nb_pixel_total : 106732 time to create 1 rle with old method : 0.13062191009521484 length of segment : 524 time for calcul the mask position with numpy : 0.0004780292510986328 nb_pixel_total : 8916 time to create 1 rle with old method : 0.010004043579101562 length of segment : 122 time for calcul the mask position with numpy : 0.006254434585571289 nb_pixel_total : 257334 time to create 1 rle with new method : 0.009974479675292969 length of segment : 811 time for calcul the mask position with numpy : 0.0022983551025390625 nb_pixel_total : 104343 time to create 1 rle with old method : 0.1093595027923584 length of segment : 619 time for calcul the mask position with numpy : 0.0002346038818359375 nb_pixel_total : 10298 time to create 1 rle with old method : 0.011732339859008789 length of segment : 131 time for calcul the mask position with numpy : 0.00044155120849609375 nb_pixel_total : 10870 time to create 1 rle with old method : 0.011912107467651367 length of segment : 173 time for calcul the mask position with numpy : 0.0001251697540283203 nb_pixel_total : 2431 time to create 1 rle with old method : 0.0028154850006103516 length of segment : 43 time for calcul the mask position with numpy : 0.0005877017974853516 nb_pixel_total : 10641 time to create 1 rle with old method : 0.011923074722290039 length of segment : 153 time for calcul the mask position with numpy : 0.0026345252990722656 nb_pixel_total : 110387 time to create 1 rle with old method : 0.1170511245727539 length of segment : 541 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 6840 time to create 1 rle with old method : 0.007776975631713867 length of segment : 116 time for calcul the mask position with numpy : 0.023151159286499023 nb_pixel_total : 1135974 time to create 1 rle with new method : 0.10111618041992188 length of segment : 1524 time for calcul the mask position with numpy : 0.00044465065002441406 nb_pixel_total : 9488 time to create 1 rle with old method : 0.010483741760253906 length of segment : 140 time for calcul the mask position with numpy : 0.0029304027557373047 nb_pixel_total : 119104 time to create 1 rle with old method : 0.12602448463439941 length of segment : 517 time for calcul the mask position with numpy : 0.0005140304565429688 nb_pixel_total : 14927 time to create 1 rle with old method : 0.017005205154418945 length of segment : 86 time for calcul the mask position with numpy : 0.0007703304290771484 nb_pixel_total : 23869 time to create 1 rle with old method : 0.02677011489868164 length of segment : 156 time for calcul the mask position with numpy : 0.00041413307189941406 nb_pixel_total : 19170 time to create 1 rle with old method : 0.020883560180664062 length of segment : 102 time for calcul the mask position with numpy : 0.0004112720489501953 nb_pixel_total : 13754 time to create 1 rle with old method : 0.015933990478515625 length of segment : 123 time for calcul the mask position with numpy : 0.0027256011962890625 nb_pixel_total : 106702 time to create 1 rle with old method : 0.12690186500549316 length of segment : 588 time for calcul the mask position with numpy : 0.00039005279541015625 nb_pixel_total : 11491 time to create 1 rle with old method : 0.015455007553100586 length of segment : 177 time for calcul the mask position with numpy : 0.0001552104949951172 nb_pixel_total : 3479 time to create 1 rle with old method : 0.004059553146362305 length of segment : 59 time for calcul the mask position with numpy : 0.0004086494445800781 nb_pixel_total : 12885 time to create 1 rle with old method : 0.014835119247436523 length of segment : 118 time for calcul the mask position with numpy : 0.00035190582275390625 nb_pixel_total : 6604 time to create 1 rle with old method : 0.009351015090942383 length of segment : 148 time for calcul the mask position with numpy : 0.00048065185546875 nb_pixel_total : 20966 time to create 1 rle with old method : 0.02404165267944336 length of segment : 162 time for calcul the mask position with numpy : 0.0018780231475830078 nb_pixel_total : 98875 time to create 1 rle with old method : 0.10893869400024414 length of segment : 515 time for calcul the mask position with numpy : 0.0002617835998535156 nb_pixel_total : 7576 time to create 1 rle with old method : 0.009106636047363281 length of segment : 159 time for calcul the mask position with numpy : 0.0005438327789306641 nb_pixel_total : 45584 time to create 1 rle with old method : 0.05125856399536133 length of segment : 151 time for calcul the mask position with numpy : 0.0005943775177001953 nb_pixel_total : 25770 time to create 1 rle with old method : 0.029582500457763672 length of segment : 166 time for calcul the mask position with numpy : 0.002704620361328125 nb_pixel_total : 127199 time to create 1 rle with old method : 0.15920710563659668 length of segment : 566 time for calcul the mask position with numpy : 0.00026702880859375 nb_pixel_total : 7616 time to create 1 rle with old method : 0.009012222290039062 length of segment : 70 time for calcul the mask position with numpy : 0.00029277801513671875 nb_pixel_total : 5714 time to create 1 rle with old method : 0.007213592529296875 length of segment : 110 time for calcul the mask position with numpy : 0.0024285316467285156 nb_pixel_total : 98595 time to create 1 rle with old method : 0.11135649681091309 length of segment : 377 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 6348 time to create 1 rle with old method : 0.0076236724853515625 length of segment : 82 time for calcul the mask position with numpy : 0.0004134178161621094 nb_pixel_total : 12902 time to create 1 rle with old method : 0.014622211456298828 length of segment : 191 time for calcul the mask position with numpy : 0.00012302398681640625 nb_pixel_total : 3284 time to create 1 rle with old method : 0.004045248031616211 length of segment : 31 time for calcul the mask position with numpy : 0.00023674964904785156 nb_pixel_total : 6412 time to create 1 rle with old method : 0.0075261592864990234 length of segment : 78 time for calcul the mask position with numpy : 0.00034689903259277344 nb_pixel_total : 9109 time to create 1 rle with old method : 0.010223627090454102 length of segment : 183 time for calcul the mask position with numpy : 0.014911413192749023 nb_pixel_total : 774973 time to create 1 rle with new method : 0.056493520736694336 length of segment : 1802 time for calcul the mask position with numpy : 0.00058746337890625 nb_pixel_total : 13689 time to create 1 rle with old method : 0.015738964080810547 length of segment : 118 time for calcul the mask position with numpy : 0.0004987716674804688 nb_pixel_total : 17543 time to create 1 rle with old method : 0.02028822898864746 length of segment : 141 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 5802 time to create 1 rle with old method : 0.007103919982910156 length of segment : 74 time for calcul the mask position with numpy : 0.00046706199645996094 nb_pixel_total : 16377 time to create 1 rle with old method : 0.018923282623291016 length of segment : 135 time for calcul the mask position with numpy : 0.002145528793334961 nb_pixel_total : 103748 time to create 1 rle with old method : 0.11767387390136719 length of segment : 542 time for calcul the mask position with numpy : 0.0003452301025390625 nb_pixel_total : 12395 time to create 1 rle with old method : 0.014614343643188477 length of segment : 134 time for calcul the mask position with numpy : 0.00037288665771484375 nb_pixel_total : 8003 time to create 1 rle with old method : 0.009352445602416992 length of segment : 172 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 3001 time to create 1 rle with old method : 0.0037119388580322266 length of segment : 63 time for calcul the mask position with numpy : 0.0003566741943359375 nb_pixel_total : 12391 time to create 1 rle with old method : 0.01468515396118164 length of segment : 142 time for calcul the mask position with numpy : 0.011647462844848633 nb_pixel_total : 696216 time to create 1 rle with new method : 0.01748347282409668 length of segment : 1017 time for calcul the mask position with numpy : 0.002847433090209961 nb_pixel_total : 136319 time to create 1 rle with old method : 0.14712858200073242 length of segment : 440 time for calcul the mask position with numpy : 0.0019431114196777344 nb_pixel_total : 111582 time to create 1 rle with old method : 0.12299203872680664 length of segment : 525 time for calcul the mask position with numpy : 0.0015625953674316406 nb_pixel_total : 82151 time to create 1 rle with old method : 0.10864496231079102 length of segment : 484 time for calcul the mask position with numpy : 0.0002014636993408203 nb_pixel_total : 2939 time to create 1 rle with old method : 0.0035309791564941406 length of segment : 83 time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 19955 time to create 1 rle with old method : 0.02307581901550293 length of segment : 130 time spent for convertir_results : 5.762387037277222 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 66 chid ids of type : 3594 Number RLEs to save : 19690 save missing photos in datou_result : time spend for datou_step_exec : 34.18913793563843 time spend to save output : 1.6341831684112549 total time spend for step 1 : 35.82332110404968 step2:crop_condition Tue Aug 5 11:31:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 24 ! batch 1 Loaded 66 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754386272_2341597 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.805070400238037 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754386282_2341597 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6591205596923828 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754386284_2341597 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5880897045135498 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754386303_2341597 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.71513295173645 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754386313_2341597 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1390936374664307 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754386315_2341597 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5603499412536621 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375253316, 1375253302, 1375253283, 1375253280, 1375253258, 1375253233, 1375253135, 1375253134, 1375253132, 1375253130, 1375253127, 1375253110, 1375253109, 1375253107, 1375253105, 1375253103, 1375252889, 1375252871, 1375252848, 1375252775, 1375252718, 1375252690, 1375252592, 1375252591] Looping around the photos to save general results len do output : 66 /1375279173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375279267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253316', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253302', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253283', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253280', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253258', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253233', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253135', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253134', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253132', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253130', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253127', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253110', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253109', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253107', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253105', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253103', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252889', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252871', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252848', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252775', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252718', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252690', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252592', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252591', None, None, None, None, None, '3447819') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 222 time used for this insertion : 0.0337214469909668 save_final save missing photos in datou_result : time spend for datou_step_exec : 47.250327348709106 time spend to save output : 0.03661155700683594 total time spend for step 2 : 47.28693890571594 step3:rle_unique_nms_with_priority Tue Aug 5 11:31:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 66 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.28679895401000977 time for calcul the mask position with numpy : 0.17747163772583008 nb_pixel_total : 1855753 time to create 1 rle with new method : 0.09569096565246582 time for calcul the mask position with numpy : 0.0060634613037109375 nb_pixel_total : 11763 time to create 1 rle with old method : 0.012691259384155273 time for calcul the mask position with numpy : 0.005903720855712891 nb_pixel_total : 29669 time to create 1 rle with old method : 0.031734466552734375 time for calcul the mask position with numpy : 0.006243228912353516 nb_pixel_total : 51576 time to create 1 rle with old method : 0.05670976638793945 time for calcul the mask position with numpy : 0.007427692413330078 nb_pixel_total : 111078 time to create 1 rle with old method : 0.12599992752075195 time for calcul the mask position with numpy : 0.006292104721069336 nb_pixel_total : 13761 time to create 1 rle with old method : 0.015170812606811523 create new chi : 0.5580346584320068 time to delete rle : 0.017545461654663086 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3831 TO DO : save crop sub photo not yet done ! save time : 0.3331749439239502 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.24894309043884277 time for calcul the mask position with numpy : 0.05835890769958496 nb_pixel_total : 1301390 time to create 1 rle with new method : 0.11953163146972656 time for calcul the mask position with numpy : 0.006201505661010742 nb_pixel_total : 16642 time to create 1 rle with old method : 0.017801523208618164 time for calcul the mask position with numpy : 0.012677669525146484 nb_pixel_total : 670463 time to create 1 rle with new method : 0.14824986457824707 time for calcul the mask position with numpy : 0.006392717361450195 nb_pixel_total : 1501 time to create 1 rle with old method : 0.0019295215606689453 time for calcul the mask position with numpy : 0.0063402652740478516 nb_pixel_total : 18607 time to create 1 rle with old method : 0.020922183990478516 time for calcul the mask position with numpy : 0.006743669509887695 nb_pixel_total : 58029 time to create 1 rle with old method : 0.0700674057006836 time for calcul the mask position with numpy : 0.010912895202636719 nb_pixel_total : 6968 time to create 1 rle with old method : 0.007946014404296875 create new chi : 0.5044267177581787 time to delete rle : 0.001374959945678711 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4664 TO DO : save crop sub photo not yet done ! save time : 0.3147881031036377 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.09710836410522461 time for calcul the mask position with numpy : 0.01689624786376953 nb_pixel_total : 1775911 time to create 1 rle with new method : 0.03829002380371094 time for calcul the mask position with numpy : 0.009251117706298828 nb_pixel_total : 106732 time to create 1 rle with old method : 0.11017656326293945 time for calcul the mask position with numpy : 0.005756378173828125 nb_pixel_total : 1718 time to create 1 rle with old method : 0.0021238327026367188 time for calcul the mask position with numpy : 0.0069696903228759766 nb_pixel_total : 175198 time to create 1 rle with new method : 0.05449271202087402 time for calcul the mask position with numpy : 0.005644559860229492 nb_pixel_total : 14041 time to create 1 rle with old method : 0.014944791793823242 create new chi : 0.27357029914855957 time to delete rle : 0.0004291534423828125 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3417 TO DO : save crop sub photo not yet done ! save time : 0.334850549697876 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.4642488956451416 time for calcul the mask position with numpy : 0.12278532981872559 nb_pixel_total : 1681874 time to create 1 rle with new method : 0.0979924201965332 time for calcul the mask position with numpy : 0.0060596466064453125 nb_pixel_total : 10870 time to create 1 rle with old method : 0.011538267135620117 time for calcul the mask position with numpy : 0.006059885025024414 nb_pixel_total : 10263 time to create 1 rle with old method : 0.010951042175292969 time for calcul the mask position with numpy : 0.00638580322265625 nb_pixel_total : 104343 time to create 1 rle with old method : 0.11080145835876465 time for calcul the mask position with numpy : 0.008453130722045898 nb_pixel_total : 257334 time to create 1 rle with new method : 0.1709904670715332 time for calcul the mask position with numpy : 0.005742311477661133 nb_pixel_total : 8916 time to create 1 rle with old method : 0.00944375991821289 create new chi : 0.5776879787445068 time to delete rle : 0.0007207393646240234 batch 1 Loaded 11 chid ids of type : 3594 +++++++++Number RLEs to save : 4762 TO DO : save crop sub photo not yet done ! save time : 0.35006213188171387 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.11849498748779297 time for calcul the mask position with numpy : 0.014712810516357422 nb_pixel_total : 809264 time to create 1 rle with new method : 0.06200838088989258 time for calcul the mask position with numpy : 0.01449131965637207 nb_pixel_total : 1134037 time to create 1 rle with new method : 0.24390697479248047 time for calcul the mask position with numpy : 0.007563352584838867 nb_pixel_total : 6840 time to create 1 rle with old method : 0.007783412933349609 time for calcul the mask position with numpy : 0.007804393768310547 nb_pixel_total : 110387 time to create 1 rle with old method : 0.12258791923522949 time for calcul the mask position with numpy : 0.006125926971435547 nb_pixel_total : 10641 time to create 1 rle with old method : 0.011730194091796875 time for calcul the mask position with numpy : 0.0058994293212890625 nb_pixel_total : 2431 time to create 1 rle with old method : 0.002602815628051758 create new chi : 0.5240886211395264 time to delete rle : 0.0009138584136962891 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5703 TO DO : save crop sub photo not yet done ! save time : 0.4443519115447998 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.056212425231933594 time for calcul the mask position with numpy : 0.1631929874420166 nb_pixel_total : 1906212 time to create 1 rle with new method : 0.0905451774597168 time for calcul the mask position with numpy : 0.00599360466003418 nb_pixel_total : 23869 time to create 1 rle with old method : 0.025793790817260742 time for calcul the mask position with numpy : 0.005893230438232422 nb_pixel_total : 14927 time to create 1 rle with old method : 0.01595616340637207 time for calcul the mask position with numpy : 0.00634312629699707 nb_pixel_total : 119104 time to create 1 rle with old method : 0.1306145191192627 time for calcul the mask position with numpy : 0.009738922119140625 nb_pixel_total : 9488 time to create 1 rle with old method : 0.009929656982421875 create new chi : 0.47356367111206055 time to delete rle : 0.00048422813415527344 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2878 TO DO : save crop sub photo not yet done ! save time : 0.233978271484375 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.08898711204528809 time for calcul the mask position with numpy : 0.017754793167114258 nb_pixel_total : 1922483 time to create 1 rle with new method : 0.1594529151916504 time for calcul the mask position with numpy : 0.005995750427246094 nb_pixel_total : 11491 time to create 1 rle with old method : 0.012365341186523438 time for calcul the mask position with numpy : 0.0068972110748291016 nb_pixel_total : 106702 time to create 1 rle with old method : 0.1134500503540039 time for calcul the mask position with numpy : 0.006036996841430664 nb_pixel_total : 13754 time to create 1 rle with old method : 0.015359163284301758 time for calcul the mask position with numpy : 0.006136655807495117 nb_pixel_total : 19170 time to create 1 rle with old method : 0.021277427673339844 create new chi : 0.3719191551208496 time to delete rle : 0.00048089027404785156 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3060 TO DO : save crop sub photo not yet done ! save time : 0.40413355827331543 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.23413920402526855 time for calcul the mask position with numpy : 0.0781254768371582 nb_pixel_total : 2050632 time to create 1 rle with new method : 0.1535043716430664 time for calcul the mask position with numpy : 0.0064280033111572266 nb_pixel_total : 6604 time to create 1 rle with old method : 0.00761866569519043 time for calcul the mask position with numpy : 0.006337881088256836 nb_pixel_total : 12885 time to create 1 rle with old method : 0.014909029006958008 time for calcul the mask position with numpy : 0.006330728530883789 nb_pixel_total : 3479 time to create 1 rle with old method : 0.004099369049072266 create new chi : 0.28962182998657227 time to delete rle : 0.00033402442932128906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1730 TO DO : save crop sub photo not yet done ! save time : 0.14998149871826172 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.1139216423034668 time for calcul the mask position with numpy : 0.20319414138793945 nb_pixel_total : 1900599 time to create 1 rle with new method : 0.18102359771728516 time for calcul the mask position with numpy : 0.0062448978424072266 nb_pixel_total : 45584 time to create 1 rle with old method : 0.04854702949523926 time for calcul the mask position with numpy : 0.005758762359619141 nb_pixel_total : 7576 time to create 1 rle with old method : 0.008083105087280273 time for calcul the mask position with numpy : 0.006162405014038086 nb_pixel_total : 98875 time to create 1 rle with old method : 0.10483193397521973 time for calcul the mask position with numpy : 0.006146907806396484 nb_pixel_total : 20966 time to create 1 rle with old method : 0.022572755813598633 create new chi : 0.6027019023895264 time to delete rle : 0.00047707557678222656 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3054 TO DO : save crop sub photo not yet done ! save time : 0.32369494438171387 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03229951858520508 time for calcul the mask position with numpy : 0.018859386444091797 nb_pixel_total : 2047830 time to create 1 rle with new method : 0.06847381591796875 time for calcul the mask position with numpy : 0.006413936614990234 nb_pixel_total : 25770 time to create 1 rle with old method : 0.027922868728637695 create new chi : 0.12194561958312988 time to delete rle : 0.0002715587615966797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1412 TO DO : save crop sub photo not yet done ! save time : 0.16699719429016113 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.13509273529052734 time for calcul the mask position with numpy : 0.18324971199035645 nb_pixel_total : 1938785 time to create 1 rle with new method : 0.24722576141357422 time for calcul the mask position with numpy : 0.006312847137451172 nb_pixel_total : 7616 time to create 1 rle with old method : 0.00861048698425293 time for calcul the mask position with numpy : 0.006731510162353516 nb_pixel_total : 127199 time to create 1 rle with old method : 0.14168715476989746 create new chi : 0.605050802230835 time to delete rle : 0.00036454200744628906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2352 TO DO : save crop sub photo not yet done ! save time : 0.17099499702453613 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04175758361816406 time for calcul the mask position with numpy : 0.047072649002075195 nb_pixel_total : 1969291 time to create 1 rle with new method : 0.10213446617126465 time for calcul the mask position with numpy : 0.006738185882568359 nb_pixel_total : 98595 time to create 1 rle with old method : 0.11069726943969727 time for calcul the mask position with numpy : 0.005956411361694336 nb_pixel_total : 5714 time to create 1 rle with old method : 0.006159067153930664 create new chi : 0.28949522972106934 time to delete rle : 0.00040531158447265625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2054 TO DO : save crop sub photo not yet done ! save time : 0.30579400062561035 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.252246618270874 time for calcul the mask position with numpy : 0.12697458267211914 nb_pixel_total : 2051066 time to create 1 rle with new method : 0.09532284736633301 time for calcul the mask position with numpy : 0.0059661865234375 nb_pixel_total : 3284 time to create 1 rle with old method : 0.003552675247192383 time for calcul the mask position with numpy : 0.005875349044799805 nb_pixel_total : 12902 time to create 1 rle with old method : 0.014604568481445312 time for calcul the mask position with numpy : 0.006268501281738281 nb_pixel_total : 6348 time to create 1 rle with old method : 0.006968021392822266 create new chi : 0.27610254287719727 time to delete rle : 0.0003306865692138672 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1688 TO DO : save crop sub photo not yet done ! save time : 0.21976900100708008 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04967904090881348 time for calcul the mask position with numpy : 0.13339471817016602 nb_pixel_total : 1284924 time to create 1 rle with new method : 0.09576869010925293 time for calcul the mask position with numpy : 0.013290882110595703 nb_pixel_total : 773155 time to create 1 rle with new method : 0.11584162712097168 time for calcul the mask position with numpy : 0.006097316741943359 nb_pixel_total : 9109 time to create 1 rle with old method : 0.009927511215209961 time for calcul the mask position with numpy : 0.009844541549682617 nb_pixel_total : 6412 time to create 1 rle with old method : 0.0069806575775146484 create new chi : 0.4008817672729492 time to delete rle : 0.00121307373046875 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 5159 TO DO : save crop sub photo not yet done ! save time : 0.36256957054138184 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06536507606506348 time for calcul the mask position with numpy : 0.018709897994995117 nb_pixel_total : 2036566 time to create 1 rle with new method : 0.16998720169067383 time for calcul the mask position with numpy : 0.006221771240234375 nb_pixel_total : 5802 time to create 1 rle with old method : 0.006554126739501953 time for calcul the mask position with numpy : 0.006113767623901367 nb_pixel_total : 17543 time to create 1 rle with old method : 0.018891334533691406 time for calcul the mask position with numpy : 0.005895376205444336 nb_pixel_total : 13689 time to create 1 rle with old method : 0.014940023422241211 create new chi : 0.2563498020172119 time to delete rle : 0.0002841949462890625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1746 TO DO : save crop sub photo not yet done ! save time : 0.19652318954467773 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.19979357719421387 time for calcul the mask position with numpy : 0.07395625114440918 nb_pixel_total : 1941080 time to create 1 rle with new method : 0.1484689712524414 time for calcul the mask position with numpy : 0.00604701042175293 nb_pixel_total : 12395 time to create 1 rle with old method : 0.013507604598999023 time for calcul the mask position with numpy : 0.006554603576660156 nb_pixel_total : 103748 time to create 1 rle with old method : 0.11060166358947754 time for calcul the mask position with numpy : 0.006014823913574219 nb_pixel_total : 16377 time to create 1 rle with old method : 0.018265247344970703 create new chi : 0.39406371116638184 time to delete rle : 0.0003230571746826172 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2702 TO DO : save crop sub photo not yet done ! save time : 0.20314741134643555 No data in photo_id : 1375252889 No data in photo_id : 1375252871 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.037599802017211914 time for calcul the mask position with numpy : 0.018821001052856445 nb_pixel_total : 2065597 time to create 1 rle with new method : 0.08688998222351074 time for calcul the mask position with numpy : 0.006003856658935547 nb_pixel_total : 8003 time to create 1 rle with old method : 0.008629322052001953 create new chi : 0.12741374969482422 time to delete rle : 0.00023221969604492188 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1424 TO DO : save crop sub photo not yet done ! save time : 0.12540888786315918 nb_obj : 5 nb_hashtags : 1 time to prepare the origin masks : 0.3322746753692627 time for calcul the mask position with numpy : 0.04729032516479492 nb_pixel_total : 1116188 time to create 1 rle with new method : 0.19584107398986816 time for calcul the mask position with numpy : 0.006555318832397461 nb_pixel_total : 111582 time to create 1 rle with old method : 0.11967158317565918 time for calcul the mask position with numpy : 0.006724834442138672 nb_pixel_total : 135917 time to create 1 rle with old method : 0.14631867408752441 time for calcul the mask position with numpy : 0.01072382926940918 nb_pixel_total : 694521 time to create 1 rle with new method : 0.12652254104614258 time for calcul the mask position with numpy : 0.006305217742919922 nb_pixel_total : 12391 time to create 1 rle with old method : 0.013074398040771484 time for calcul the mask position with numpy : 0.006116628646850586 nb_pixel_total : 3001 time to create 1 rle with old method : 0.0033140182495117188 create new chi : 0.6978027820587158 time to delete rle : 0.0008351802825927734 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 5321 TO DO : save crop sub photo not yet done ! save time : 0.590191125869751 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032581329345703125 time for calcul the mask position with numpy : 0.018625736236572266 nb_pixel_total : 1991449 time to create 1 rle with new method : 0.028638601303100586 time for calcul the mask position with numpy : 0.0067291259765625 nb_pixel_total : 82151 time to create 1 rle with old method : 0.08724045753479004 create new chi : 0.15349936485290527 time to delete rle : 0.00027823448181152344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2048 TO DO : save crop sub photo not yet done ! save time : 0.17802834510803223 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03185296058654785 time for calcul the mask position with numpy : 0.07807660102844238 nb_pixel_total : 2070661 time to create 1 rle with new method : 0.13979649543762207 time for calcul the mask position with numpy : 0.005839824676513672 nb_pixel_total : 2939 time to create 1 rle with old method : 0.0032274723052978516 create new chi : 0.23717355728149414 time to delete rle : 0.00023651123046875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1246 TO DO : save crop sub photo not yet done ! save time : 0.1187293529510498 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03158283233642578 time for calcul the mask position with numpy : 0.13384103775024414 nb_pixel_total : 2053645 time to create 1 rle with new method : 0.09326481819152832 time for calcul the mask position with numpy : 0.0058956146240234375 nb_pixel_total : 19955 time to create 1 rle with old method : 0.021308422088623047 create new chi : 0.2645893096923828 time to delete rle : 0.0002288818359375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1340 TO DO : save crop sub photo not yet done ! save time : 0.16573047637939453 No data in photo_id : 1375252591 map_output_result : {1375253316: (0.0, 'Should be the crop_list due to order', 0), 1375253302: (0.0, 'Should be the crop_list due to order', 0), 1375253283: (0.0, 'Should be the crop_list due to order', 0), 1375253280: (0.0, 'Should be the crop_list due to order', 0), 1375253258: (0.0, 'Should be the crop_list due to order', 0), 1375253233: (0.0, 'Should be the crop_list due to order', 0), 1375253135: (0.0, 'Should be the crop_list due to order', 0), 1375253134: (0.0, 'Should be the crop_list due to order', 0), 1375253132: (0.0, 'Should be the crop_list due to order', 0), 1375253130: (0.0, 'Should be the crop_list due to order', 0), 1375253127: (0.0, 'Should be the crop_list due to order', 0), 1375253110: (0.0, 'Should be the crop_list due to order', 0), 1375253109: (0.0, 'Should be the crop_list due to order', 0), 1375253107: (0.0, 'Should be the crop_list due to order', 0), 1375253105: (0.0, 'Should be the crop_list due to order', 0), 1375253103: (0.0, 'Should be the crop_list due to order', 0), 1375252889: (0.0, 'Should be the crop_list due to order', 0.0), 1375252871: (0.0, 'Should be the crop_list due to order', 0.0), 1375252848: (0.0, 'Should be the crop_list due to order', 0), 1375252775: (0.0, 'Should be the crop_list due to order', 0), 1375252718: (0.0, 'Should be the crop_list due to order', 0), 1375252690: (0.0, 'Should be the crop_list due to order', 0), 1375252592: (0.0, 'Should be the crop_list due to order', 0), 1375252591: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375253316, 1375253302, 1375253283, 1375253280, 1375253258, 1375253233, 1375253135, 1375253134, 1375253132, 1375253130, 1375253127, 1375253110, 1375253109, 1375253107, 1375253105, 1375253103, 1375252889, 1375252871, 1375252848, 1375252775, 1375252718, 1375252690, 1375252592, 1375252591] Looping around the photos to save general results len do output : 24 /1375253316.Didn't retrieve data . /1375253302.Didn't retrieve data . /1375253283.Didn't retrieve data . /1375253280.Didn't retrieve data . /1375253258.Didn't retrieve data . /1375253233.Didn't retrieve data . /1375253135.Didn't retrieve data . /1375253134.Didn't retrieve data . /1375253132.Didn't retrieve data . /1375253130.Didn't retrieve data . /1375253127.Didn't retrieve data . /1375253110.Didn't retrieve data . /1375253109.Didn't retrieve data . /1375253107.Didn't retrieve data . /1375253105.Didn't retrieve data . /1375253103.Didn't retrieve data . /1375252889.Didn't retrieve data . /1375252871.Didn't retrieve data . /1375252848.Didn't retrieve data . /1375252775.Didn't retrieve data . /1375252718.Didn't retrieve data . /1375252690.Didn't retrieve data . /1375252592.Didn't retrieve data . /1375252591.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253316', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253302', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253283', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253280', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253258', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253233', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253135', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253134', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253132', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253130', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253127', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253110', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253109', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253107', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253105', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253103', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252889', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252871', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252848', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252775', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252718', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252690', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252592', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252591', None, None, None, None, None, '3447819') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.10387587547302246 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.007235288619995 time spend to save output : 0.10496997833251953 total time spend for step 3 : 18.112205266952515 step4:ventilate_hashtags_in_portfolio Tue Aug 5 11:32:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25678966 get user id for portfolio 25678966 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678966 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_fonce','pet_clair','metal','mal_croppe','pehd','background','environnement','papier','autre','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678966 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_fonce','pet_clair','metal','mal_croppe','pehd','background','environnement','papier','autre','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678966 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_fonce','pet_clair','metal','mal_croppe','pehd','background','environnement','papier','autre','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25680665,25680666,25680667,25680668,25680669,25680670,25680671,25680672,25680673,25680674,25680675?tags=flou,pet_fonce,pet_clair,metal,mal_croppe,pehd,background,environnement,papier,autre,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375253316, 1375253302, 1375253283, 1375253280, 1375253258, 1375253233, 1375253135, 1375253134, 1375253132, 1375253130, 1375253127, 1375253110, 1375253109, 1375253107, 1375253105, 1375253103, 1375252889, 1375252871, 1375252848, 1375252775, 1375252718, 1375252690, 1375252592, 1375252591] Looping around the photos to save general results len do output : 1 /25678966. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253316', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253302', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253283', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253280', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253258', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253233', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253135', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253134', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253132', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253130', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253127', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253110', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253109', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253107', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253105', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253103', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252889', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252871', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252848', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252775', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252718', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252690', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252592', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252591', None, None, None, None, None, '3447819') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.019242525100708008 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.6022427082061768 time spend to save output : 0.019598960876464844 total time spend for step 4 : 2.6218416690826416 step5:final Tue Aug 5 11:32:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375253316: ('0.1160300925925926',), 1375253302: ('0.1160300925925926',), 1375253283: ('0.1160300925925926',), 1375253280: ('0.1160300925925926',), 1375253258: ('0.1160300925925926',), 1375253233: ('0.1160300925925926',), 1375253135: ('0.1160300925925926',), 1375253134: ('0.1160300925925926',), 1375253132: ('0.1160300925925926',), 1375253130: ('0.1160300925925926',), 1375253127: ('0.1160300925925926',), 1375253110: ('0.1160300925925926',), 1375253109: ('0.1160300925925926',), 1375253107: ('0.1160300925925926',), 1375253105: ('0.1160300925925926',), 1375253103: ('0.1160300925925926',), 1375252889: ('0.1160300925925926',), 1375252871: ('0.1160300925925926',), 1375252848: ('0.1160300925925926',), 1375252775: ('0.1160300925925926',), 1375252718: ('0.1160300925925926',), 1375252690: ('0.1160300925925926',), 1375252592: ('0.1160300925925926',), 1375252591: ('0.1160300925925926',)} new output for save of step final : {1375253316: ('0.1160300925925926',), 1375253302: ('0.1160300925925926',), 1375253283: ('0.1160300925925926',), 1375253280: ('0.1160300925925926',), 1375253258: ('0.1160300925925926',), 1375253233: ('0.1160300925925926',), 1375253135: ('0.1160300925925926',), 1375253134: ('0.1160300925925926',), 1375253132: ('0.1160300925925926',), 1375253130: ('0.1160300925925926',), 1375253127: ('0.1160300925925926',), 1375253110: ('0.1160300925925926',), 1375253109: ('0.1160300925925926',), 1375253107: ('0.1160300925925926',), 1375253105: ('0.1160300925925926',), 1375253103: ('0.1160300925925926',), 1375252889: ('0.1160300925925926',), 1375252871: ('0.1160300925925926',), 1375252848: ('0.1160300925925926',), 1375252775: ('0.1160300925925926',), 1375252718: ('0.1160300925925926',), 1375252690: ('0.1160300925925926',), 1375252592: ('0.1160300925925926',), 1375252591: ('0.1160300925925926',)} [1375253316, 1375253302, 1375253283, 1375253280, 1375253258, 1375253233, 1375253135, 1375253134, 1375253132, 1375253130, 1375253127, 1375253110, 1375253109, 1375253107, 1375253105, 1375253103, 1375252889, 1375252871, 1375252848, 1375252775, 1375252718, 1375252690, 1375252592, 1375252591] Looping around the photos to save general results len do output : 24 /1375253316.Didn't retrieve data . /1375253302.Didn't retrieve data . /1375253283.Didn't retrieve data . /1375253280.Didn't retrieve data . /1375253258.Didn't retrieve data . /1375253233.Didn't retrieve data . /1375253135.Didn't retrieve data . /1375253134.Didn't retrieve data . /1375253132.Didn't retrieve data . /1375253130.Didn't retrieve data . /1375253127.Didn't retrieve data . /1375253110.Didn't retrieve data . /1375253109.Didn't retrieve data . /1375253107.Didn't retrieve data . /1375253105.Didn't retrieve data . /1375253103.Didn't retrieve data . /1375252889.Didn't retrieve data . /1375252871.Didn't retrieve data . /1375252848.Didn't retrieve data . /1375252775.Didn't retrieve data . /1375252718.Didn't retrieve data . /1375252690.Didn't retrieve data . /1375252592.Didn't retrieve data . /1375252591.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253316', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253302', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253283', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253280', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253258', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253233', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253135', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253134', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253132', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253130', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253127', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253110', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253109', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253107', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253105', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253103', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252889', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252871', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252848', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252775', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252718', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252690', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252592', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252591', None, None, None, None, None, '3447819') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.019756793975830078 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12251925468444824 time spend to save output : 0.020650148391723633 total time spend for step 5 : 0.14316940307617188 step6:blur_detection Tue Aug 5 11:32:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d.jpg resize: (1080, 1920) 1375253316 1.5291087268057784 treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a.jpg resize: (1080, 1920) 1375253302 -3.1588022230978696 treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664.jpg resize: (1080, 1920) 1375253283 -0.5642682954245811 treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11.jpg resize: (1080, 1920) 1375253280 1.6612192509465777 treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63.jpg resize: (1080, 1920) 1375253258 1.1375278862650868 treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b.jpg resize: (1080, 1920) 1375253233 -0.5609258522703987 treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab.jpg resize: (1080, 1920) 1375253135 1.3458531470060076 treat image : temp/1754386229_2341597_1375253134_d627c607254eaf687aac99365dfd13b1.jpg resize: (1080, 1920) 1375253134 9.500838829404131 treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097.jpg resize: (1080, 1920) 1375253132 -0.29706989777163595 treat image : temp/1754386229_2341597_1375253130_e217c4762688b703bb0dabb0c3cf6e4d.jpg resize: (1080, 1920) 1375253130 0.9357575001141214 treat image : temp/1754386229_2341597_1375253127_abdc55571c39a2f0a8a6c51479b2d6e7.jpg resize: (1080, 1920) 1375253127 -3.3176016858067245 treat image : temp/1754386229_2341597_1375253110_30eb62b60a5dcf008288b325dc7671bb.jpg resize: (1080, 1920) 1375253110 -1.003219969350166 treat image : temp/1754386229_2341597_1375253109_5ee6ff766e83940691b1f963d1a48f8e.jpg resize: (1080, 1920) 1375253109 3.030244994416442 treat image : temp/1754386229_2341597_1375253107_48ccdd25d57577e884c32e978ccf2350.jpg resize: (1080, 1920) 1375253107 0.62819642558412 treat image : temp/1754386229_2341597_1375253105_f0f4a3f834675281fc412b7c400a71b6.jpg resize: (1080, 1920) 1375253105 0.07195397974919324 treat image : temp/1754386229_2341597_1375253103_29482e9b909f99e829a1d9d64f7cddac.jpg resize: (1080, 1920) 1375253103 -3.724087530785395 treat image : temp/1754386229_2341597_1375252889_ed4cfa1cfb5842bee22460d5939fedb7.jpg resize: (1080, 1920) 1375252889 -1.8266429962104265 treat image : temp/1754386229_2341597_1375252871_9918723a8324d05aaccc452d0530bc7c.jpg resize: (1080, 1920) 1375252871 -0.03911870565813013 treat image : temp/1754386229_2341597_1375252848_779d490372a83e4486ceea631e538a58.jpg resize: (1080, 1920) 1375252848 0.48991705212176373 treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79.jpg resize: (1080, 1920) 1375252775 -0.8740225228057326 treat image : temp/1754386229_2341597_1375252718_eeddc8823a07d541fa2aa0e8638f682a.jpg resize: (1080, 1920) 1375252718 -0.7420036016100633 treat image : temp/1754386229_2341597_1375252690_b7268fb0ea39661dc15e56f47ac18209.jpg resize: (1080, 1920) 1375252690 -1.3567734476233069 treat image : temp/1754386229_2341597_1375252592_7456c753dcac0d644f8dd08007dbdd29.jpg resize: (1080, 1920) 1375252592 -0.1659885732405243 treat image : temp/1754386229_2341597_1375252591_cfc7181b7dcdefb605b204995fe33072.jpg resize: (1080, 1920) 1375252591 -1.7185859704189783 treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525473_0.png resize: (229, 184) 1375279173 -1.2662343725806815 treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525476_0.png resize: (212, 199) 1375279174 -0.7674089519614152 treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525478_0.png resize: (85, 115) 1375279175 -2.7146962219364243 treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525481_0.png resize: (44, 51) 1375279176 -2.552815221665286 treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525488_0.png resize: (122, 145) 1375279177 -1.2308680328523212 treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525489_0.png resize: (740, 460) 1375279178 -0.7541269635829254 treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525492_0.png resize: (173, 110) 1375279179 -0.5196419195611431 treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525494_0.png resize: (153, 192) 1375279180 -0.23176253490946688 treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525496_0.png resize: (116, 102) 1375279181 -0.3563456412186059 treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b_rle_crop_3903525498_0.png resize: (140, 129) 1375279182 -3.653636969315105 treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b_rle_crop_3903525501_0.png resize: (155, 291) 1375279183 -0.7776733875930452 treat image : temp/1754386229_2341597_1375253134_d627c607254eaf687aac99365dfd13b1_rle_crop_3903525507_0.png resize: (113, 183) 1375279184 0.5589708636118901 treat image : temp/1754386229_2341597_1375253134_d627c607254eaf687aac99365dfd13b1_rle_crop_3903525508_0.png resize: (148, 98) 1375279185 -1.8333554238458014 treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097_rle_crop_3903525511_0.png resize: (125, 138) 1375279186 -2.683451635683171 treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097_rle_crop_3903525512_0.png resize: (146, 371) 1375279187 -0.7120987418979804 treat image : temp/1754386229_2341597_1375253127_abdc55571c39a2f0a8a6c51479b2d6e7_rle_crop_3903525515_0.png resize: (64, 164) 1375279188 -2.4813819998100994 treat image : temp/1754386229_2341597_1375253110_30eb62b60a5dcf008288b325dc7671bb_rle_crop_3903525516_0.png resize: (110, 117) 1375279189 -1.440616134734517 treat image : temp/1754386229_2341597_1375253110_30eb62b60a5dcf008288b325dc7671bb_rle_crop_3903525517_0.png resize: (375, 518) 1375279190 -2.87258601614593 treat image : temp/1754386229_2341597_1375253109_5ee6ff766e83940691b1f963d1a48f8e_rle_crop_3903525519_0.png resize: (191, 90) 1375279191 -0.6773383952589696 treat image : temp/1754386229_2341597_1375253109_5ee6ff766e83940691b1f963d1a48f8e_rle_crop_3903525520_0.png resize: (31, 140) 1375279192 -0.9039193524368244 treat image : temp/1754386229_2341597_1375253107_48ccdd25d57577e884c32e978ccf2350_rle_crop_3903525521_0.png resize: (78, 136) 1375279194 -0.7171502813860409 treat image : temp/1754386229_2341597_1375253107_48ccdd25d57577e884c32e978ccf2350_rle_crop_3903525522_0.png resize: (172, 91) 1375279195 -0.3647277824136198 treat image : temp/1754386229_2341597_1375253105_f0f4a3f834675281fc412b7c400a71b6_rle_crop_3903525524_0.png resize: (116, 207) 1375279196 -1.5740323560529075 treat image : temp/1754386229_2341597_1375253105_f0f4a3f834675281fc412b7c400a71b6_rle_crop_3903525525_0.png resize: (137, 182) 1375279197 -0.08386883100482384 treat image : temp/1754386229_2341597_1375253105_f0f4a3f834675281fc412b7c400a71b6_rle_crop_3903525526_0.png resize: (74, 108) 1375279198 -0.32194610353604086 treat image : temp/1754386229_2341597_1375253103_29482e9b909f99e829a1d9d64f7cddac_rle_crop_3903525527_0.png resize: (132, 188) 1375279199 -4.403501931087781 treat image : temp/1754386229_2341597_1375252848_779d490372a83e4486ceea631e538a58_rle_crop_3903525530_0.png resize: (172, 99) 1375279200 -1.9989973294239523 treat image : temp/1754386229_2341597_1375252690_b7268fb0ea39661dc15e56f47ac18209_rle_crop_3903525537_0.png resize: (83, 74) 1375279201 -2.639230652790123 treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525479_0.png resize: (322, 305) 1375279206 -1.2696138663944532 treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525482_0.png resize: (986, 985) 1375279207 -0.6047454276695433 treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525491_0.png resize: (126, 121) 1375279208 -1.620364551561139 treat image : temp/1754386229_2341597_1375252592_7456c753dcac0d644f8dd08007dbdd29_rle_crop_3903525538_0.png resize: (129, 213) 1375279210 0.6535422041887604 treat image : temp/1754386229_2341597_1375253109_5ee6ff766e83940691b1f963d1a48f8e_rle_crop_3903525518_0.png resize: (73, 120) 1375279211 -3.120269141228942 treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525474_0.png resize: (532, 343) 1375279234 0.16779362247124507 treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525475_0.png resize: (268, 286) 1375279235 -1.938884320890294 treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525477_0.png resize: (89, 184) 1375279236 -2.98252533201582 treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525480_0.png resize: (178, 141) 1375279237 -2.8802703016034314 treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525483_0.png resize: (152, 169) 1375279238 -1.9996556009359439 treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664_rle_crop_3903525485_0.png resize: (385, 712) 1375279239 -2.624175718672438 treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664_rle_crop_3903525486_0.png resize: (144, 139) 1375279240 -2.807955208125567 treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664_rle_crop_3903525487_0.png resize: (522, 323) 1375279241 0.3754567123539049 treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525490_0.png resize: (496, 348) 1375279242 -1.224425883838889 treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525493_0.png resize: (43, 77) 1375279243 -0.717977364514597 treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525495_0.png resize: (538, 352) 1375279244 0.19200180521095853 treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525497_0.png resize: (986, 1671) 1375279245 -0.32605154956901927 treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b_rle_crop_3903525499_0.png resize: (513, 399) 1375279246 0.3967185239733928 treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab_rle_crop_3903525502_0.png resize: (92, 298) 1375279247 -1.0889338523789718 treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab_rle_crop_3903525503_0.png resize: (116, 186) 1375279248 -3.2516709944412825 treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab_rle_crop_3903525504_0.png resize: (588, 346) 1375279249 -0.634484083954958 treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab_rle_crop_3903525505_0.png resize: (171, 145) 1375279250 -1.939399982835153 treat image : temp/1754386229_2341597_1375253134_d627c607254eaf687aac99365dfd13b1_rle_crop_3903525506_0.png resize: (59, 75) 1375279251 1.8047626268795962 treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097_rle_crop_3903525510_0.png resize: (515, 319) 1375279252 0.7349274131321947 treat image : temp/1754386229_2341597_1375253130_e217c4762688b703bb0dabb0c3cf6e4d_rle_crop_3903525513_0.png resize: (159, 250) 1375279253 -0.5324617805156571 treat image : temp/1754386229_2341597_1375253127_abdc55571c39a2f0a8a6c51479b2d6e7_rle_crop_3903525514_0.png resize: (553, 369) 1375279254 -0.337673619666636 treat image : temp/1754386229_2341597_1375253107_48ccdd25d57577e884c32e978ccf2350_rle_crop_3903525523_0.png resize: (996, 1107) 1375279255 -1.1020627768039735 treat image : temp/1754386229_2341597_1375253103_29482e9b909f99e829a1d9d64f7cddac_rle_crop_3903525528_0.png resize: (539, 334) 1375279256 -0.17776950002606717 treat image : temp/1754386229_2341597_1375253103_29482e9b909f99e829a1d9d64f7cddac_rle_crop_3903525529_0.png resize: (132, 164) 1375279257 -3.5921469497896297 treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525531_0.png resize: (62, 64) 1375279258 -0.32625772862563435 treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525532_0.png resize: (141, 139) 1375279259 -1.9588413968965948 treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525533_0.png resize: (969, 1051) 1375279260 0.2372519066676352 treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525534_0.png resize: (373, 507) 1375279261 -2.31159473784366 treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525535_0.png resize: (519, 349) 1375279262 -0.06821993604410566 treat image : temp/1754386229_2341597_1375252718_eeddc8823a07d541fa2aa0e8638f682a_rle_crop_3903525536_0.png resize: (476, 309) 1375279263 0.15773442905659935 treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664_rle_crop_3903525484_0.png resize: (132, 128) 1375279264 -2.696740412128317 treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097_rle_crop_3903525509_0.png resize: (159, 196) 1375279265 1.4687165311494546 treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b_rle_crop_3903525500_0.png resize: (82, 306) 1375279267 -0.6787061722184173 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.021126270294189453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 10.206600189208984 save missing photos in datou_result : time spend for datou_step_exec : 21.70953607559204 time spend to save output : 10.232627868652344 total time spend for step 6 : 31.942163944244385 step7:brightness Tue Aug 5 11:32:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d.jpg treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a.jpg treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664.jpg treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11.jpg treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63.jpg treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b.jpg treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab.jpg treat image : temp/1754386229_2341597_1375253134_d627c607254eaf687aac99365dfd13b1.jpg treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097.jpg treat image : temp/1754386229_2341597_1375253130_e217c4762688b703bb0dabb0c3cf6e4d.jpg treat image : temp/1754386229_2341597_1375253127_abdc55571c39a2f0a8a6c51479b2d6e7.jpg treat image : temp/1754386229_2341597_1375253110_30eb62b60a5dcf008288b325dc7671bb.jpg treat image : temp/1754386229_2341597_1375253109_5ee6ff766e83940691b1f963d1a48f8e.jpg treat image : temp/1754386229_2341597_1375253107_48ccdd25d57577e884c32e978ccf2350.jpg treat image : temp/1754386229_2341597_1375253105_f0f4a3f834675281fc412b7c400a71b6.jpg treat image : temp/1754386229_2341597_1375253103_29482e9b909f99e829a1d9d64f7cddac.jpg treat image : temp/1754386229_2341597_1375252889_ed4cfa1cfb5842bee22460d5939fedb7.jpg treat image : temp/1754386229_2341597_1375252871_9918723a8324d05aaccc452d0530bc7c.jpg treat image : temp/1754386229_2341597_1375252848_779d490372a83e4486ceea631e538a58.jpg treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79.jpg treat image : temp/1754386229_2341597_1375252718_eeddc8823a07d541fa2aa0e8638f682a.jpg treat image : temp/1754386229_2341597_1375252690_b7268fb0ea39661dc15e56f47ac18209.jpg treat image : temp/1754386229_2341597_1375252592_7456c753dcac0d644f8dd08007dbdd29.jpg treat image : temp/1754386229_2341597_1375252591_cfc7181b7dcdefb605b204995fe33072.jpg treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525473_0.png treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525476_0.png treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525478_0.png treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525481_0.png treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525488_0.png treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525489_0.png treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525492_0.png treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525494_0.png treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525496_0.png treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b_rle_crop_3903525498_0.png treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b_rle_crop_3903525501_0.png treat image : temp/1754386229_2341597_1375253134_d627c607254eaf687aac99365dfd13b1_rle_crop_3903525507_0.png treat image : temp/1754386229_2341597_1375253134_d627c607254eaf687aac99365dfd13b1_rle_crop_3903525508_0.png treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097_rle_crop_3903525511_0.png treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097_rle_crop_3903525512_0.png treat image : temp/1754386229_2341597_1375253127_abdc55571c39a2f0a8a6c51479b2d6e7_rle_crop_3903525515_0.png treat image : temp/1754386229_2341597_1375253110_30eb62b60a5dcf008288b325dc7671bb_rle_crop_3903525516_0.png treat image : temp/1754386229_2341597_1375253110_30eb62b60a5dcf008288b325dc7671bb_rle_crop_3903525517_0.png treat image : temp/1754386229_2341597_1375253109_5ee6ff766e83940691b1f963d1a48f8e_rle_crop_3903525519_0.png treat image : temp/1754386229_2341597_1375253109_5ee6ff766e83940691b1f963d1a48f8e_rle_crop_3903525520_0.png treat image : temp/1754386229_2341597_1375253107_48ccdd25d57577e884c32e978ccf2350_rle_crop_3903525521_0.png treat image : temp/1754386229_2341597_1375253107_48ccdd25d57577e884c32e978ccf2350_rle_crop_3903525522_0.png treat image : temp/1754386229_2341597_1375253105_f0f4a3f834675281fc412b7c400a71b6_rle_crop_3903525524_0.png treat image : temp/1754386229_2341597_1375253105_f0f4a3f834675281fc412b7c400a71b6_rle_crop_3903525525_0.png treat image : temp/1754386229_2341597_1375253105_f0f4a3f834675281fc412b7c400a71b6_rle_crop_3903525526_0.png treat image : temp/1754386229_2341597_1375253103_29482e9b909f99e829a1d9d64f7cddac_rle_crop_3903525527_0.png treat image : temp/1754386229_2341597_1375252848_779d490372a83e4486ceea631e538a58_rle_crop_3903525530_0.png treat image : temp/1754386229_2341597_1375252690_b7268fb0ea39661dc15e56f47ac18209_rle_crop_3903525537_0.png treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525479_0.png treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525482_0.png treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525491_0.png treat image : temp/1754386229_2341597_1375252592_7456c753dcac0d644f8dd08007dbdd29_rle_crop_3903525538_0.png treat image : temp/1754386229_2341597_1375253109_5ee6ff766e83940691b1f963d1a48f8e_rle_crop_3903525518_0.png treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525474_0.png treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525475_0.png treat image : temp/1754386229_2341597_1375253316_3e88ac72fb313119b3055dcfa446362d_rle_crop_3903525477_0.png treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525480_0.png treat image : temp/1754386229_2341597_1375253302_648ed7bd2f1269c3c649f3b0afd21d8a_rle_crop_3903525483_0.png treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664_rle_crop_3903525485_0.png treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664_rle_crop_3903525486_0.png treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664_rle_crop_3903525487_0.png treat image : temp/1754386229_2341597_1375253280_2e137de3ba47d164e53b47628ce57d11_rle_crop_3903525490_0.png treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525493_0.png treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525495_0.png treat image : temp/1754386229_2341597_1375253258_ddc253088b06c2f3a27aacdc04751d63_rle_crop_3903525497_0.png treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b_rle_crop_3903525499_0.png treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab_rle_crop_3903525502_0.png treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab_rle_crop_3903525503_0.png treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab_rle_crop_3903525504_0.png treat image : temp/1754386229_2341597_1375253135_73b927f408f023a2ddbfb5b9ddffa7ab_rle_crop_3903525505_0.png treat image : temp/1754386229_2341597_1375253134_d627c607254eaf687aac99365dfd13b1_rle_crop_3903525506_0.png treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097_rle_crop_3903525510_0.png treat image : temp/1754386229_2341597_1375253130_e217c4762688b703bb0dabb0c3cf6e4d_rle_crop_3903525513_0.png treat image : temp/1754386229_2341597_1375253127_abdc55571c39a2f0a8a6c51479b2d6e7_rle_crop_3903525514_0.png treat image : temp/1754386229_2341597_1375253107_48ccdd25d57577e884c32e978ccf2350_rle_crop_3903525523_0.png treat image : temp/1754386229_2341597_1375253103_29482e9b909f99e829a1d9d64f7cddac_rle_crop_3903525528_0.png treat image : temp/1754386229_2341597_1375253103_29482e9b909f99e829a1d9d64f7cddac_rle_crop_3903525529_0.png treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525531_0.png treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525532_0.png treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525533_0.png treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525534_0.png treat image : temp/1754386229_2341597_1375252775_7c7430bc15399d34b9d03061d72a7c79_rle_crop_3903525535_0.png treat image : temp/1754386229_2341597_1375252718_eeddc8823a07d541fa2aa0e8638f682a_rle_crop_3903525536_0.png treat image : temp/1754386229_2341597_1375253283_de72917038f3aaf06c13450c42081664_rle_crop_3903525484_0.png treat image : temp/1754386229_2341597_1375253132_ce831f052817ce0379106a68dacce097_rle_crop_3903525509_0.png treat image : temp/1754386229_2341597_1375253233_5179a42574924dc94e1dcad41deda49b_rle_crop_3903525500_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 90 time used for this insertion : 0.01938009262084961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 90 time used for this insertion : 0.02065420150756836 save missing photos in datou_result : time spend for datou_step_exec : 6.235815048217773 time spend to save output : 0.0449981689453125 total time spend for step 7 : 6.280813217163086 step8:velours_tree Tue Aug 5 11:32:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.0942838191986084 time spend to save output : 5.435943603515625e-05 total time spend for step 8 : 0.09433817863464355 step9:send_mail_cod Tue Aug 5 11:32:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25678966_05-08-2025_11_32_55.pdf 25680665 imagette256806651754386375 25680666 change filename to text .imagette256806661754386375 25680667 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256806671754386375 25680668 change filename to text .imagette256806681754386376 25680669 imagette256806691754386376 25680670 imagette256806701754386376 25680671 imagette256806711754386376 25680673 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256806731754386376 25680674 change filename to text .change filename to text .imagette256806741754386377 25680675 change filename to text .change filename to text .change filename to text .change filename to text .imagette256806751754386377 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25678966 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25680665,25680666,25680667,25680668,25680669,25680670,25680671,25680672,25680673,25680674,25680675?tags=flou,pet_fonce,pet_clair,metal,mal_croppe,pehd,background,environnement,papier,autre,carton args[1375253316] : ((1375253316, 1.5291087268057784, 492688767), (1375253316, 0.39144517318315636, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253302] : ((1375253302, -3.1588022230978696, 492609224), (1375253302, 0.2688766982205753, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253283] : ((1375253283, -0.5642682954245811, 492688767), (1375253283, 0.32235384665377653, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253280] : ((1375253280, 1.6612192509465777, 492688767), (1375253280, 0.6258669093564256, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253258] : ((1375253258, 1.1375278862650868, 492688767), (1375253258, 0.34374064151434197, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253233] : ((1375253233, -0.5609258522703987, 492688767), (1375253233, 0.6245066502763659, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253135] : ((1375253135, 1.3458531470060076, 492688767), (1375253135, 0.3845309908883573, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253134] : ((1375253134, 9.500838829404131, 492688767), (1375253134, 0.8404924411410282, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253132] : ((1375253132, -0.29706989777163595, 492688767), (1375253132, 1.0691613084645593, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253130] : ((1375253130, 0.9357575001141214, 492688767), (1375253130, 0.954615562116276, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253127] : ((1375253127, -3.3176016858067245, 492609224), (1375253127, 0.21795793434199778, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253110] : ((1375253110, -1.003219969350166, 492688767), (1375253110, 0.08456058429251863, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253109] : ((1375253109, 3.030244994416442, 492688767), (1375253109, 0.22191535503287182, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253107] : ((1375253107, 0.62819642558412, 492688767), (1375253107, 0.9047849550134973, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253105] : ((1375253105, 0.07195397974919324, 492688767), (1375253105, 0.5930856229176531, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375253103] : ((1375253103, -3.724087530785395, 492609224), (1375253103, 0.3787736208448065, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375252889] : ((1375252889, -1.8266429962104265, 492688767), (1375252889, 0.9063197109215941, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375252871] : ((1375252871, -0.03911870565813013, 492688767), (1375252871, 0.6801048217147613, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375252848] : ((1375252848, 0.48991705212176373, 492688767), (1375252848, 0.7501748776315574, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375252775] : ((1375252775, -0.8740225228057326, 492688767), (1375252775, 0.6563962093308526, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375252718] : ((1375252718, -0.7420036016100633, 492688767), (1375252718, 0.7294067283557546, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375252690] : ((1375252690, -1.3567734476233069, 492688767), (1375252690, 0.9090057949249398, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375252592] : ((1375252592, -0.1659885732405243, 492688767), (1375252592, 0.7646870072856399, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com args[1375252591] : ((1375252591, -1.7185859704189783, 492688767), (1375252591, 0.8251166732077412, 2107752395), '0.1160300925925926') We are sending mail with results at report@fotonower.com refus_total : 0.1160300925925926 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25678966 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678966_05-08-2025_11_32_55.pdf results_Auto_P25678966_05-08-2025_11_32_55.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678966_05-08-2025_11_32_55.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25678966','results_Auto_P25678966_05-08-2025_11_32_55.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678966_05-08-2025_11_32_55.pdf','pdf','','0.65','0.1160300925925926') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25678966

https://www.fotonower.com/image?json=false&list_photos_id=1375253316
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5291087268057784)
https://www.fotonower.com/image?json=false&list_photos_id=1375253302
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253283
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253280
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.6612192509465777)
https://www.fotonower.com/image?json=false&list_photos_id=1375253258
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1375278862650868)
https://www.fotonower.com/image?json=false&list_photos_id=1375253233
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253135
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3458531470060076)
https://www.fotonower.com/image?json=false&list_photos_id=1375253134
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.500838829404131)
https://www.fotonower.com/image?json=false&list_photos_id=1375253132
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253130
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253127
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253110
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253109
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.030244994416442)
https://www.fotonower.com/image?json=false&list_photos_id=1375253107
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253105
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375253103
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375252889
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375252871
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375252848
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375252775
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375252718
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375252690
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375252592
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375252591
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.60%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/25680666?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25680667?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25680668?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25680673?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25680674?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25680675?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678966_05-08-2025_11_32_55.pdf.

Lien vers velours :https://www.fotonower.com/velours/25680665,25680666,25680667,25680668,25680669,25680670,25680671,25680672,25680673,25680674,25680675?tags=flou,pet_fonce,pet_clair,metal,mal_croppe,pehd,background,environnement,papier,autre,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 05 Aug 2025 09:33:00 GMT Content-Length: 0 Connection: close X-Message-Id: foRCjZNZRd2H7F9QShmZcQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375253316, 1375253302, 1375253283, 1375253280, 1375253258, 1375253233, 1375253135, 1375253134, 1375253132, 1375253130, 1375253127, 1375253110, 1375253109, 1375253107, 1375253105, 1375253103, 1375252889, 1375252871, 1375252848, 1375252775, 1375252718, 1375252690, 1375252592, 1375252591] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253316', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253302', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253283', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253280', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253258', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253233', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253135', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253134', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253132', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253130', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253127', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253110', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253109', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253107', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253105', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253103', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252889', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252871', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252848', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252775', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252718', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252690', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252592', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252591', None, None, None, None, None, '3447819') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.017957210540771484 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.735162973403931 time spend to save output : 0.018300294876098633 total time spend for step 9 : 5.753463268280029 step10:split_time_score Tue Aug 5 11:33:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 24),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05082025 25678966 Nombre de photos uploadées : 24 / 23040 (0%) 05082025 25678966 Nombre de photos taguées (types de déchets): 0 / 24 (0%) 05082025 25678966 Nombre de photos taguées (volume) : 0 / 24 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ???????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001119852066040039 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21701860427856445 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07281246985918212 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25675565_05-08-2025_10_11_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25675565 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25675565 AND mptpi.`type`=3594 To do Qualite : 0.1160300925925926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678966_05-08-2025_11_32_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25678966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678966 AND mptpi.`type`=3594 To do Qualite : 0.08013306166409463 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678972_05-08-2025_11_21_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25678972 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678972 AND mptpi.`type`=3594 To do Qualite : 0.09016365916105501 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678976_05-08-2025_11_11_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25678976 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678976 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05082025': {'nb_upload': 24, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375253316, 1375253302, 1375253283, 1375253280, 1375253258, 1375253233, 1375253135, 1375253134, 1375253132, 1375253130, 1375253127, 1375253110, 1375253109, 1375253107, 1375253105, 1375253103, 1375252889, 1375252871, 1375252848, 1375252775, 1375252718, 1375252690, 1375252592, 1375252591] Looping around the photos to save general results len do output : 1 /25678966Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253316', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253302', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253283', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253280', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253258', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253233', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253135', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253134', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253132', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253130', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253127', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253110', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253109', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253107', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253105', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375253103', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252889', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252871', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252848', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252775', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252718', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252690', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252592', None, None, None, None, None, '3447819') ('3318', None, None, None, None, None, None, None, '3447819') ('3318', '25678966', '1375252591', None, None, None, None, None, '3447819') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.10402750968933105 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6240339279174805 time spend to save output : 0.10432100296020508 total time spend for step 10 : 0.7283549308776855 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 24 set_done_treatment 83.88user 30.20system 2:35.76elapsed 73%CPU (0avgtext+0avgdata 2959108maxresident)k 229720inputs+50584outputs (738major+2569406minor)pagefaults 0swaps