python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2436666 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3408610'] with mtr_portfolio_ids : ['25537193'] and first list_photo_ids : [] new path : /proc/2436666/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 24 ; length of list_pids : 24 ; length of list_args : 24 time to download the photos : 2.903719663619995 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Jul 31 11:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3470 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-31 11:50:33.306674: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-31 11:50:33.331306: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-31 11:50:33.333302: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f20cc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-31 11:50:33.333363: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-31 11:50:33.337414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-31 11:50:33.484031: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x39758880 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-31 11:50:33.484080: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-31 11:50:33.485128: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-31 11:50:33.485538: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-31 11:50:33.488962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-31 11:50:33.492103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-31 11:50:33.492528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-31 11:50:33.495556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-31 11:50:33.497011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-31 11:50:33.502241: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-31 11:50:33.503329: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-31 11:50:33.503410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-31 11:50:33.503997: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-31 11:50:33.504014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-31 11:50:33.504023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-31 11:50:33.504969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3019 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-31 11:50:33.753765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-31 11:50:33.753885: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-31 11:50:33.753908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-31 11:50:33.753929: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-31 11:50:33.753949: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-31 11:50:33.753967: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-31 11:50:33.753987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-31 11:50:33.754006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-31 11:50:33.755092: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-31 11:50:33.756394: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-31 11:50:33.756434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-31 11:50:33.756455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-31 11:50:33.756474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-31 11:50:33.756492: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-31 11:50:33.756511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-31 11:50:33.756529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-31 11:50:33.756548: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-31 11:50:33.757657: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-31 11:50:33.757696: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-31 11:50:33.757708: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-31 11:50:33.757718: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-31 11:50:33.758894: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3019 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-31 11:50:42.571137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-31 11:50:42.754581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-31 11:50:44.182342: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.182935: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.20G (2366963712 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.182964: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.183529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.183546: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.190621: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.190642: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.191240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.191257: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.197782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.197803: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.198352: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.198367: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.234047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.234087: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.234647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.234662: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.240827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.240848: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.241406: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.241422: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-31 11:50:44.280155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.280859: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.282802: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.283381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.331956: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.332745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.334954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.335531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.375675: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.376321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.378795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.379369: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.385640: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.386210: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.388301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.388890: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.395870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.396467: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.398616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.399224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.431573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.432137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.432687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.433235: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.438094: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.438648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.457075: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.457632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.458182: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.458730: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.472824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.473386: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.473987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.474584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.479195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.479757: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.485745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.486302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.499648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.500365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.504865: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.505418: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.505965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.506523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.507281: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.507880: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.520158: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.520709: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.521270: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.521817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.522363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.522910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.541560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.542120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.595851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.596974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.598082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.599174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.608470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.609023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.623230: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.623872: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.624451: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.625012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.629527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.630129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.630685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.631253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.632440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.632462: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-07-31 11:50:44.643200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.643840: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.653432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.654001: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.654559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.655105: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.655711: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-31 11:50:44.656331: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.45G (2629959680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 24 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 2437239 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1084 tf kernel not reseted sub process len(results) : 24 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 24 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2277 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 1854 time to create 1 rle with old method : 0.0025115013122558594 length of segment : 46 time for calcul the mask position with numpy : 0.010777711868286133 nb_pixel_total : 705150 time to create 1 rle with new method : 0.49443912506103516 length of segment : 925 time for calcul the mask position with numpy : 0.0016262531280517578 nb_pixel_total : 119585 time to create 1 rle with old method : 0.13222551345825195 length of segment : 654 time for calcul the mask position with numpy : 0.017893552780151367 nb_pixel_total : 738019 time to create 1 rle with new method : 0.04381537437438965 length of segment : 938 time for calcul the mask position with numpy : 0.0003185272216796875 nb_pixel_total : 19591 time to create 1 rle with old method : 0.022324562072753906 length of segment : 218 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 3024 time to create 1 rle with old method : 0.003553152084350586 length of segment : 61 time for calcul the mask position with numpy : 0.0001819133758544922 nb_pixel_total : 9557 time to create 1 rle with old method : 0.011026859283447266 length of segment : 174 time for calcul the mask position with numpy : 0.00421595573425293 nb_pixel_total : 320223 time to create 1 rle with new method : 0.02409815788269043 length of segment : 424 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 5249 time to create 1 rle with old method : 0.006222963333129883 length of segment : 87 time for calcul the mask position with numpy : 0.00039577484130859375 nb_pixel_total : 30406 time to create 1 rle with old method : 0.03873252868652344 length of segment : 186 time for calcul the mask position with numpy : 0.00042724609375 nb_pixel_total : 7582 time to create 1 rle with old method : 0.009052515029907227 length of segment : 182 time for calcul the mask position with numpy : 0.00036072731018066406 nb_pixel_total : 10196 time to create 1 rle with old method : 0.011928319931030273 length of segment : 116 time for calcul the mask position with numpy : 0.0003952980041503906 nb_pixel_total : 11942 time to create 1 rle with old method : 0.020343542098999023 length of segment : 112 time for calcul the mask position with numpy : 0.0003986358642578125 nb_pixel_total : 10160 time to create 1 rle with old method : 0.017232179641723633 length of segment : 123 time for calcul the mask position with numpy : 0.002684354782104492 nb_pixel_total : 109358 time to create 1 rle with old method : 0.12889814376831055 length of segment : 539 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 7269 time to create 1 rle with old method : 0.008634805679321289 length of segment : 95 time for calcul the mask position with numpy : 0.0004203319549560547 nb_pixel_total : 3234 time to create 1 rle with old method : 0.0039615631103515625 length of segment : 151 time for calcul the mask position with numpy : 0.018399477005004883 nb_pixel_total : 757101 time to create 1 rle with new method : 0.36557722091674805 length of segment : 988 time for calcul the mask position with numpy : 0.011967658996582031 nb_pixel_total : 732717 time to create 1 rle with new method : 0.05224323272705078 length of segment : 954 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 3559 time to create 1 rle with old method : 0.003908634185791016 length of segment : 84 time for calcul the mask position with numpy : 0.0005791187286376953 nb_pixel_total : 21503 time to create 1 rle with old method : 0.022704362869262695 length of segment : 194 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 3053 time to create 1 rle with old method : 0.0033872127532958984 length of segment : 66 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 2996 time to create 1 rle with old method : 0.0035059452056884766 length of segment : 50 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1629 time to create 1 rle with old method : 0.0018908977508544922 length of segment : 42 time for calcul the mask position with numpy : 0.01679205894470215 nb_pixel_total : 869552 time to create 1 rle with new method : 0.07002687454223633 length of segment : 1287 time for calcul the mask position with numpy : 0.0002117156982421875 nb_pixel_total : 9874 time to create 1 rle with old method : 0.01071929931640625 length of segment : 118 time for calcul the mask position with numpy : 0.0013003349304199219 nb_pixel_total : 91087 time to create 1 rle with old method : 0.1041572093963623 length of segment : 517 time for calcul the mask position with numpy : 0.00018143653869628906 nb_pixel_total : 5381 time to create 1 rle with old method : 0.0063321590423583984 length of segment : 106 time for calcul the mask position with numpy : 0.0004062652587890625 nb_pixel_total : 13049 time to create 1 rle with old method : 0.015010595321655273 length of segment : 211 time for calcul the mask position with numpy : 0.009572744369506836 nb_pixel_total : 717319 time to create 1 rle with new method : 0.12547922134399414 length of segment : 975 time for calcul the mask position with numpy : 0.00024509429931640625 nb_pixel_total : 8009 time to create 1 rle with old method : 0.009268760681152344 length of segment : 132 time for calcul the mask position with numpy : 0.008910179138183594 nb_pixel_total : 692886 time to create 1 rle with new method : 0.03980135917663574 length of segment : 954 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 12887 time to create 1 rle with old method : 0.014829874038696289 length of segment : 124 time for calcul the mask position with numpy : 0.0001983642578125 nb_pixel_total : 7888 time to create 1 rle with old method : 0.00941157341003418 length of segment : 73 time for calcul the mask position with numpy : 0.002057313919067383 nb_pixel_total : 107154 time to create 1 rle with old method : 0.11813545227050781 length of segment : 516 time for calcul the mask position with numpy : 0.012519598007202148 nb_pixel_total : 751618 time to create 1 rle with new method : 0.22488021850585938 length of segment : 983 time for calcul the mask position with numpy : 0.01212310791015625 nb_pixel_total : 764254 time to create 1 rle with new method : 0.04981565475463867 length of segment : 992 time for calcul the mask position with numpy : 0.00029540061950683594 nb_pixel_total : 15768 time to create 1 rle with old method : 0.01790904998779297 length of segment : 193 time for calcul the mask position with numpy : 0.00022983551025390625 nb_pixel_total : 12833 time to create 1 rle with old method : 0.014445781707763672 length of segment : 119 time for calcul the mask position with numpy : 0.0008745193481445312 nb_pixel_total : 31187 time to create 1 rle with old method : 0.05074286460876465 length of segment : 233 time for calcul the mask position with numpy : 0.00017309188842773438 nb_pixel_total : 7923 time to create 1 rle with old method : 0.009244441986083984 length of segment : 114 time spent for convertir_results : 4.693109035491943 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 41 chid ids of type : 3594 Number RLEs to save : 15056 save missing photos in datou_result : time spend for datou_step_exec : 34.13243556022644 time spend to save output : 0.9530870914459229 total time spend for step 1 : 35.08552265167236 step2:crop_condition Thu Jul 31 11:51:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 24 ! batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753955466_2436666 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.40466570854187 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753955470_2436666 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2916104793548584 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753955501_2436666 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.233237266540527 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753955509_2436666 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5257501602172852 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1374568368, 1374568367, 1374568366, 1374568364, 1374568361, 1374568357, 1374568345, 1374568334, 1374568326, 1374568324, 1374568320, 1374568317, 1374568308, 1374568307, 1374568306, 1374568304, 1374568299, 1374568262, 1374568261, 1374568259, 1374568258, 1374568255, 1374568252, 1374568225] Looping around the photos to save general results len do output : 41 /1374578175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374578243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568368', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568367', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568366', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568364', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568361', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568357', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568345', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568334', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568326', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568324', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568320', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568317', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568308', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568307', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568306', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568304', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568299', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568262', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568261', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568259', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568258', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568255', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568252', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568225', None, None, None, None, None, '3408610') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 147 time used for this insertion : 0.02446150779724121 save_final save missing photos in datou_result : time spend for datou_step_exec : 43.51589035987854 time spend to save output : 0.025847434997558594 total time spend for step 2 : 43.5417377948761 step3:rle_unique_nms_with_priority Thu Jul 31 11:51:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.36551833152770996 time for calcul the mask position with numpy : 0.17901968955993652 nb_pixel_total : 2071757 time to create 1 rle with new method : 0.20127582550048828 time for calcul the mask position with numpy : 0.005982398986816406 nb_pixel_total : 1843 time to create 1 rle with old method : 0.0020599365234375 create new chi : 0.3979008197784424 time to delete rle : 0.025503158569335938 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1174 TO DO : save crop sub photo not yet done ! save time : 0.10923624038696289 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.12135505676269531 time for calcul the mask position with numpy : 0.05676913261413574 nb_pixel_total : 1369151 time to create 1 rle with new method : 0.1819460391998291 time for calcul the mask position with numpy : 0.011552095413208008 nb_pixel_total : 704449 time to create 1 rle with new method : 0.18394160270690918 create new chi : 0.4447793960571289 time to delete rle : 0.000278472900390625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2928 TO DO : save crop sub photo not yet done ! save time : 0.19989633560180664 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.1869642734527588 time for calcul the mask position with numpy : 0.1867508888244629 nb_pixel_total : 1953542 time to create 1 rle with new method : 0.18484210968017578 time for calcul the mask position with numpy : 0.00642704963684082 nb_pixel_total : 120058 time to create 1 rle with old method : 0.12434148788452148 create new chi : 0.5121004581451416 time to delete rle : 0.0003333091735839844 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2222 TO DO : save crop sub photo not yet done ! save time : 0.17432117462158203 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.1347792148590088 time for calcul the mask position with numpy : 0.1010746955871582 nb_pixel_total : 1335711 time to create 1 rle with new method : 0.09027814865112305 time for calcul the mask position with numpy : 0.011482477188110352 nb_pixel_total : 737889 time to create 1 rle with new method : 0.15708279609680176 create new chi : 0.3695676326751709 time to delete rle : 0.00031375885009765625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2966 TO DO : save crop sub photo not yet done ! save time : 0.21015071868896484 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.08448910713195801 time for calcul the mask position with numpy : 0.12162470817565918 nb_pixel_total : 2054060 time to create 1 rle with new method : 0.09415626525878906 time for calcul the mask position with numpy : 0.006418943405151367 nb_pixel_total : 19540 time to create 1 rle with old method : 0.02112269401550293 create new chi : 0.2542574405670166 time to delete rle : 0.00027251243591308594 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1522 TO DO : save crop sub photo not yet done ! save time : 0.12613296508789062 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.4759078025817871 time for calcul the mask position with numpy : 0.060272216796875 nb_pixel_total : 1744580 time to create 1 rle with new method : 0.4316866397857666 time for calcul the mask position with numpy : 0.00829458236694336 nb_pixel_total : 316458 time to create 1 rle with new method : 0.1913919448852539 time for calcul the mask position with numpy : 0.0061266422271728516 nb_pixel_total : 9546 time to create 1 rle with old method : 0.010590553283691406 time for calcul the mask position with numpy : 0.006597042083740234 nb_pixel_total : 3016 time to create 1 rle with old method : 0.0032808780670166016 create new chi : 0.7273304462432861 time to delete rle : 0.00043702125549316406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2381 TO DO : save crop sub photo not yet done ! save time : 0.18616509437561035 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.13529634475708008 time for calcul the mask position with numpy : 0.018849849700927734 nb_pixel_total : 2038075 time to create 1 rle with new method : 0.08807110786437988 time for calcul the mask position with numpy : 0.006094694137573242 nb_pixel_total : 30281 time to create 1 rle with old method : 0.03281068801879883 time for calcul the mask position with numpy : 0.00585627555847168 nb_pixel_total : 5244 time to create 1 rle with old method : 0.005710124969482422 create new chi : 0.16458725929260254 time to delete rle : 0.00025534629821777344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1632 TO DO : save crop sub photo not yet done ! save time : 0.15590143203735352 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.3231046199798584 time for calcul the mask position with numpy : 0.07130050659179688 nb_pixel_total : 2043956 time to create 1 rle with new method : 0.24036645889282227 time for calcul the mask position with numpy : 0.006245613098144531 nb_pixel_total : 11910 time to create 1 rle with old method : 0.013098001480102539 time for calcul the mask position with numpy : 0.005983591079711914 nb_pixel_total : 10157 time to create 1 rle with old method : 0.010926008224487305 time for calcul the mask position with numpy : 0.0058176517486572266 nb_pixel_total : 7577 time to create 1 rle with old method : 0.0082855224609375 create new chi : 0.371718168258667 time to delete rle : 0.00031757354736328125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1906 TO DO : save crop sub photo not yet done ! save time : 0.16019701957702637 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07409811019897461 time for calcul the mask position with numpy : 0.0192415714263916 nb_pixel_total : 2063466 time to create 1 rle with new method : 0.08432674407958984 time for calcul the mask position with numpy : 0.006458282470703125 nb_pixel_total : 10134 time to create 1 rle with old method : 0.011641979217529297 create new chi : 0.12935972213745117 time to delete rle : 0.0002541542053222656 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1326 TO DO : save crop sub photo not yet done ! save time : 0.11992764472961426 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.36200380325317383 time for calcul the mask position with numpy : 0.08618783950805664 nb_pixel_total : 1956956 time to create 1 rle with new method : 0.10658383369445801 time for calcul the mask position with numpy : 0.006058216094970703 nb_pixel_total : 7261 time to create 1 rle with old method : 0.008234500885009766 time for calcul the mask position with numpy : 0.006766080856323242 nb_pixel_total : 109383 time to create 1 rle with old method : 0.1479957103729248 create new chi : 0.3724393844604492 time to delete rle : 0.0003426074981689453 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2348 TO DO : save crop sub photo not yet done ! save time : 0.18220925331115723 No data in photo_id : 1374568320 No data in photo_id : 1374568317 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.17249011993408203 time for calcul the mask position with numpy : 0.04854464530944824 nb_pixel_total : 1314191 time to create 1 rle with new method : 0.39540910720825195 time for calcul the mask position with numpy : 0.011587381362915039 nb_pixel_total : 756202 time to create 1 rle with new method : 0.28683996200561523 time for calcul the mask position with numpy : 0.005990266799926758 nb_pixel_total : 3207 time to create 1 rle with old method : 0.0035271644592285156 create new chi : 0.7608728408813477 time to delete rle : 0.00046944618225097656 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3370 TO DO : save crop sub photo not yet done ! save time : 0.22394609451293945 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.1986222267150879 time for calcul the mask position with numpy : 0.18225789070129395 nb_pixel_total : 1338691 time to create 1 rle with new method : 0.09055781364440918 time for calcul the mask position with numpy : 0.005902290344238281 nb_pixel_total : 3551 time to create 1 rle with old method : 0.003828763961791992 time for calcul the mask position with numpy : 0.011119365692138672 nb_pixel_total : 731358 time to create 1 rle with new method : 0.5165479183197021 create new chi : 0.819826602935791 time to delete rle : 0.00029754638671875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3162 TO DO : save crop sub photo not yet done ! save time : 0.21303224563598633 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.08313107490539551 time for calcul the mask position with numpy : 0.22330904006958008 nb_pixel_total : 2052109 time to create 1 rle with new method : 0.0849452018737793 time for calcul the mask position with numpy : 0.006358146667480469 nb_pixel_total : 21491 time to create 1 rle with old method : 0.023833274841308594 create new chi : 0.34694862365722656 time to delete rle : 0.0003292560577392578 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1474 TO DO : save crop sub photo not yet done ! save time : 0.11878442764282227 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.12228608131408691 time for calcul the mask position with numpy : 0.11120223999023438 nb_pixel_total : 2070554 time to create 1 rle with new method : 0.12151336669921875 time for calcul the mask position with numpy : 0.006378889083862305 nb_pixel_total : 3046 time to create 1 rle with old method : 0.0037157535552978516 create new chi : 0.2521097660064697 time to delete rle : 0.00023937225341796875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1214 TO DO : save crop sub photo not yet done ! save time : 0.13041162490844727 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.689194917678833 time for calcul the mask position with numpy : 0.08231186866760254 nb_pixel_total : 1697072 time to create 1 rle with new method : 0.11524248123168945 time for calcul the mask position with numpy : 0.006728410720825195 nb_pixel_total : 91087 time to create 1 rle with old method : 0.10088396072387695 time for calcul the mask position with numpy : 0.006124973297119141 nb_pixel_total : 9874 time to create 1 rle with old method : 0.01096653938293457 time for calcul the mask position with numpy : 0.00764012336730957 nb_pixel_total : 271006 time to create 1 rle with new method : 0.08975529670715332 time for calcul the mask position with numpy : 0.006209373474121094 nb_pixel_total : 1622 time to create 1 rle with old method : 0.0018687248229980469 time for calcul the mask position with numpy : 0.006137847900390625 nb_pixel_total : 2939 time to create 1 rle with old method : 0.003506898880004883 create new chi : 0.44672536849975586 time to delete rle : 0.0005309581756591797 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 3934 TO DO : save crop sub photo not yet done ! save time : 0.2614436149597168 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.040125131607055664 time for calcul the mask position with numpy : 0.020196199417114258 nb_pixel_total : 2055170 time to create 1 rle with new method : 0.029395580291748047 time for calcul the mask position with numpy : 0.0063323974609375 nb_pixel_total : 13049 time to create 1 rle with old method : 0.014881610870361328 time for calcul the mask position with numpy : 0.006334781646728516 nb_pixel_total : 5381 time to create 1 rle with old method : 0.006227731704711914 create new chi : 0.0899500846862793 time to delete rle : 0.0002741813659667969 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1714 TO DO : save crop sub photo not yet done ! save time : 0.14580988883972168 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03481650352478027 time for calcul the mask position with numpy : 0.014892578125 nb_pixel_total : 1356281 time to create 1 rle with new method : 0.5776913166046143 time for calcul the mask position with numpy : 0.011518716812133789 nb_pixel_total : 717319 time to create 1 rle with new method : 0.029910564422607422 create new chi : 0.6344900131225586 time to delete rle : 0.0003025531768798828 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3030 TO DO : save crop sub photo not yet done ! save time : 0.22641253471374512 No data in photo_id : 1374568259 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.22226333618164062 time for calcul the mask position with numpy : 0.23226118087768555 nb_pixel_total : 1372705 time to create 1 rle with new method : 0.0948326587677002 time for calcul the mask position with numpy : 0.012751340866088867 nb_pixel_total : 692886 time to create 1 rle with new method : 0.2879672050476074 time for calcul the mask position with numpy : 0.006228923797607422 nb_pixel_total : 8009 time to create 1 rle with old method : 0.00921773910522461 create new chi : 0.655174970626831 time to delete rle : 0.0005252361297607422 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3252 TO DO : save crop sub photo not yet done ! save time : 0.22794508934020996 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.08452129364013672 time for calcul the mask position with numpy : 0.0554201602935791 nb_pixel_total : 1194053 time to create 1 rle with new method : 0.19074416160583496 time for calcul the mask position with numpy : 0.012952804565429688 nb_pixel_total : 751618 time to create 1 rle with new method : 0.16679024696350098 time for calcul the mask position with numpy : 0.006967067718505859 nb_pixel_total : 107154 time to create 1 rle with old method : 0.1195366382598877 time for calcul the mask position with numpy : 0.006525754928588867 nb_pixel_total : 7888 time to create 1 rle with old method : 0.008849859237670898 time for calcul the mask position with numpy : 0.006438255310058594 nb_pixel_total : 12887 time to create 1 rle with old method : 0.014384746551513672 create new chi : 0.5987811088562012 time to delete rle : 0.0006253719329833984 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4472 TO DO : save crop sub photo not yet done ! save time : 0.32824277877807617 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.07450366020202637 time for calcul the mask position with numpy : 0.05455803871154785 nb_pixel_total : 1280745 time to create 1 rle with new method : 0.10559415817260742 time for calcul the mask position with numpy : 0.006651639938354492 nb_pixel_total : 12833 time to create 1 rle with old method : 0.014483451843261719 time for calcul the mask position with numpy : 0.006489753723144531 nb_pixel_total : 15768 time to create 1 rle with old method : 0.017719745635986328 time for calcul the mask position with numpy : 0.01607513427734375 nb_pixel_total : 764254 time to create 1 rle with new method : 0.09160137176513672 create new chi : 0.32230210304260254 time to delete rle : 0.0005273818969726562 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3688 TO DO : save crop sub photo not yet done ! save time : 0.25215864181518555 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.472456693649292 time for calcul the mask position with numpy : 0.09400153160095215 nb_pixel_total : 2034490 time to create 1 rle with new method : 0.11917376518249512 time for calcul the mask position with numpy : 0.006653785705566406 nb_pixel_total : 7923 time to create 1 rle with old method : 0.008800506591796875 time for calcul the mask position with numpy : 0.00637507438659668 nb_pixel_total : 31187 time to create 1 rle with old method : 0.035073041915893555 create new chi : 0.2824721336364746 time to delete rle : 0.00035834312438964844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1774 TO DO : save crop sub photo not yet done ! save time : 0.15698766708374023 map_output_result : {1374568368: (0.0, 'Should be the crop_list due to order', 0), 1374568367: (0.0, 'Should be the crop_list due to order', 0), 1374568366: (0.0, 'Should be the crop_list due to order', 0), 1374568364: (0.0, 'Should be the crop_list due to order', 0), 1374568361: (0.0, 'Should be the crop_list due to order', 0), 1374568357: (0.0, 'Should be the crop_list due to order', 0), 1374568345: (0.0, 'Should be the crop_list due to order', 0), 1374568334: (0.0, 'Should be the crop_list due to order', 0), 1374568326: (0.0, 'Should be the crop_list due to order', 0), 1374568324: (0.0, 'Should be the crop_list due to order', 0), 1374568320: (0.0, 'Should be the crop_list due to order', 0.0), 1374568317: (0.0, 'Should be the crop_list due to order', 0.0), 1374568308: (0.0, 'Should be the crop_list due to order', 0), 1374568307: (0.0, 'Should be the crop_list due to order', 0), 1374568306: (0.0, 'Should be the crop_list due to order', 0), 1374568304: (0.0, 'Should be the crop_list due to order', 0), 1374568299: (0.0, 'Should be the crop_list due to order', 0), 1374568262: (0.0, 'Should be the crop_list due to order', 0), 1374568261: (0.0, 'Should be the crop_list due to order', 0), 1374568259: (0.0, 'Should be the crop_list due to order', 0.0), 1374568258: (0.0, 'Should be the crop_list due to order', 0), 1374568255: (0.0, 'Should be the crop_list due to order', 0), 1374568252: (0.0, 'Should be the crop_list due to order', 0), 1374568225: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1374568368, 1374568367, 1374568366, 1374568364, 1374568361, 1374568357, 1374568345, 1374568334, 1374568326, 1374568324, 1374568320, 1374568317, 1374568308, 1374568307, 1374568306, 1374568304, 1374568299, 1374568262, 1374568261, 1374568259, 1374568258, 1374568255, 1374568252, 1374568225] Looping around the photos to save general results len do output : 24 /1374568368.Didn't retrieve data . /1374568367.Didn't retrieve data . /1374568366.Didn't retrieve data . /1374568364.Didn't retrieve data . /1374568361.Didn't retrieve data . /1374568357.Didn't retrieve data . /1374568345.Didn't retrieve data . /1374568334.Didn't retrieve data . /1374568326.Didn't retrieve data . /1374568324.Didn't retrieve data . /1374568320.Didn't retrieve data . /1374568317.Didn't retrieve data . /1374568308.Didn't retrieve data . /1374568307.Didn't retrieve data . /1374568306.Didn't retrieve data . /1374568304.Didn't retrieve data . /1374568299.Didn't retrieve data . /1374568262.Didn't retrieve data . /1374568261.Didn't retrieve data . /1374568259.Didn't retrieve data . /1374568258.Didn't retrieve data . /1374568255.Didn't retrieve data . /1374568252.Didn't retrieve data . /1374568225.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568368', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568367', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568366', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568364', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568361', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568357', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568345', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568334', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568326', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568324', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568320', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568317', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568308', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568307', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568306', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568304', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568299', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568262', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568261', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568259', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568258', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568255', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568252', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568225', None, None, None, None, None, '3408610') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.015845537185668945 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.924877405166626 time spend to save output : 0.01671123504638672 total time spend for step 3 : 17.941588640213013 step4:ventilate_hashtags_in_portfolio Thu Jul 31 11:52:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25537193 get user id for portfolio 25537193 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25537193 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','background','carton','metal','environnement','pet_fonce','autre','papier','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25537193 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','background','carton','metal','environnement','pet_fonce','autre','papier','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25537193 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','background','carton','metal','environnement','pet_fonce','autre','papier','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25537890,25537891,25537892,25537893,25537894,25537895,25537896,25537897,25537898,25537899,25537900?tags=flou,pehd,background,carton,metal,environnement,pet_fonce,autre,papier,pet_clair,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1374568368, 1374568367, 1374568366, 1374568364, 1374568361, 1374568357, 1374568345, 1374568334, 1374568326, 1374568324, 1374568320, 1374568317, 1374568308, 1374568307, 1374568306, 1374568304, 1374568299, 1374568262, 1374568261, 1374568259, 1374568258, 1374568255, 1374568252, 1374568225] Looping around the photos to save general results len do output : 1 /25537193. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568368', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568367', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568366', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568364', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568361', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568357', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568345', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568334', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568326', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568324', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568320', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568317', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568308', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568307', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568306', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568304', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568299', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568262', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568261', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568259', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568258', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568255', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568252', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568225', None, None, None, None, None, '3408610') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.015572547912597656 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6689229011535645 time spend to save output : 0.015967130661010742 total time spend for step 4 : 1.6848900318145752 step5:final Thu Jul 31 11:52:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1374568368: ('0.14363677099408437',), 1374568367: ('0.14363677099408437',), 1374568366: ('0.14363677099408437',), 1374568364: ('0.14363677099408437',), 1374568361: ('0.14363677099408437',), 1374568357: ('0.14363677099408437',), 1374568345: ('0.14363677099408437',), 1374568334: ('0.14363677099408437',), 1374568326: ('0.14363677099408437',), 1374568324: ('0.14363677099408437',), 1374568320: ('0.14363677099408437',), 1374568317: ('0.14363677099408437',), 1374568308: ('0.14363677099408437',), 1374568307: ('0.14363677099408437',), 1374568306: ('0.14363677099408437',), 1374568304: ('0.14363677099408437',), 1374568299: ('0.14363677099408437',), 1374568262: ('0.14363677099408437',), 1374568261: ('0.14363677099408437',), 1374568259: ('0.14363677099408437',), 1374568258: ('0.14363677099408437',), 1374568255: ('0.14363677099408437',), 1374568252: ('0.14363677099408437',), 1374568225: ('0.14363677099408437',)} new output for save of step final : {1374568368: ('0.14363677099408437',), 1374568367: ('0.14363677099408437',), 1374568366: ('0.14363677099408437',), 1374568364: ('0.14363677099408437',), 1374568361: ('0.14363677099408437',), 1374568357: ('0.14363677099408437',), 1374568345: ('0.14363677099408437',), 1374568334: ('0.14363677099408437',), 1374568326: ('0.14363677099408437',), 1374568324: ('0.14363677099408437',), 1374568320: ('0.14363677099408437',), 1374568317: ('0.14363677099408437',), 1374568308: ('0.14363677099408437',), 1374568307: ('0.14363677099408437',), 1374568306: ('0.14363677099408437',), 1374568304: ('0.14363677099408437',), 1374568299: ('0.14363677099408437',), 1374568262: ('0.14363677099408437',), 1374568261: ('0.14363677099408437',), 1374568259: ('0.14363677099408437',), 1374568258: ('0.14363677099408437',), 1374568255: ('0.14363677099408437',), 1374568252: ('0.14363677099408437',), 1374568225: ('0.14363677099408437',)} [1374568368, 1374568367, 1374568366, 1374568364, 1374568361, 1374568357, 1374568345, 1374568334, 1374568326, 1374568324, 1374568320, 1374568317, 1374568308, 1374568307, 1374568306, 1374568304, 1374568299, 1374568262, 1374568261, 1374568259, 1374568258, 1374568255, 1374568252, 1374568225] Looping around the photos to save general results len do output : 24 /1374568368.Didn't retrieve data . /1374568367.Didn't retrieve data . /1374568366.Didn't retrieve data . /1374568364.Didn't retrieve data . /1374568361.Didn't retrieve data . /1374568357.Didn't retrieve data . /1374568345.Didn't retrieve data . /1374568334.Didn't retrieve data . /1374568326.Didn't retrieve data . /1374568324.Didn't retrieve data . /1374568320.Didn't retrieve data . /1374568317.Didn't retrieve data . /1374568308.Didn't retrieve data . /1374568307.Didn't retrieve data . /1374568306.Didn't retrieve data . /1374568304.Didn't retrieve data . /1374568299.Didn't retrieve data . /1374568262.Didn't retrieve data . /1374568261.Didn't retrieve data . /1374568259.Didn't retrieve data . /1374568258.Didn't retrieve data . /1374568255.Didn't retrieve data . /1374568252.Didn't retrieve data . /1374568225.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568368', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568367', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568366', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568364', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568361', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568357', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568345', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568334', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568326', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568324', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568320', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568317', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568308', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568307', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568306', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568304', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568299', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568262', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568261', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568259', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568258', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568255', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568252', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568225', None, None, None, None, None, '3408610') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.017418622970581055 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12659287452697754 time spend to save output : 0.018533706665039062 total time spend for step 5 : 0.1451265811920166 step6:blur_detection Thu Jul 31 11:52:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1753955427_2436666_1374568368_6d83dba734c2b9fffd10daa1cde59e63.jpg resize: (1080, 1920) 1374568368 -2.2049223601133217 treat image : temp/1753955427_2436666_1374568367_6427090c1b1628a55b4f183045c74988.jpg resize: (1080, 1920) 1374568367 -1.6449544072872513 treat image : temp/1753955427_2436666_1374568366_4ca4c3bb514b5be376e5f9c3a99cf9e8.jpg resize: (1080, 1920) 1374568366 -2.2857906163953667 treat image : temp/1753955427_2436666_1374568364_e3bf2a419e939b8ccf475f1ad307bf61.jpg resize: (1080, 1920) 1374568364 -2.316148521883746 treat image : temp/1753955427_2436666_1374568361_147aa32695db7c4033e8b36f752e0b48.jpg resize: (1080, 1920) 1374568361 -2.775507418886225 treat image : temp/1753955427_2436666_1374568357_1f5e661a9ab12360bbf9c49baab4b79d.jpg resize: (1080, 1920) 1374568357 -2.4582478492380337 treat image : temp/1753955427_2436666_1374568345_bddf134071376c3d1df51d1898648361.jpg resize: (1080, 1920) 1374568345 -1.693200284639881 treat image : temp/1753955427_2436666_1374568334_f6520716ce98efeb28782d616fe9a06a.jpg resize: (1080, 1920) 1374568334 -2.5542210250691517 treat image : temp/1753955427_2436666_1374568326_073bd397f186ca3e19dbea809cda64ab.jpg resize: (1080, 1920) 1374568326 -2.2691698548136023 treat image : temp/1753955427_2436666_1374568324_2ced5bdf3799ea8e47fe1470f77012ed.jpg resize: (1080, 1920) 1374568324 -2.6931379522236334 treat image : temp/1753955427_2436666_1374568320_be58b5b26762c9aae7278ec6d6699b52.jpg resize: (1080, 1920) 1374568320 -1.4990965213293093 treat image : temp/1753955427_2436666_1374568317_3e2f13dc516cfeae649819bb73e9786e.jpg resize: (1080, 1920) 1374568317 -2.361538697203884 treat image : temp/1753955427_2436666_1374568308_37f8a169fd72279df39a8801f2d36371.jpg resize: (1080, 1920) 1374568308 -2.681490947461662 treat image : temp/1753955427_2436666_1374568307_75b72e0d8ca1427fa27e5c2cb32e7260.jpg resize: (1080, 1920) 1374568307 -1.7676585485357876 treat image : temp/1753955427_2436666_1374568306_d8122af7d7306b8922dc239081c4aebf.jpg resize: (1080, 1920) 1374568306 -2.3955387076088392 treat image : temp/1753955427_2436666_1374568304_bdca2a082af1ef4323b4310173a0485b.jpg resize: (1080, 1920) 1374568304 -4.535261240554171 treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94.jpg resize: (1080, 1920) 1374568299 -2.439644782928829 treat image : temp/1753955427_2436666_1374568262_d5940e95f9e1e2e68b739037f3a013cd.jpg resize: (1080, 1920) 1374568262 -3.1294149559611046 treat image : temp/1753955427_2436666_1374568261_af503978d2a2c8056463f8ced695a798.jpg resize: (1080, 1920) 1374568261 -2.518733668564176 treat image : temp/1753955427_2436666_1374568259_e4d39a22e2c35270cf91502582064913.jpg resize: (1080, 1920) 1374568259 1.1407422770763647 treat image : temp/1753955427_2436666_1374568258_624154f0743ce3c40e9125f453ad0776.jpg resize: (1080, 1920) 1374568258 -2.3793009330507044 treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356.jpg resize: (1080, 1920) 1374568255 -2.0216820028799822 treat image : temp/1753955427_2436666_1374568252_e1c1ad886650a5fa72ef5d7bc2499704.jpg resize: (1080, 1920) 1374568252 -2.538941200303783 treat image : temp/1753955427_2436666_1374568225_ddfe681534d978307b569d92e5a53bd0.jpg resize: (1080, 1920) 1374568225 -0.7664478522454041 treat image : temp/1753955427_2436666_1374568357_1f5e661a9ab12360bbf9c49baab4b79d_rle_crop_3899150959_0.png resize: (174, 84) 1374578175 -1.8825798928643878 treat image : temp/1753955427_2436666_1374568334_f6520716ce98efeb28782d616fe9a06a_rle_crop_3899150963_0.png resize: (182, 115) 1374578176 -2.0509046662112533 treat image : temp/1753955427_2436666_1374568308_37f8a169fd72279df39a8801f2d36371_rle_crop_3899150969_0.png resize: (151, 85) 1374578177 -2.564209946938125 treat image : temp/1753955427_2436666_1374568307_75b72e0d8ca1427fa27e5c2cb32e7260_rle_crop_3899150972_0.png resize: (84, 60) 1374578178 -1.2727327729464617 treat image : temp/1753955427_2436666_1374568304_bdca2a082af1ef4323b4310173a0485b_rle_crop_3899150974_0.png resize: (66, 71) 1374578179 -5.3751849691663045 treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150978_0.png resize: (118, 115) 1374578180 -1.3575460111215258 treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150975_0.png resize: (48, 137) 1374578181 -2.469740889549679 treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150976_0.png resize: (41, 55) 1374578182 0.23390363735781902 treat image : temp/1753955427_2436666_1374568262_d5940e95f9e1e2e68b739037f3a013cd_rle_crop_3899150981_0.png resize: (210, 89) 1374578183 -1.3379473405000897 treat image : temp/1753955427_2436666_1374568334_f6520716ce98efeb28782d616fe9a06a_rle_crop_3899150964_0.png resize: (116, 114) 1374578185 -0.9968431846014055 treat image : temp/1753955427_2436666_1374568262_d5940e95f9e1e2e68b739037f3a013cd_rle_crop_3899150980_0.png resize: (91, 89) 1374578186 -2.1219388284106993 treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356_rle_crop_3899150985_0.png resize: (119, 142) 1374578187 -0.06815479856760218 treat image : temp/1753955427_2436666_1374568368_6d83dba734c2b9fffd10daa1cde59e63_rle_crop_3899150953_0.png resize: (46, 51) 1374578209 -0.05606452523805224 treat image : temp/1753955427_2436666_1374568367_6427090c1b1628a55b4f183045c74988_rle_crop_3899150954_0.png resize: (912, 954) 1374578210 0.5725278576591147 treat image : temp/1753955427_2436666_1374568366_4ca4c3bb514b5be376e5f9c3a99cf9e8_rle_crop_3899150955_0.png resize: (536, 362) 1374578211 -0.5811577566644912 treat image : temp/1753955427_2436666_1374568364_e3bf2a419e939b8ccf475f1ad307bf61_rle_crop_3899150956_0.png resize: (936, 1035) 1374578212 0.24423828486795718 treat image : temp/1753955427_2436666_1374568361_147aa32695db7c4033e8b36f752e0b48_rle_crop_3899150957_0.png resize: (209, 143) 1374578213 -2.576791521238627 treat image : temp/1753955427_2436666_1374568357_1f5e661a9ab12360bbf9c49baab4b79d_rle_crop_3899150960_0.png resize: (420, 1110) 1374578215 -4.3726836755767335 treat image : temp/1753955427_2436666_1374568345_bddf134071376c3d1df51d1898648361_rle_crop_3899150961_0.png resize: (87, 92) 1374578216 -2.5038364310546073 treat image : temp/1753955427_2436666_1374568345_bddf134071376c3d1df51d1898648361_rle_crop_3899150962_0.png resize: (176, 226) 1374578217 -1.3203599505086954 treat image : temp/1753955427_2436666_1374568334_f6520716ce98efeb28782d616fe9a06a_rle_crop_3899150965_0.png resize: (106, 158) 1374578218 -2.116732379779906 treat image : temp/1753955427_2436666_1374568326_073bd397f186ca3e19dbea809cda64ab_rle_crop_3899150966_0.png resize: (122, 107) 1374578219 -3.1963141613605046 treat image : temp/1753955427_2436666_1374568324_2ced5bdf3799ea8e47fe1470f77012ed_rle_crop_3899150968_0.png resize: (95, 92) 1374578220 -5.527688486985872 treat image : temp/1753955427_2436666_1374568324_2ced5bdf3799ea8e47fe1470f77012ed_rle_crop_3899150967_0.png resize: (535, 368) 1374578221 0.1977012827094729 treat image : temp/1753955427_2436666_1374568308_37f8a169fd72279df39a8801f2d36371_rle_crop_3899150970_0.png resize: (985, 1026) 1374578223 -0.09977962232150588 treat image : temp/1753955427_2436666_1374568307_75b72e0d8ca1427fa27e5c2cb32e7260_rle_crop_3899150971_0.png resize: (944, 1022) 1374578224 0.09271557153637 treat image : temp/1753955427_2436666_1374568306_d8122af7d7306b8922dc239081c4aebf_rle_crop_3899150973_0.png resize: (193, 152) 1374578225 -2.3603559895219957 treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150977_0.png resize: (982, 1266) 1374578226 -1.6017510285509504 treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150979_0.png resize: (506, 305) 1374578227 -0.3044861726378535 treat image : temp/1753955427_2436666_1374568261_af503978d2a2c8056463f8ced695a798_rle_crop_3899150982_0.png resize: (968, 953) 1374578228 -0.18865035479612305 treat image : temp/1753955427_2436666_1374568258_624154f0743ce3c40e9125f453ad0776_rle_crop_3899150984_0.png resize: (952, 933) 1374578229 0.33415751849262143 treat image : temp/1753955427_2436666_1374568258_624154f0743ce3c40e9125f453ad0776_rle_crop_3899150983_0.png resize: (132, 75) 1374578230 -0.8117090896232413 treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356_rle_crop_3899150988_0.png resize: (978, 1032) 1374578231 -0.18730889616942611 treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356_rle_crop_3899150986_0.png resize: (73, 125) 1374578232 -3.1622221383486204 treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356_rle_crop_3899150987_0.png resize: (504, 344) 1374578233 -0.30502354558737615 treat image : temp/1753955427_2436666_1374568252_e1c1ad886650a5fa72ef5d7bc2499704_rle_crop_3899150989_0.png resize: (987, 1061) 1374578234 -0.5895405143380599 treat image : temp/1753955427_2436666_1374568252_e1c1ad886650a5fa72ef5d7bc2499704_rle_crop_3899150991_0.png resize: (108, 153) 1374578235 -1.0100543029132496 treat image : temp/1753955427_2436666_1374568252_e1c1ad886650a5fa72ef5d7bc2499704_rle_crop_3899150990_0.png resize: (179, 133) 1374578236 -2.6715956617698664 treat image : temp/1753955427_2436666_1374568225_ddfe681534d978307b569d92e5a53bd0_rle_crop_3899150993_0.png resize: (113, 89) 1374578237 -0.9835536626293278 treat image : temp/1753955427_2436666_1374568225_ddfe681534d978307b569d92e5a53bd0_rle_crop_3899150992_0.png resize: (231, 185) 1374578238 -1.2889932922813454 treat image : temp/1753955427_2436666_1374568357_1f5e661a9ab12360bbf9c49baab4b79d_rle_crop_3899150958_0.png resize: (61, 66) 1374578243 0.158931034205425 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 65 time used for this insertion : 0.017588376998901367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 65 time used for this insertion : 0.01939845085144043 save missing photos in datou_result : time spend for datou_step_exec : 22.357277631759644 time spend to save output : 0.04156327247619629 total time spend for step 6 : 22.39884090423584 step7:brightness Thu Jul 31 11:52:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1753955427_2436666_1374568368_6d83dba734c2b9fffd10daa1cde59e63.jpg treat image : temp/1753955427_2436666_1374568367_6427090c1b1628a55b4f183045c74988.jpg treat image : temp/1753955427_2436666_1374568366_4ca4c3bb514b5be376e5f9c3a99cf9e8.jpg treat image : temp/1753955427_2436666_1374568364_e3bf2a419e939b8ccf475f1ad307bf61.jpg treat image : temp/1753955427_2436666_1374568361_147aa32695db7c4033e8b36f752e0b48.jpg treat image : temp/1753955427_2436666_1374568357_1f5e661a9ab12360bbf9c49baab4b79d.jpg treat image : temp/1753955427_2436666_1374568345_bddf134071376c3d1df51d1898648361.jpg treat image : temp/1753955427_2436666_1374568334_f6520716ce98efeb28782d616fe9a06a.jpg treat image : temp/1753955427_2436666_1374568326_073bd397f186ca3e19dbea809cda64ab.jpg treat image : temp/1753955427_2436666_1374568324_2ced5bdf3799ea8e47fe1470f77012ed.jpg treat image : temp/1753955427_2436666_1374568320_be58b5b26762c9aae7278ec6d6699b52.jpg treat image : temp/1753955427_2436666_1374568317_3e2f13dc516cfeae649819bb73e9786e.jpg treat image : temp/1753955427_2436666_1374568308_37f8a169fd72279df39a8801f2d36371.jpg treat image : temp/1753955427_2436666_1374568307_75b72e0d8ca1427fa27e5c2cb32e7260.jpg treat image : temp/1753955427_2436666_1374568306_d8122af7d7306b8922dc239081c4aebf.jpg treat image : temp/1753955427_2436666_1374568304_bdca2a082af1ef4323b4310173a0485b.jpg treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94.jpg treat image : temp/1753955427_2436666_1374568262_d5940e95f9e1e2e68b739037f3a013cd.jpg treat image : temp/1753955427_2436666_1374568261_af503978d2a2c8056463f8ced695a798.jpg treat image : temp/1753955427_2436666_1374568259_e4d39a22e2c35270cf91502582064913.jpg treat image : temp/1753955427_2436666_1374568258_624154f0743ce3c40e9125f453ad0776.jpg treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356.jpg treat image : temp/1753955427_2436666_1374568252_e1c1ad886650a5fa72ef5d7bc2499704.jpg treat image : temp/1753955427_2436666_1374568225_ddfe681534d978307b569d92e5a53bd0.jpg treat image : temp/1753955427_2436666_1374568357_1f5e661a9ab12360bbf9c49baab4b79d_rle_crop_3899150959_0.png treat image : temp/1753955427_2436666_1374568334_f6520716ce98efeb28782d616fe9a06a_rle_crop_3899150963_0.png treat image : temp/1753955427_2436666_1374568308_37f8a169fd72279df39a8801f2d36371_rle_crop_3899150969_0.png treat image : temp/1753955427_2436666_1374568307_75b72e0d8ca1427fa27e5c2cb32e7260_rle_crop_3899150972_0.png treat image : temp/1753955427_2436666_1374568304_bdca2a082af1ef4323b4310173a0485b_rle_crop_3899150974_0.png treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150978_0.png treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150975_0.png treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150976_0.png treat image : temp/1753955427_2436666_1374568262_d5940e95f9e1e2e68b739037f3a013cd_rle_crop_3899150981_0.png treat image : temp/1753955427_2436666_1374568334_f6520716ce98efeb28782d616fe9a06a_rle_crop_3899150964_0.png treat image : temp/1753955427_2436666_1374568262_d5940e95f9e1e2e68b739037f3a013cd_rle_crop_3899150980_0.png treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356_rle_crop_3899150985_0.png treat image : temp/1753955427_2436666_1374568368_6d83dba734c2b9fffd10daa1cde59e63_rle_crop_3899150953_0.png treat image : temp/1753955427_2436666_1374568367_6427090c1b1628a55b4f183045c74988_rle_crop_3899150954_0.png treat image : temp/1753955427_2436666_1374568366_4ca4c3bb514b5be376e5f9c3a99cf9e8_rle_crop_3899150955_0.png treat image : temp/1753955427_2436666_1374568364_e3bf2a419e939b8ccf475f1ad307bf61_rle_crop_3899150956_0.png treat image : temp/1753955427_2436666_1374568361_147aa32695db7c4033e8b36f752e0b48_rle_crop_3899150957_0.png treat image : temp/1753955427_2436666_1374568357_1f5e661a9ab12360bbf9c49baab4b79d_rle_crop_3899150960_0.png treat image : temp/1753955427_2436666_1374568345_bddf134071376c3d1df51d1898648361_rle_crop_3899150961_0.png treat image : temp/1753955427_2436666_1374568345_bddf134071376c3d1df51d1898648361_rle_crop_3899150962_0.png treat image : temp/1753955427_2436666_1374568334_f6520716ce98efeb28782d616fe9a06a_rle_crop_3899150965_0.png treat image : temp/1753955427_2436666_1374568326_073bd397f186ca3e19dbea809cda64ab_rle_crop_3899150966_0.png treat image : temp/1753955427_2436666_1374568324_2ced5bdf3799ea8e47fe1470f77012ed_rle_crop_3899150968_0.png treat image : temp/1753955427_2436666_1374568324_2ced5bdf3799ea8e47fe1470f77012ed_rle_crop_3899150967_0.png treat image : temp/1753955427_2436666_1374568308_37f8a169fd72279df39a8801f2d36371_rle_crop_3899150970_0.png treat image : temp/1753955427_2436666_1374568307_75b72e0d8ca1427fa27e5c2cb32e7260_rle_crop_3899150971_0.png treat image : temp/1753955427_2436666_1374568306_d8122af7d7306b8922dc239081c4aebf_rle_crop_3899150973_0.png treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150977_0.png treat image : temp/1753955427_2436666_1374568299_cc53a5eb14b60186a57848e590201f94_rle_crop_3899150979_0.png treat image : temp/1753955427_2436666_1374568261_af503978d2a2c8056463f8ced695a798_rle_crop_3899150982_0.png treat image : temp/1753955427_2436666_1374568258_624154f0743ce3c40e9125f453ad0776_rle_crop_3899150984_0.png treat image : temp/1753955427_2436666_1374568258_624154f0743ce3c40e9125f453ad0776_rle_crop_3899150983_0.png treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356_rle_crop_3899150988_0.png treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356_rle_crop_3899150986_0.png treat image : temp/1753955427_2436666_1374568255_91f09c1221820b09b3f30cdd3699e356_rle_crop_3899150987_0.png treat image : temp/1753955427_2436666_1374568252_e1c1ad886650a5fa72ef5d7bc2499704_rle_crop_3899150989_0.png treat image : temp/1753955427_2436666_1374568252_e1c1ad886650a5fa72ef5d7bc2499704_rle_crop_3899150991_0.png treat image : temp/1753955427_2436666_1374568252_e1c1ad886650a5fa72ef5d7bc2499704_rle_crop_3899150990_0.png treat image : temp/1753955427_2436666_1374568225_ddfe681534d978307b569d92e5a53bd0_rle_crop_3899150993_0.png treat image : temp/1753955427_2436666_1374568225_ddfe681534d978307b569d92e5a53bd0_rle_crop_3899150992_0.png treat image : temp/1753955427_2436666_1374568357_1f5e661a9ab12360bbf9c49baab4b79d_rle_crop_3899150958_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 65 time used for this insertion : 0.014935970306396484 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 65 time used for this insertion : 0.015101194381713867 save missing photos in datou_result : time spend for datou_step_exec : 6.284168004989624 time spend to save output : 0.03472614288330078 total time spend for step 7 : 6.318894147872925 step8:velours_tree Thu Jul 31 11:52:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08216524124145508 time spend to save output : 3.3855438232421875e-05 total time spend for step 8 : 0.0821990966796875 step9:send_mail_cod Thu Jul 31 11:52:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25537193_31-07-2025_11_52_37.pdf 25537890 imagette255378901753955557 25537891 imagette255378911753955557 25537892 imagette255378921753955557 25537893 change filename to text .change filename to text .change filename to text .imagette255378931753955557 25537894 imagette255378941753955558 25537896 imagette255378961753955558 25537897 change filename to text .imagette255378971753955558 25537898 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette255378981753955558 25537899 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette255378991753955558 25537900 imagette255379001753955560 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25537193 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25537890,25537891,25537892,25537893,25537894,25537895,25537896,25537897,25537898,25537899,25537900?tags=flou,pehd,background,carton,metal,environnement,pet_fonce,autre,papier,pet_clair,mal_croppe args[1374568368] : ((1374568368, -2.2049223601133217, 492609224), (1374568368, 0.46894693902388357, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568367] : ((1374568367, -1.6449544072872513, 492688767), (1374568367, 0.5038126121425491, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568366] : ((1374568366, -2.2857906163953667, 492609224), (1374568366, 0.4649930692809077, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568364] : ((1374568364, -2.316148521883746, 492609224), (1374568364, 0.471256902671915, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568361] : ((1374568361, -2.775507418886225, 492609224), (1374568361, 0.4260902563906776, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568357] : ((1374568357, -2.4582478492380337, 492609224), (1374568357, 0.4816739578683957, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568345] : ((1374568345, -1.693200284639881, 492688767), (1374568345, 0.3264439460989924, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568334] : ((1374568334, -2.5542210250691517, 492609224), (1374568334, 0.3822882630668186, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568326] : ((1374568326, -2.2691698548136023, 492609224), (1374568326, 0.3808558062900621, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568324] : ((1374568324, -2.6931379522236334, 492609224), (1374568324, 0.547057238887637, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568320] : ((1374568320, -1.4990965213293093, 492688767), (1374568320, 0.7141989820813819, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568317] : ((1374568317, -2.361538697203884, 492609224), (1374568317, 0.7329016217812432, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568308] : ((1374568308, -2.681490947461662, 492609224), (1374568308, 0.40470388775802674, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568307] : ((1374568307, -1.7676585485357876, 492688767), (1374568307, 0.6989882087119221, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568306] : ((1374568306, -2.3955387076088392, 492609224), (1374568306, 0.5744812680768271, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568304] : ((1374568304, -4.535261240554171, 492609224), (1374568304, 0.4850728202128862, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568299] : ((1374568299, -2.439644782928829, 492609224), (1374568299, 0.3702577390332917, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568262] : ((1374568262, -3.1294149559611046, 492609224), (1374568262, 0.5797944278342843, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568261] : ((1374568261, -2.518733668564176, 492609224), (1374568261, 0.8058194370922291, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568259] : ((1374568259, 1.1407422770763647, 492688767), (1374568259, -1.2426367423274927, 501862349), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568258] : ((1374568258, -2.3793009330507044, 492609224), (1374568258, 0.4308058775947592, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568255] : ((1374568255, -2.0216820028799822, 492609224), (1374568255, 0.3756658405612423, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568252] : ((1374568252, -2.538941200303783, 492609224), (1374568252, 0.393707125860143, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com args[1374568225] : ((1374568225, -0.7664478522454041, 492688767), (1374568225, 0.5964850091761327, 2107752395), '0.14363677099408437') We are sending mail with results at report@fotonower.com refus_total : 0.14363677099408437 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25537193 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25537193_31-07-2025_11_52_37.pdf results_Auto_P25537193_31-07-2025_11_52_37.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25537193_31-07-2025_11_52_37.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25537193','results_Auto_P25537193_31-07-2025_11_52_37.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25537193_31-07-2025_11_52_37.pdf','pdf','','0.68','0.14363677099408437') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25537193

https://www.fotonower.com/image?json=false&list_photos_id=1374568368
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568367
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568366
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568364
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568361
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568357
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568345
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568334
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568326
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568324
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568320
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568317
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568308
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568307
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568306
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568304
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568299
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568262
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568261
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568259
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1407422770763647)
https://www.fotonower.com/image?json=false&list_photos_id=1374568258
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568255
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568252
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374568225
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.36%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/25537893?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25537897?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25537898?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25537899?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25537193_31-07-2025_11_52_37.pdf.

Lien vers velours :https://www.fotonower.com/velours/25537890,25537891,25537892,25537893,25537894,25537895,25537896,25537897,25537898,25537899,25537900?tags=flou,pehd,background,carton,metal,environnement,pet_fonce,autre,papier,pet_clair,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 31 Jul 2025 09:52:42 GMT Content-Length: 0 Connection: close X-Message-Id: MMqjNQK0Sr2nQ6US420gsA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1374568368, 1374568367, 1374568366, 1374568364, 1374568361, 1374568357, 1374568345, 1374568334, 1374568326, 1374568324, 1374568320, 1374568317, 1374568308, 1374568307, 1374568306, 1374568304, 1374568299, 1374568262, 1374568261, 1374568259, 1374568258, 1374568255, 1374568252, 1374568225] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568368', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568367', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568366', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568364', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568361', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568357', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568345', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568334', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568326', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568324', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568320', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568317', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568308', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568307', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568306', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568304', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568299', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568262', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568261', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568259', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568258', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568255', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568252', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568225', None, None, None, None, None, '3408610') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01962447166442871 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.913646221160889 time spend to save output : 0.019907474517822266 total time spend for step 9 : 4.933553695678711 step10:split_time_score Thu Jul 31 11:52:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 24),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 31072025 25537193 Nombre de photos uploadées : 24 / 23040 (0%) 31072025 25537193 Nombre de photos taguées (types de déchets): 0 / 24 (0%) 31072025 25537193 Nombre de photos taguées (volume) : 0 / 24 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ???????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0010695457458496094 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22043132781982422 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1288892103909465 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25530216_31-07-2025_08_21_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25530216 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25530216 AND mptpi.`type`=3594 To do Qualite : 0.0400941679526749 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25532093_31-07-2025_09_51_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25532093 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25532093 AND mptpi.`type`=3594 To do Qualite : 0.017316454475308645 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25532109_31-07-2025_09_41_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25532109 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25532109 AND mptpi.`type`=3594 To do Qualite : 0.045261622299382735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25532112_31-07-2025_09_31_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25532112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25532112 AND mptpi.`type`=3594 To do Qualite : 0.10603395061728398 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25537191_31-07-2025_11_41_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25537191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25537191 AND mptpi.`type`=3594 To do Qualite : 0.14363677099408437 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25537193_31-07-2025_11_52_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25537193 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25537193 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'31072025': {'nb_upload': 24, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1374568368, 1374568367, 1374568366, 1374568364, 1374568361, 1374568357, 1374568345, 1374568334, 1374568326, 1374568324, 1374568320, 1374568317, 1374568308, 1374568307, 1374568306, 1374568304, 1374568299, 1374568262, 1374568261, 1374568259, 1374568258, 1374568255, 1374568252, 1374568225] Looping around the photos to save general results len do output : 1 /25537193Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568368', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568367', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568366', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568364', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568361', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568357', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568345', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568334', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568326', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568324', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568320', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568317', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568308', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568307', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568306', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568304', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568299', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568262', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568261', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568259', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568258', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568255', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568252', None, None, None, None, None, '3408610') ('3318', None, None, None, None, None, None, None, '3408610') ('3318', '25537193', '1374568225', None, None, None, None, None, '3408610') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.015580415725708008 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7470519542694092 time spend to save output : 0.015875816345214844 total time spend for step 10 : 0.762927770614624 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 24 set_done_treatment 86.82user 36.75system 2:19.18elapsed 88%CPU (0avgtext+0avgdata 2903092maxresident)k 784inputs+54744outputs (1major+2295939minor)pagefaults 0swaps