python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3351246 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3713624'] with mtr_portfolio_ids : ['26801185'] and first list_photo_ids : [] new path : /proc/3351246/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.9685778617858887 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Sep 12 17:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10591 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-12 17:40:33.668003: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-12 17:40:33.677704: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-12 17:40:33.679256: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f295c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-12 17:40:33.679306: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-12 17:40:33.681896: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-12 17:40:33.837074: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3248c140 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-12 17:40:33.837122: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-12 17:40:33.838642: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 17:40:33.839064: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 17:40:33.842155: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 17:40:33.844747: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 17:40:33.845138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 17:40:33.848009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 17:40:33.849347: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 17:40:33.854716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 17:40:33.856224: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 17:40:33.856302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 17:40:33.857122: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-12 17:40:33.857140: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-12 17:40:33.857150: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-12 17:40:33.858516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9811 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-12 17:40:34.139576: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 17:40:34.139678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 17:40:34.139703: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 17:40:34.139724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 17:40:34.139745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 17:40:34.139766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 17:40:34.139786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 17:40:34.139807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 17:40:34.141474: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 17:40:34.143060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 17:40:34.143131: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 17:40:34.143151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 17:40:34.143168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 17:40:34.143185: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 17:40:34.143202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 17:40:34.143219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 17:40:34.143237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 17:40:34.144882: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 17:40:34.144926: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-12 17:40:34.144939: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-12 17:40:34.144949: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-12 17:40:34.146438: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9811 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-12 17:40:44.773148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 17:40:44.951364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 17:40:46.642909: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:46.643554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:46.644320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:46.644979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:46.645595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:46.646297: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:46.969905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:46.970358: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-09-12 17:40:47.038099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.038184: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.040001: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.040035: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.042895: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.042933: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.044006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.044035: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.070664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.070701: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 564.38MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.071249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.071264: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 564.38MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.072773: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.072793: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 290.15MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.073360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.073376: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 290.15MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.078750: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.078772: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.079320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.079334: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-12 17:40:47.081292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.081842: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.088300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.088914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.090526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.091127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.118352: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.119011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.119588: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.120135: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.123905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.124483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.141088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.141649: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.142200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.142748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.156841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.157397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.157943: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.158488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.162717: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.163409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.167898: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.168475: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.181499: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.182055: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.186122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.186691: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.187241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.187789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.188556: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.189151: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.199850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.200420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.200986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.201533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.202079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.202626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.203174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.203720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.214268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.214925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.222572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.223129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.254994: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.255057: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-12 17:40:47.256224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.257150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.264687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.265465: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.266097: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.266682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.275067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.275681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.294606: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.295368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.296100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.296847: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.301727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.302282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.302831: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.303378: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.304398: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.314509: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.315187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.324811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.325409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.325995: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.326580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.327173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-12 17:40:47.327761: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 Detection mask done ! Trying to reset tf kernel 3351789 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5615 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6808 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006461143493652344 nb_pixel_total : 26285 time to create 1 rle with old method : 0.030844926834106445 length of segment : 166 time for calcul the mask position with numpy : 0.00380706787109375 nb_pixel_total : 102104 time to create 1 rle with old method : 0.1506364345550537 length of segment : 287 time for calcul the mask position with numpy : 0.0009448528289794922 nb_pixel_total : 20579 time to create 1 rle with old method : 0.02525186538696289 length of segment : 216 time for calcul the mask position with numpy : 0.0004887580871582031 nb_pixel_total : 16307 time to create 1 rle with old method : 0.020299911499023438 length of segment : 189 time for calcul the mask position with numpy : 0.0012803077697753906 nb_pixel_total : 70695 time to create 1 rle with old method : 0.08700203895568848 length of segment : 338 time for calcul the mask position with numpy : 0.006910562515258789 nb_pixel_total : 188407 time to create 1 rle with new method : 0.017131805419921875 length of segment : 653 time for calcul the mask position with numpy : 0.0009210109710693359 nb_pixel_total : 35206 time to create 1 rle with old method : 0.0417933464050293 length of segment : 275 time for calcul the mask position with numpy : 0.00037670135498046875 nb_pixel_total : 13579 time to create 1 rle with old method : 0.016177892684936523 length of segment : 157 time for calcul the mask position with numpy : 0.0005869865417480469 nb_pixel_total : 31030 time to create 1 rle with old method : 0.037029266357421875 length of segment : 205 time for calcul the mask position with numpy : 0.00021791458129882812 nb_pixel_total : 9583 time to create 1 rle with old method : 0.012550115585327148 length of segment : 90 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 13811 time to create 1 rle with old method : 0.016980648040771484 length of segment : 200 time for calcul the mask position with numpy : 0.0005202293395996094 nb_pixel_total : 17014 time to create 1 rle with old method : 0.021116971969604492 length of segment : 173 time for calcul the mask position with numpy : 0.0009300708770751953 nb_pixel_total : 28316 time to create 1 rle with old method : 0.03464245796203613 length of segment : 253 time for calcul the mask position with numpy : 0.0003020763397216797 nb_pixel_total : 8662 time to create 1 rle with old method : 0.010558605194091797 length of segment : 153 time for calcul the mask position with numpy : 0.0007755756378173828 nb_pixel_total : 20350 time to create 1 rle with old method : 0.025728940963745117 length of segment : 123 time for calcul the mask position with numpy : 0.003587961196899414 nb_pixel_total : 113604 time to create 1 rle with old method : 0.13503146171569824 length of segment : 442 time for calcul the mask position with numpy : 0.0016248226165771484 nb_pixel_total : 41972 time to create 1 rle with old method : 0.05047106742858887 length of segment : 314 time for calcul the mask position with numpy : 0.0011944770812988281 nb_pixel_total : 20542 time to create 1 rle with old method : 0.030177831649780273 length of segment : 118 time for calcul the mask position with numpy : 0.004715442657470703 nb_pixel_total : 130235 time to create 1 rle with old method : 0.14454913139343262 length of segment : 544 time for calcul the mask position with numpy : 0.00258636474609375 nb_pixel_total : 85270 time to create 1 rle with old method : 0.09821891784667969 length of segment : 644 time for calcul the mask position with numpy : 0.0018243789672851562 nb_pixel_total : 103201 time to create 1 rle with old method : 0.11769485473632812 length of segment : 384 time for calcul the mask position with numpy : 0.0006008148193359375 nb_pixel_total : 29312 time to create 1 rle with old method : 0.03553032875061035 length of segment : 203 time for calcul the mask position with numpy : 0.0009007453918457031 nb_pixel_total : 22234 time to create 1 rle with old method : 0.02561354637145996 length of segment : 242 time for calcul the mask position with numpy : 0.0014040470123291016 nb_pixel_total : 29636 time to create 1 rle with old method : 0.03468942642211914 length of segment : 228 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 16988 time to create 1 rle with old method : 0.02036118507385254 length of segment : 147 time for calcul the mask position with numpy : 0.01815509796142578 nb_pixel_total : 320918 time to create 1 rle with new method : 0.040090322494506836 length of segment : 752 time for calcul the mask position with numpy : 0.0008101463317871094 nb_pixel_total : 37537 time to create 1 rle with old method : 0.04450559616088867 length of segment : 329 time for calcul the mask position with numpy : 0.0004086494445800781 nb_pixel_total : 10778 time to create 1 rle with old method : 0.013231277465820312 length of segment : 121 time for calcul the mask position with numpy : 0.0015232563018798828 nb_pixel_total : 57529 time to create 1 rle with old method : 0.06866192817687988 length of segment : 565 time for calcul the mask position with numpy : 0.0002593994140625 nb_pixel_total : 12257 time to create 1 rle with old method : 0.014564275741577148 length of segment : 87 time for calcul the mask position with numpy : 0.0012857913970947266 nb_pixel_total : 42704 time to create 1 rle with old method : 0.04982757568359375 length of segment : 330 time for calcul the mask position with numpy : 0.0002791881561279297 nb_pixel_total : 15121 time to create 1 rle with old method : 0.01766800880432129 length of segment : 115 time for calcul the mask position with numpy : 0.0004482269287109375 nb_pixel_total : 28402 time to create 1 rle with old method : 0.03460192680358887 length of segment : 172 time for calcul the mask position with numpy : 0.0008957386016845703 nb_pixel_total : 26304 time to create 1 rle with old method : 0.031065940856933594 length of segment : 188 time for calcul the mask position with numpy : 0.0019125938415527344 nb_pixel_total : 107438 time to create 1 rle with old method : 0.12871527671813965 length of segment : 469 time for calcul the mask position with numpy : 0.000331878662109375 nb_pixel_total : 17515 time to create 1 rle with old method : 0.020833969116210938 length of segment : 105 time for calcul the mask position with numpy : 0.00031304359436035156 nb_pixel_total : 18587 time to create 1 rle with old method : 0.02163243293762207 length of segment : 135 time for calcul the mask position with numpy : 0.0008533000946044922 nb_pixel_total : 47007 time to create 1 rle with old method : 0.05248284339904785 length of segment : 263 time for calcul the mask position with numpy : 0.004050731658935547 nb_pixel_total : 238683 time to create 1 rle with new method : 0.015628576278686523 length of segment : 513 time for calcul the mask position with numpy : 0.00027108192443847656 nb_pixel_total : 9280 time to create 1 rle with old method : 0.010564565658569336 length of segment : 139 time for calcul the mask position with numpy : 0.0004553794860839844 nb_pixel_total : 25583 time to create 1 rle with old method : 0.028844356536865234 length of segment : 155 time for calcul the mask position with numpy : 0.0008037090301513672 nb_pixel_total : 50942 time to create 1 rle with old method : 0.056342363357543945 length of segment : 330 time for calcul the mask position with numpy : 0.0010440349578857422 nb_pixel_total : 35618 time to create 1 rle with old method : 0.03904151916503906 length of segment : 247 time for calcul the mask position with numpy : 0.0009160041809082031 nb_pixel_total : 18702 time to create 1 rle with old method : 0.021540403366088867 length of segment : 410 time for calcul the mask position with numpy : 0.00045418739318847656 nb_pixel_total : 28765 time to create 1 rle with old method : 0.03224992752075195 length of segment : 151 time for calcul the mask position with numpy : 0.0005807876586914062 nb_pixel_total : 37346 time to create 1 rle with old method : 0.041481733322143555 length of segment : 253 time for calcul the mask position with numpy : 0.0003757476806640625 nb_pixel_total : 26619 time to create 1 rle with old method : 0.030330181121826172 length of segment : 217 time for calcul the mask position with numpy : 0.0015256404876708984 nb_pixel_total : 102428 time to create 1 rle with old method : 0.1135721206665039 length of segment : 910 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 22480 time to create 1 rle with old method : 0.025451183319091797 length of segment : 191 time for calcul the mask position with numpy : 0.0029449462890625 nb_pixel_total : 198540 time to create 1 rle with new method : 0.009722709655761719 length of segment : 611 time for calcul the mask position with numpy : 0.0002079010009765625 nb_pixel_total : 8022 time to create 1 rle with old method : 0.008982658386230469 length of segment : 172 time for calcul the mask position with numpy : 0.0012423992156982422 nb_pixel_total : 75464 time to create 1 rle with old method : 0.0830986499786377 length of segment : 430 time for calcul the mask position with numpy : 0.0013892650604248047 nb_pixel_total : 28229 time to create 1 rle with old method : 0.03231692314147949 length of segment : 287 time for calcul the mask position with numpy : 0.0006299018859863281 nb_pixel_total : 44242 time to create 1 rle with old method : 0.047971248626708984 length of segment : 250 time for calcul the mask position with numpy : 0.0029811859130859375 nb_pixel_total : 148323 time to create 1 rle with old method : 0.1623368263244629 length of segment : 531 time for calcul the mask position with numpy : 0.006591320037841797 nb_pixel_total : 151077 time to create 1 rle with new method : 0.012167930603027344 length of segment : 503 time for calcul the mask position with numpy : 0.0016777515411376953 nb_pixel_total : 25609 time to create 1 rle with old method : 0.028674840927124023 length of segment : 223 time for calcul the mask position with numpy : 0.0028676986694335938 nb_pixel_total : 82188 time to create 1 rle with old method : 0.09127306938171387 length of segment : 258 time for calcul the mask position with numpy : 0.0016083717346191406 nb_pixel_total : 39266 time to create 1 rle with old method : 0.044030189514160156 length of segment : 182 time for calcul the mask position with numpy : 0.0021436214447021484 nb_pixel_total : 47737 time to create 1 rle with old method : 0.0522768497467041 length of segment : 263 time for calcul the mask position with numpy : 0.00531768798828125 nb_pixel_total : 83081 time to create 1 rle with old method : 0.0930328369140625 length of segment : 556 time for calcul the mask position with numpy : 0.0028395652770996094 nb_pixel_total : 74436 time to create 1 rle with old method : 0.08460688591003418 length of segment : 499 time for calcul the mask position with numpy : 0.0014307498931884766 nb_pixel_total : 28250 time to create 1 rle with old method : 0.03219890594482422 length of segment : 170 time for calcul the mask position with numpy : 0.0017740726470947266 nb_pixel_total : 28349 time to create 1 rle with old method : 0.032320261001586914 length of segment : 199 time for calcul the mask position with numpy : 0.0016639232635498047 nb_pixel_total : 33004 time to create 1 rle with old method : 0.03589606285095215 length of segment : 314 time for calcul the mask position with numpy : 0.005391836166381836 nb_pixel_total : 84259 time to create 1 rle with old method : 0.09363198280334473 length of segment : 437 time for calcul the mask position with numpy : 0.0014133453369140625 nb_pixel_total : 27236 time to create 1 rle with old method : 0.031036853790283203 length of segment : 149 time for calcul the mask position with numpy : 0.004393577575683594 nb_pixel_total : 62267 time to create 1 rle with old method : 0.06939244270324707 length of segment : 338 time for calcul the mask position with numpy : 0.001280069351196289 nb_pixel_total : 9993 time to create 1 rle with old method : 0.01155543327331543 length of segment : 257 time for calcul the mask position with numpy : 0.0026001930236816406 nb_pixel_total : 77836 time to create 1 rle with old method : 0.08926200866699219 length of segment : 243 time for calcul the mask position with numpy : 0.0011262893676757812 nb_pixel_total : 16068 time to create 1 rle with old method : 0.018991708755493164 length of segment : 166 time for calcul the mask position with numpy : 0.002251863479614258 nb_pixel_total : 39340 time to create 1 rle with old method : 0.045633792877197266 length of segment : 272 time for calcul the mask position with numpy : 0.0033490657806396484 nb_pixel_total : 56173 time to create 1 rle with old method : 0.06457829475402832 length of segment : 271 time for calcul the mask position with numpy : 0.0019135475158691406 nb_pixel_total : 29098 time to create 1 rle with old method : 0.03384852409362793 length of segment : 198 time for calcul the mask position with numpy : 0.0025644302368164062 nb_pixel_total : 61603 time to create 1 rle with old method : 0.07125449180603027 length of segment : 429 time for calcul the mask position with numpy : 0.0008571147918701172 nb_pixel_total : 9337 time to create 1 rle with old method : 0.010857582092285156 length of segment : 149 time for calcul the mask position with numpy : 0.0011487007141113281 nb_pixel_total : 20953 time to create 1 rle with old method : 0.034482717514038086 length of segment : 205 time for calcul the mask position with numpy : 0.0009458065032958984 nb_pixel_total : 11511 time to create 1 rle with old method : 0.02066659927368164 length of segment : 110 time for calcul the mask position with numpy : 0.0048296451568603516 nb_pixel_total : 69391 time to create 1 rle with old method : 0.09020018577575684 length of segment : 558 time for calcul the mask position with numpy : 0.0024526119232177734 nb_pixel_total : 50636 time to create 1 rle with old method : 0.05781888961791992 length of segment : 432 time for calcul the mask position with numpy : 0.0017757415771484375 nb_pixel_total : 48156 time to create 1 rle with old method : 0.0603482723236084 length of segment : 265 time for calcul the mask position with numpy : 0.0009386539459228516 nb_pixel_total : 23741 time to create 1 rle with old method : 0.028069496154785156 length of segment : 115 time for calcul the mask position with numpy : 0.0020411014556884766 nb_pixel_total : 58505 time to create 1 rle with old method : 0.06613659858703613 length of segment : 300 time for calcul the mask position with numpy : 0.0023474693298339844 nb_pixel_total : 90140 time to create 1 rle with old method : 0.10250616073608398 length of segment : 445 time for calcul the mask position with numpy : 0.001255035400390625 nb_pixel_total : 30725 time to create 1 rle with old method : 0.035100698471069336 length of segment : 162 time for calcul the mask position with numpy : 0.0022177696228027344 nb_pixel_total : 83324 time to create 1 rle with old method : 0.09541010856628418 length of segment : 357 time for calcul the mask position with numpy : 0.0002918243408203125 nb_pixel_total : 10904 time to create 1 rle with old method : 0.012255191802978516 length of segment : 89 time for calcul the mask position with numpy : 0.001360177993774414 nb_pixel_total : 37659 time to create 1 rle with old method : 0.043396949768066406 length of segment : 337 time for calcul the mask position with numpy : 0.003961801528930664 nb_pixel_total : 108165 time to create 1 rle with old method : 0.12127017974853516 length of segment : 433 time for calcul the mask position with numpy : 0.0007531642913818359 nb_pixel_total : 19742 time to create 1 rle with old method : 0.02321314811706543 length of segment : 256 time for calcul the mask position with numpy : 0.0019218921661376953 nb_pixel_total : 78993 time to create 1 rle with old method : 0.08861970901489258 length of segment : 477 time for calcul the mask position with numpy : 0.0008065700531005859 nb_pixel_total : 31795 time to create 1 rle with old method : 0.037683963775634766 length of segment : 221 time for calcul the mask position with numpy : 0.0002143383026123047 nb_pixel_total : 7028 time to create 1 rle with old method : 0.008656024932861328 length of segment : 80 time for calcul the mask position with numpy : 0.001004934310913086 nb_pixel_total : 37125 time to create 1 rle with old method : 0.04662370681762695 length of segment : 132 time for calcul the mask position with numpy : 0.0011487007141113281 nb_pixel_total : 31591 time to create 1 rle with old method : 0.03876829147338867 length of segment : 272 time for calcul the mask position with numpy : 0.003406524658203125 nb_pixel_total : 122802 time to create 1 rle with old method : 0.14161181449890137 length of segment : 395 time for calcul the mask position with numpy : 0.00047588348388671875 nb_pixel_total : 22817 time to create 1 rle with old method : 0.02599048614501953 length of segment : 323 time for calcul the mask position with numpy : 0.0036170482635498047 nb_pixel_total : 53579 time to create 1 rle with old method : 0.0619969367980957 length of segment : 423 time for calcul the mask position with numpy : 0.0039730072021484375 nb_pixel_total : 81252 time to create 1 rle with old method : 0.09105515480041504 length of segment : 392 time for calcul the mask position with numpy : 0.0010411739349365234 nb_pixel_total : 24939 time to create 1 rle with old method : 0.029317855834960938 length of segment : 183 time for calcul the mask position with numpy : 0.0008883476257324219 nb_pixel_total : 29761 time to create 1 rle with old method : 0.03339362144470215 length of segment : 191 time for calcul the mask position with numpy : 0.0017957687377929688 nb_pixel_total : 30528 time to create 1 rle with old method : 0.03630876541137695 length of segment : 371 time for calcul the mask position with numpy : 0.0006546974182128906 nb_pixel_total : 16576 time to create 1 rle with old method : 0.018523454666137695 length of segment : 172 time for calcul the mask position with numpy : 0.0017786026000976562 nb_pixel_total : 87346 time to create 1 rle with old method : 0.0976564884185791 length of segment : 325 time for calcul the mask position with numpy : 0.0027685165405273438 nb_pixel_total : 65365 time to create 1 rle with old method : 0.07368659973144531 length of segment : 369 time for calcul the mask position with numpy : 0.0011353492736816406 nb_pixel_total : 38469 time to create 1 rle with old method : 0.04277491569519043 length of segment : 307 time for calcul the mask position with numpy : 0.0007994174957275391 nb_pixel_total : 31232 time to create 1 rle with old method : 0.03458118438720703 length of segment : 191 time for calcul the mask position with numpy : 0.002020120620727539 nb_pixel_total : 74531 time to create 1 rle with old method : 0.08482050895690918 length of segment : 401 time for calcul the mask position with numpy : 0.000751495361328125 nb_pixel_total : 27205 time to create 1 rle with old method : 0.031557321548461914 length of segment : 137 time for calcul the mask position with numpy : 0.002457857131958008 nb_pixel_total : 90631 time to create 1 rle with old method : 0.10176849365234375 length of segment : 414 time for calcul the mask position with numpy : 0.0006363391876220703 nb_pixel_total : 15974 time to create 1 rle with old method : 0.02052164077758789 length of segment : 177 time for calcul the mask position with numpy : 0.0006427764892578125 nb_pixel_total : 18045 time to create 1 rle with old method : 0.02159905433654785 length of segment : 143 time for calcul the mask position with numpy : 0.0004088878631591797 nb_pixel_total : 10706 time to create 1 rle with old method : 0.013064384460449219 length of segment : 108 time for calcul the mask position with numpy : 0.0008208751678466797 nb_pixel_total : 27663 time to create 1 rle with old method : 0.03229355812072754 length of segment : 190 time for calcul the mask position with numpy : 0.003912448883056641 nb_pixel_total : 152255 time to create 1 rle with new method : 0.00945901870727539 length of segment : 370 time for calcul the mask position with numpy : 0.0008397102355957031 nb_pixel_total : 31432 time to create 1 rle with old method : 0.03727078437805176 length of segment : 321 time for calcul the mask position with numpy : 0.0007116794586181641 nb_pixel_total : 19874 time to create 1 rle with old method : 0.02365279197692871 length of segment : 217 time spent for convertir_results : 11.235337257385254 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 117 chid ids of type : 3594 Number RLEs to save : 33614 save missing photos in datou_result : time spend for datou_step_exec : 65.59671950340271 time spend to save output : 2.022164821624756 total time spend for step 1 : 67.61888432502747 step2:crop_condition Fri Sep 12 17:41:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 117 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 94 About to insert : list_path_to_insert length 94 new photo from crops ! About to upload 94 photos upload in portfolio : 3736932 init cache_photo without model_param we have 94 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757691724_3351246 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 94 photos in the portfolio 3736932 time of upload the photos Elapsed time : 28.338494062423706 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757691756_3351246 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1695775985717773 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757691759_3351246 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6107537746429443 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757691764_3351246 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.2299044132232666 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757691769_3351246 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4230034351348877 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1383490790, 1383490783, 1383490775, 1383490639, 1383490637, 1383490635, 1383490625, 1383490563, 1383490482, 1383490479] Looping around the photos to save general results len do output : 117 /1383509284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383509599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490790', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490783', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490775', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490639', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490637', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490635', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490625', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490563', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490482', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490479', None, None, None, None, None, '3713624') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 361 time used for this insertion : 0.03316211700439453 save_final save missing photos in datou_result : time spend for datou_step_exec : 72.33844947814941 time spend to save output : 0.03761625289916992 total time spend for step 2 : 72.37606573104858 step3:rle_unique_nms_with_priority Fri Sep 12 17:42:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 117 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 10 nb_hashtags : 1 time to prepare the origin masks : 3.028445243835449 time for calcul the mask position with numpy : 0.6660501956939697 nb_pixel_total : 7780625 time to create 1 rle with new method : 0.6116268634796143 time for calcul the mask position with numpy : 0.023333311080932617 nb_pixel_total : 9583 time to create 1 rle with old method : 0.010698080062866211 time for calcul the mask position with numpy : 0.023258209228515625 nb_pixel_total : 31030 time to create 1 rle with old method : 0.0339205265045166 time for calcul the mask position with numpy : 0.02342987060546875 nb_pixel_total : 13579 time to create 1 rle with old method : 0.014852046966552734 time for calcul the mask position with numpy : 0.024385690689086914 nb_pixel_total : 35206 time to create 1 rle with old method : 0.038294076919555664 time for calcul the mask position with numpy : 0.02451801300048828 nb_pixel_total : 188407 time to create 1 rle with new method : 0.8347799777984619 time for calcul the mask position with numpy : 0.024547815322875977 nb_pixel_total : 70695 time to create 1 rle with old method : 0.0758657455444336 time for calcul the mask position with numpy : 0.023267269134521484 nb_pixel_total : 16307 time to create 1 rle with old method : 0.017475128173828125 time for calcul the mask position with numpy : 0.024480581283569336 nb_pixel_total : 20579 time to create 1 rle with old method : 0.022663593292236328 time for calcul the mask position with numpy : 0.024801015853881836 nb_pixel_total : 102104 time to create 1 rle with old method : 0.11030864715576172 time for calcul the mask position with numpy : 0.023638248443603516 nb_pixel_total : 26285 time to create 1 rle with old method : 0.028229236602783203 create new chi : 2.7662770748138428 time to delete rle : 0.02188730239868164 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7312 TO DO : save crop sub photo not yet done ! save time : 0.4786186218261719 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 3.8392810821533203 time for calcul the mask position with numpy : 0.7891254425048828 nb_pixel_total : 7814624 time to create 1 rle with new method : 0.8583357334136963 time for calcul the mask position with numpy : 0.023583650588989258 nb_pixel_total : 85270 time to create 1 rle with old method : 0.09502243995666504 time for calcul the mask position with numpy : 0.02468585968017578 nb_pixel_total : 130235 time to create 1 rle with old method : 0.14426612854003906 time for calcul the mask position with numpy : 0.02409195899963379 nb_pixel_total : 20542 time to create 1 rle with old method : 0.02337479591369629 time for calcul the mask position with numpy : 0.025739431381225586 nb_pixel_total : 41972 time to create 1 rle with old method : 0.047760725021362305 time for calcul the mask position with numpy : 0.026895999908447266 nb_pixel_total : 113604 time to create 1 rle with old method : 0.1297450065612793 time for calcul the mask position with numpy : 0.025556087493896484 nb_pixel_total : 20350 time to create 1 rle with old method : 0.022684097290039062 time for calcul the mask position with numpy : 0.0249483585357666 nb_pixel_total : 8662 time to create 1 rle with old method : 0.00964212417602539 time for calcul the mask position with numpy : 0.025631189346313477 nb_pixel_total : 28316 time to create 1 rle with old method : 0.031624555587768555 time for calcul the mask position with numpy : 0.024755001068115234 nb_pixel_total : 17014 time to create 1 rle with old method : 0.019211530685424805 time for calcul the mask position with numpy : 0.024326801300048828 nb_pixel_total : 13811 time to create 1 rle with old method : 0.014968395233154297 create new chi : 2.477220058441162 time to delete rle : 0.001092672348022461 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 8088 TO DO : save crop sub photo not yet done ! save time : 0.5207157135009766 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 5.359274864196777 time for calcul the mask position with numpy : 0.772869348526001 nb_pixel_total : 7542973 time to create 1 rle with new method : 0.836137056350708 time for calcul the mask position with numpy : 0.023533105850219727 nb_pixel_total : 26304 time to create 1 rle with old method : 0.028083324432373047 time for calcul the mask position with numpy : 0.023754596710205078 nb_pixel_total : 26908 time to create 1 rle with old method : 0.029703855514526367 time for calcul the mask position with numpy : 0.02411174774169922 nb_pixel_total : 15121 time to create 1 rle with old method : 0.017007827758789062 time for calcul the mask position with numpy : 0.02440500259399414 nb_pixel_total : 42704 time to create 1 rle with old method : 0.04627370834350586 time for calcul the mask position with numpy : 0.02444744110107422 nb_pixel_total : 12257 time to create 1 rle with old method : 0.013385772705078125 time for calcul the mask position with numpy : 0.02541804313659668 nb_pixel_total : 57529 time to create 1 rle with old method : 0.06427860260009766 time for calcul the mask position with numpy : 0.024309873580932617 nb_pixel_total : 10778 time to create 1 rle with old method : 0.011944293975830078 time for calcul the mask position with numpy : 0.025251388549804688 nb_pixel_total : 37537 time to create 1 rle with old method : 0.04296374320983887 time for calcul the mask position with numpy : 0.028058528900146484 nb_pixel_total : 320918 time to create 1 rle with new method : 0.6013824939727783 time for calcul the mask position with numpy : 0.024109840393066406 nb_pixel_total : 16988 time to create 1 rle with old method : 0.018737077713012695 time for calcul the mask position with numpy : 0.03104567527770996 nb_pixel_total : 29636 time to create 1 rle with old method : 0.03281998634338379 time for calcul the mask position with numpy : 0.03404426574707031 nb_pixel_total : 22234 time to create 1 rle with old method : 0.024143695831298828 time for calcul the mask position with numpy : 0.02460479736328125 nb_pixel_total : 29312 time to create 1 rle with old method : 0.031891822814941406 time for calcul the mask position with numpy : 0.025084733963012695 nb_pixel_total : 103201 time to create 1 rle with old method : 0.1123192310333252 create new chi : 3.10984468460083 time to delete rle : 0.0014295578002929688 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9861 TO DO : save crop sub photo not yet done ! save time : 0.6160597801208496 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 4.068426847457886 time for calcul the mask position with numpy : 0.7059648036956787 nb_pixel_total : 7675233 time to create 1 rle with new method : 1.14778470993042 time for calcul the mask position with numpy : 0.023435354232788086 nb_pixel_total : 37346 time to create 1 rle with old method : 0.04083609580993652 time for calcul the mask position with numpy : 0.024471759796142578 nb_pixel_total : 28765 time to create 1 rle with old method : 0.03156685829162598 time for calcul the mask position with numpy : 0.024182558059692383 nb_pixel_total : 18702 time to create 1 rle with old method : 0.020999908447265625 time for calcul the mask position with numpy : 0.024817228317260742 nb_pixel_total : 35618 time to create 1 rle with old method : 0.04126262664794922 time for calcul the mask position with numpy : 0.02420210838317871 nb_pixel_total : 34643 time to create 1 rle with old method : 0.03685879707336426 time for calcul the mask position with numpy : 0.022930383682250977 nb_pixel_total : 25583 time to create 1 rle with old method : 0.027652502059936523 time for calcul the mask position with numpy : 0.02609729766845703 nb_pixel_total : 9280 time to create 1 rle with old method : 0.009948015213012695 time for calcul the mask position with numpy : 0.02455925941467285 nb_pixel_total : 238683 time to create 1 rle with new method : 0.627554178237915 time for calcul the mask position with numpy : 0.026018142700195312 nb_pixel_total : 47007 time to create 1 rle with old method : 0.052977800369262695 time for calcul the mask position with numpy : 0.024596452713012695 nb_pixel_total : 18587 time to create 1 rle with old method : 0.02070140838623047 time for calcul the mask position with numpy : 0.025455474853515625 nb_pixel_total : 17515 time to create 1 rle with old method : 0.019986629486083984 time for calcul the mask position with numpy : 0.02485370635986328 nb_pixel_total : 107438 time to create 1 rle with old method : 0.11761975288391113 create new chi : 3.2609450817108154 time to delete rle : 0.0011401176452636719 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8173 TO DO : save crop sub photo not yet done ! save time : 0.5245015621185303 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.776841878890991 time for calcul the mask position with numpy : 1.042423963546753 nb_pixel_total : 7788795 time to create 1 rle with new method : 1.0716140270233154 time for calcul the mask position with numpy : 0.023858070373535156 nb_pixel_total : 44242 time to create 1 rle with old method : 0.06885719299316406 time for calcul the mask position with numpy : 0.027631044387817383 nb_pixel_total : 28229 time to create 1 rle with old method : 0.03405618667602539 time for calcul the mask position with numpy : 0.024237394332885742 nb_pixel_total : 75045 time to create 1 rle with old method : 0.08133411407470703 time for calcul the mask position with numpy : 0.024105548858642578 nb_pixel_total : 8022 time to create 1 rle with old method : 0.009098529815673828 time for calcul the mask position with numpy : 0.0266721248626709 nb_pixel_total : 198540 time to create 1 rle with new method : 0.7533597946166992 time for calcul the mask position with numpy : 0.02651214599609375 nb_pixel_total : 22480 time to create 1 rle with old method : 0.036511898040771484 time for calcul the mask position with numpy : 0.02945089340209961 nb_pixel_total : 102428 time to create 1 rle with old method : 0.11954331398010254 time for calcul the mask position with numpy : 0.026447772979736328 nb_pixel_total : 26619 time to create 1 rle with old method : 0.03019881248474121 create new chi : 3.5213449001312256 time to delete rle : 0.001360177993774414 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8281 TO DO : save crop sub photo not yet done ! save time : 0.5377378463745117 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 7.460554599761963 time for calcul the mask position with numpy : 0.9995133876800537 nb_pixel_total : 7275942 time to create 1 rle with new method : 0.9112250804901123 time for calcul the mask position with numpy : 0.024502038955688477 nb_pixel_total : 16068 time to create 1 rle with old method : 0.01807880401611328 time for calcul the mask position with numpy : 0.024682998657226562 nb_pixel_total : 77836 time to create 1 rle with old method : 0.09059548377990723 time for calcul the mask position with numpy : 0.02548980712890625 nb_pixel_total : 9472 time to create 1 rle with old method : 0.010559320449829102 time for calcul the mask position with numpy : 0.02485823631286621 nb_pixel_total : 62267 time to create 1 rle with old method : 0.07216548919677734 time for calcul the mask position with numpy : 0.025551557540893555 nb_pixel_total : 27236 time to create 1 rle with old method : 0.031239748001098633 time for calcul the mask position with numpy : 0.02625250816345215 nb_pixel_total : 84259 time to create 1 rle with old method : 0.09685802459716797 time for calcul the mask position with numpy : 0.027755260467529297 nb_pixel_total : 33004 time to create 1 rle with old method : 0.037595272064208984 time for calcul the mask position with numpy : 0.025424718856811523 nb_pixel_total : 28349 time to create 1 rle with old method : 0.031668663024902344 time for calcul the mask position with numpy : 0.024793624877929688 nb_pixel_total : 28250 time to create 1 rle with old method : 0.0326080322265625 time for calcul the mask position with numpy : 0.02686762809753418 nb_pixel_total : 74436 time to create 1 rle with old method : 0.08568763732910156 time for calcul the mask position with numpy : 0.026454925537109375 nb_pixel_total : 83081 time to create 1 rle with old method : 0.09412050247192383 time for calcul the mask position with numpy : 0.02593517303466797 nb_pixel_total : 47737 time to create 1 rle with old method : 0.05320310592651367 time for calcul the mask position with numpy : 0.025408029556274414 nb_pixel_total : 39266 time to create 1 rle with old method : 0.04426383972167969 time for calcul the mask position with numpy : 0.026798009872436523 nb_pixel_total : 82188 time to create 1 rle with old method : 0.09551262855529785 time for calcul the mask position with numpy : 0.026360511779785156 nb_pixel_total : 25609 time to create 1 rle with old method : 0.033478498458862305 time for calcul the mask position with numpy : 0.03133344650268555 nb_pixel_total : 151077 time to create 1 rle with new method : 0.812708854675293 time for calcul the mask position with numpy : 0.025463104248046875 nb_pixel_total : 148323 time to create 1 rle with old method : 0.16840744018554688 create new chi : 4.233629941940308 time to delete rle : 0.0017838478088378906 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 12657 TO DO : save crop sub photo not yet done ! save time : 0.809257984161377 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 8.623842477798462 time for calcul the mask position with numpy : 0.6710934638977051 nb_pixel_total : 7815956 time to create 1 rle with new method : 0.9505610466003418 time for calcul the mask position with numpy : 0.025715351104736328 nb_pixel_total : 58505 time to create 1 rle with old method : 0.06656479835510254 time for calcul the mask position with numpy : 0.023814916610717773 nb_pixel_total : 23741 time to create 1 rle with old method : 0.02670764923095703 time for calcul the mask position with numpy : 0.02456045150756836 nb_pixel_total : 48156 time to create 1 rle with old method : 0.05301260948181152 time for calcul the mask position with numpy : 0.02446770668029785 nb_pixel_total : 50636 time to create 1 rle with old method : 0.05626487731933594 time for calcul the mask position with numpy : 0.024600744247436523 nb_pixel_total : 69391 time to create 1 rle with old method : 0.07571554183959961 time for calcul the mask position with numpy : 0.023765087127685547 nb_pixel_total : 11511 time to create 1 rle with old method : 0.01278376579284668 time for calcul the mask position with numpy : 0.024211406707763672 nb_pixel_total : 20953 time to create 1 rle with old method : 0.02305746078491211 time for calcul the mask position with numpy : 0.023390769958496094 nb_pixel_total : 9337 time to create 1 rle with old method : 0.010349512100219727 time for calcul the mask position with numpy : 0.024190187454223633 nb_pixel_total : 61603 time to create 1 rle with old method : 0.06800484657287598 time for calcul the mask position with numpy : 0.02492046356201172 nb_pixel_total : 29098 time to create 1 rle with old method : 0.03167295455932617 time for calcul the mask position with numpy : 0.024029254913330078 nb_pixel_total : 56173 time to create 1 rle with old method : 0.0620884895324707 time for calcul the mask position with numpy : 0.024906158447265625 nb_pixel_total : 39340 time to create 1 rle with old method : 0.04430580139160156 create new chi : 2.4880194664001465 time to delete rle : 0.0013031959533691406 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8768 TO DO : save crop sub photo not yet done ! save time : 0.5812251567840576 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 5.462133169174194 time for calcul the mask position with numpy : 0.8741636276245117 nb_pixel_total : 7795925 time to create 1 rle with new method : 1.390172004699707 time for calcul the mask position with numpy : 0.02419877052307129 nb_pixel_total : 7028 time to create 1 rle with old method : 0.008731365203857422 time for calcul the mask position with numpy : 0.04444289207458496 nb_pixel_total : 31795 time to create 1 rle with old method : 0.03617739677429199 time for calcul the mask position with numpy : 0.037760257720947266 nb_pixel_total : 78993 time to create 1 rle with old method : 0.09217524528503418 time for calcul the mask position with numpy : 0.04597306251525879 nb_pixel_total : 19742 time to create 1 rle with old method : 0.022695064544677734 time for calcul the mask position with numpy : 0.04653525352478027 nb_pixel_total : 108165 time to create 1 rle with old method : 0.12599468231201172 time for calcul the mask position with numpy : 0.027559757232666016 nb_pixel_total : 37659 time to create 1 rle with old method : 0.04404902458190918 time for calcul the mask position with numpy : 0.03181028366088867 nb_pixel_total : 10904 time to create 1 rle with old method : 0.019257783889770508 time for calcul the mask position with numpy : 0.026068449020385742 nb_pixel_total : 83324 time to create 1 rle with old method : 0.09873557090759277 time for calcul the mask position with numpy : 0.02541351318359375 nb_pixel_total : 30725 time to create 1 rle with old method : 0.035208940505981445 time for calcul the mask position with numpy : 0.027260303497314453 nb_pixel_total : 90140 time to create 1 rle with old method : 0.10030651092529297 create new chi : 3.2286500930786133 time to delete rle : 0.001096487045288086 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 7874 TO DO : save crop sub photo not yet done ! save time : 0.4708590507507324 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 5.852679967880249 time for calcul the mask position with numpy : 0.7662765979766846 nb_pixel_total : 7661650 time to create 1 rle with new method : 0.8814394474029541 time for calcul the mask position with numpy : 0.025681257247924805 nb_pixel_total : 38469 time to create 1 rle with old method : 0.043723106384277344 time for calcul the mask position with numpy : 0.02627086639404297 nb_pixel_total : 65365 time to create 1 rle with old method : 0.07398033142089844 time for calcul the mask position with numpy : 0.027176618576049805 nb_pixel_total : 87346 time to create 1 rle with old method : 0.09960818290710449 time for calcul the mask position with numpy : 0.025177955627441406 nb_pixel_total : 16576 time to create 1 rle with old method : 0.019077301025390625 time for calcul the mask position with numpy : 0.024810791015625 nb_pixel_total : 30528 time to create 1 rle with old method : 0.03754019737243652 time for calcul the mask position with numpy : 0.026630401611328125 nb_pixel_total : 29761 time to create 1 rle with old method : 0.03374218940734863 time for calcul the mask position with numpy : 0.02630305290222168 nb_pixel_total : 24939 time to create 1 rle with old method : 0.0356144905090332 time for calcul the mask position with numpy : 0.02566671371459961 nb_pixel_total : 81252 time to create 1 rle with old method : 0.09936189651489258 time for calcul the mask position with numpy : 0.03477048873901367 nb_pixel_total : 53579 time to create 1 rle with old method : 0.06567025184631348 time for calcul the mask position with numpy : 0.026209592819213867 nb_pixel_total : 13417 time to create 1 rle with old method : 0.01480865478515625 time for calcul the mask position with numpy : 0.024939537048339844 nb_pixel_total : 122802 time to create 1 rle with old method : 0.1480090618133545 time for calcul the mask position with numpy : 0.024913549423217773 nb_pixel_total : 31591 time to create 1 rle with old method : 0.03896689414978027 time for calcul the mask position with numpy : 0.026727676391601562 nb_pixel_total : 37125 time to create 1 rle with old method : 0.0445103645324707 create new chi : 2.791921854019165 time to delete rle : 0.0015392303466796875 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 9535 TO DO : save crop sub photo not yet done ! save time : 0.6159970760345459 nb_obj : 11 nb_hashtags : 1 time to prepare the origin masks : 4.957724571228027 time for calcul the mask position with numpy : 0.6195433139801025 nb_pixel_total : 7794852 time to create 1 rle with new method : 0.8564004898071289 time for calcul the mask position with numpy : 0.04224228858947754 nb_pixel_total : 19874 time to create 1 rle with old method : 0.022380828857421875 time for calcul the mask position with numpy : 0.025590181350708008 nb_pixel_total : 31432 time to create 1 rle with old method : 0.0351865291595459 time for calcul the mask position with numpy : 0.024976730346679688 nb_pixel_total : 152255 time to create 1 rle with new method : 0.8667669296264648 time for calcul the mask position with numpy : 0.025615453720092773 nb_pixel_total : 27663 time to create 1 rle with old method : 0.03171277046203613 time for calcul the mask position with numpy : 0.024848222732543945 nb_pixel_total : 10706 time to create 1 rle with old method : 0.011608600616455078 time for calcul the mask position with numpy : 0.02428150177001953 nb_pixel_total : 18045 time to create 1 rle with old method : 0.019710063934326172 time for calcul the mask position with numpy : 0.024281024932861328 nb_pixel_total : 15974 time to create 1 rle with old method : 0.01742267608642578 time for calcul the mask position with numpy : 0.026711463928222656 nb_pixel_total : 90631 time to create 1 rle with old method : 0.10146641731262207 time for calcul the mask position with numpy : 0.024632692337036133 nb_pixel_total : 27205 time to create 1 rle with old method : 0.030781030654907227 time for calcul the mask position with numpy : 0.027710914611816406 nb_pixel_total : 74531 time to create 1 rle with old method : 0.08412504196166992 time for calcul the mask position with numpy : 0.02455592155456543 nb_pixel_total : 31232 time to create 1 rle with old method : 0.03465557098388672 create new chi : 3.095337152481079 time to delete rle : 0.0011844635009765625 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7498 TO DO : save crop sub photo not yet done ! save time : 0.49141740798950195 map_output_result : {1383490790: (0.0, 'Should be the crop_list due to order', 0), 1383490783: (0.0, 'Should be the crop_list due to order', 0), 1383490775: (0.0, 'Should be the crop_list due to order', 0), 1383490639: (0.0, 'Should be the crop_list due to order', 0), 1383490637: (0.0, 'Should be the crop_list due to order', 0), 1383490635: (0.0, 'Should be the crop_list due to order', 0), 1383490625: (0.0, 'Should be the crop_list due to order', 0), 1383490563: (0.0, 'Should be the crop_list due to order', 0), 1383490482: (0.0, 'Should be the crop_list due to order', 0), 1383490479: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1383490790, 1383490783, 1383490775, 1383490639, 1383490637, 1383490635, 1383490625, 1383490563, 1383490482, 1383490479] Looping around the photos to save general results len do output : 10 /1383490790.Didn't retrieve data . /1383490783.Didn't retrieve data . /1383490775.Didn't retrieve data . /1383490639.Didn't retrieve data . /1383490637.Didn't retrieve data . /1383490635.Didn't retrieve data . /1383490625.Didn't retrieve data . /1383490563.Didn't retrieve data . /1383490482.Didn't retrieve data . /1383490479.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490790', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490783', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490775', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490639', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490637', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490635', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490625', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490563', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490482', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490479', None, None, None, None, None, '3713624') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.012606620788574219 save_final save missing photos in datou_result : time spend for datou_step_exec : 90.48485946655273 time spend to save output : 0.012981176376342773 total time spend for step 3 : 90.49784064292908 step4:ventilate_hashtags_in_portfolio Fri Sep 12 17:44:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26801185 get user id for portfolio 26801185 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26801185 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pehd','pet_clair','autre','flou','pet_fonce','background','metal','papier','environnement','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26801185 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pehd','pet_clair','autre','flou','pet_fonce','background','metal','papier','environnement','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26801185 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pehd','pet_clair','autre','flou','pet_fonce','background','metal','papier','environnement','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26801727,26801728,26801729,26801730,26801731,26801732,26801733,26801734,26801735,26801736,26801737?tags=carton,pehd,pet_clair,autre,flou,pet_fonce,background,metal,papier,environnement,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1383490790, 1383490783, 1383490775, 1383490639, 1383490637, 1383490635, 1383490625, 1383490563, 1383490482, 1383490479] Looping around the photos to save general results len do output : 1 /26801185. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490790', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490783', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490775', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490639', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490637', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490635', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490625', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490563', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490482', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490479', None, None, None, None, None, '3713624') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01647782325744629 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7087926864624023 time spend to save output : 0.01688218116760254 total time spend for step 4 : 1.7256748676300049 step5:final Fri Sep 12 17:44:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1383490790: ('0.07230691792052471',), 1383490783: ('0.07230691792052471',), 1383490775: ('0.07230691792052471',), 1383490639: ('0.07230691792052471',), 1383490637: ('0.07230691792052471',), 1383490635: ('0.07230691792052471',), 1383490625: ('0.07230691792052471',), 1383490563: ('0.07230691792052471',), 1383490482: ('0.07230691792052471',), 1383490479: ('0.07230691792052471',)} new output for save of step final : {1383490790: ('0.07230691792052471',), 1383490783: ('0.07230691792052471',), 1383490775: ('0.07230691792052471',), 1383490639: ('0.07230691792052471',), 1383490637: ('0.07230691792052471',), 1383490635: ('0.07230691792052471',), 1383490625: ('0.07230691792052471',), 1383490563: ('0.07230691792052471',), 1383490482: ('0.07230691792052471',), 1383490479: ('0.07230691792052471',)} [1383490790, 1383490783, 1383490775, 1383490639, 1383490637, 1383490635, 1383490625, 1383490563, 1383490482, 1383490479] Looping around the photos to save general results len do output : 10 /1383490790.Didn't retrieve data . /1383490783.Didn't retrieve data . /1383490775.Didn't retrieve data . /1383490639.Didn't retrieve data . /1383490637.Didn't retrieve data . /1383490635.Didn't retrieve data . /1383490625.Didn't retrieve data . /1383490563.Didn't retrieve data . /1383490482.Didn't retrieve data . /1383490479.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490790', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490783', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490775', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490639', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490637', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490635', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490625', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490563', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490482', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490479', None, None, None, None, None, '3713624') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014670372009277344 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12074732780456543 time spend to save output : 0.015339374542236328 total time spend for step 5 : 0.13608670234680176 step6:blur_detection Fri Sep 12 17:44:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760.jpg resize: (2160, 3840) 1383490790 -6.007919130015685 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015.jpg resize: (2160, 3840) 1383490783 -6.89217884764307 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54.jpg resize: (2160, 3840) 1383490775 -6.28949757088783 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3.jpg resize: (2160, 3840) 1383490639 -6.947648949704232 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3.jpg resize: (2160, 3840) 1383490637 -6.911867009067123 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8.jpg resize: (2160, 3840) 1383490635 -6.9860911645463935 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2.jpg resize: (2160, 3840) 1383490625 -6.064380577704754 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16.jpg resize: (2160, 3840) 1383490563 -7.094124345957223 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2.jpg resize: (2160, 3840) 1383490482 -6.867461257044363 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d.jpg resize: (2160, 3840) 1383490479 -5.965723767599607 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137140_0.png resize: (165, 189) 1383509284 -4.410589398008155 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137141_0.png resize: (287, 401) 1383509286 -2.6065640456924823 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137142_0.png resize: (166, 192) 1383509288 -4.777274552026947 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137143_0.png resize: (189, 156) 1383509289 0.17333310098036145 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137144_0.png resize: (308, 298) 1383509290 -3.5133016950517915 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137145_0.png resize: (533, 582) 1383509291 -3.830646731561168 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137146_0.png resize: (228, 281) 1383509292 -3.3419359762932914 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137147_0.png resize: (157, 117) 1383509293 -3.64849396361495 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137148_0.png resize: (205, 188) 1383509294 -2.6755278635092 treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137149_0.png resize: (90, 138) 1383509295 -2.1190837545074235 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137151_0.png resize: (173, 174) 1383509296 -0.3560047020282193 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137152_0.png resize: (242, 172) 1383509297 -1.0454209411800663 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137153_0.png resize: (152, 76) 1383509298 -1.9881082960013092 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137155_0.png resize: (441, 426) 1383509299 -3.9251562495788606 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137156_0.png resize: (289, 218) 1383509300 -4.107117401844881 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137158_0.png resize: (537, 440) 1383509301 -3.6764497681742205 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137159_0.png resize: (620, 219) 1383509302 -3.435712461442233 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137160_0.png resize: (384, 447) 1383509303 -1.4883382691821552 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137161_0.png resize: (203, 251) 1383509305 -2.703736696896879 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137162_0.png resize: (241, 163) 1383509306 -3.949094870611062 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137163_0.png resize: (228, 188) 1383509307 -4.1329611868511265 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137165_0.png resize: (738, 684) 1383509309 -4.048030680947421 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137166_0.png resize: (323, 185) 1383509310 -4.036171560242837 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137168_0.png resize: (409, 362) 1383509312 -4.14117943438776 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137170_0.png resize: (246, 238) 1383509313 -0.8676646311886247 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137171_0.png resize: (114, 156) 1383509314 -2.650627017830255 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137172_0.png resize: (138, 259) 1383509316 -1.263246703290687 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137174_0.png resize: (372, 475) 1383509317 -2.1795823464641266 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137175_0.png resize: (105, 213) 1383509318 -3.326706059033894 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137177_0.png resize: (263, 312) 1383509320 -4.095553537283259 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137178_0.png resize: (461, 760) 1383509321 -4.864647938042929 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137179_0.png resize: (139, 100) 1383509322 -1.7540218259470626 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137181_0.png resize: (325, 227) 1383509324 -3.9080551436366333 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137182_0.png resize: (247, 200) 1383509325 -4.834703277168236 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137183_0.png resize: (260, 207) 1383509326 -3.717454334753349 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137184_0.png resize: (144, 310) 1383509328 -3.5009771134478673 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137185_0.png resize: (203, 230) 1383509329 -2.5675507572475884 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137186_0.png resize: (203, 161) 1383509330 -2.446455372772936 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137187_0.png resize: (477, 338) 1383509332 -3.342654661013027 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137190_0.png resize: (150, 92) 1383509333 -2.770219480287529 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137191_0.png resize: (413, 308) 1383509334 -4.126551876179397 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137192_0.png resize: (287, 347) 1383509336 -2.4868825368906156 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137193_0.png resize: (225, 280) 1383509337 -3.1613034532897584 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137194_0.png resize: (526, 428) 1383509338 -3.7812532129119307 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137195_0.png resize: (502, 491) 1383509340 -3.501552954219863 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137196_0.png resize: (220, 195) 1383509341 -3.8368466298377246 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137198_0.png resize: (182, 307) 1383509342 -3.6839316708779126 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137199_0.png resize: (263, 263) 1383509344 -3.6200977582325957 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137200_0.png resize: (272, 548) 1383509345 -4.025405896549165 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137202_0.png resize: (168, 217) 1383509346 -2.988031069661812 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137203_0.png resize: (198, 231) 1383509348 -2.604373626693827 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137204_0.png resize: (313, 157) 1383509349 -1.6992330522656607 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137205_0.png resize: (362, 432) 1383509350 -2.9091247880861357 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137206_0.png resize: (144, 238) 1383509352 -2.6181265836437717 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137208_0.png resize: (186, 154) 1383509353 -3.2662981330269605 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137210_0.png resize: (158, 156) 1383509354 -3.067155433931715 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137211_0.png resize: (272, 260) 1383509356 -3.7657487741429416 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137212_0.png resize: (268, 288) 1383509358 -3.0424380309361228 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137213_0.png resize: (198, 288) 1383509359 -3.4234826983352176 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137214_0.png resize: (296, 347) 1383509361 -2.965954545314637 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137215_0.png resize: (149, 89) 1383509362 -2.3870699788800613 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137216_0.png resize: (205, 163) 1383509363 -3.415658603556236 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137218_0.png resize: (421, 390) 1383509365 -3.4698976113246616 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137220_0.png resize: (254, 289) 1383509366 -2.4944082194167208 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137223_0.png resize: (358, 342) 1383509367 -3.916572677120636 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137224_0.png resize: (159, 226) 1383509369 -2.6619114158312005 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137226_0.png resize: (87, 139) 1383509370 -2.600435894672217 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137227_0.png resize: (337, 246) 1383509371 -4.581403514444872 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137228_0.png resize: (396, 406) 1383509373 -4.883293555772859 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137229_0.png resize: (256, 108) 1383509374 -3.274762663890203 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137230_0.png resize: (397, 381) 1383509375 -2.1951523396955475 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137231_0.png resize: (220, 193) 1383509377 -2.748574549021304 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137232_0.png resize: (79, 115) 1383509378 -3.213809350857141 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137233_0.png resize: (127, 378) 1383509379 -4.4249077429948755 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137235_0.png resize: (391, 480) 1383509381 -3.876977093020406 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137237_0.png resize: (360, 267) 1383509382 -1.8198817398979685 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137238_0.png resize: (342, 661) 1383509383 -3.2407920982517573 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137239_0.png resize: (147, 269) 1383509385 -2.9220563256841747 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137240_0.png resize: (164, 277) 1383509386 -1.7544167773342842 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137241_0.png resize: (301, 327) 1383509387 -2.8017934608902024 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137243_0.png resize: (308, 333) 1383509390 -2.0703193636399155 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137244_0.png resize: (320, 346) 1383509391 -4.791840103728168 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137245_0.png resize: (302, 161) 1383509392 -4.630412428679181 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137246_0.png resize: (191, 231) 1383509394 -3.497000358392413 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137247_0.png resize: (392, 294) 1383509395 -2.3045058557075584 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137248_0.png resize: (133, 269) 1383509396 -2.91158988364052 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137249_0.png resize: (371, 339) 1383509398 -4.746563046505707 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137250_0.png resize: (155, 171) 1383509399 -3.9170094043431476 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137251_0.png resize: (143, 159) 1383509400 -4.152093840267427 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137252_0.png resize: (107, 129) 1383509401 -3.5163084018049218 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137253_0.png resize: (188, 227) 1383509403 -2.7470311700599486 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137254_0.png resize: (362, 536) 1383509405 -4.379197501237007 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137255_0.png resize: (292, 217) 1383509406 -3.712990597197456 treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137256_0.png resize: (217, 133) 1383509408 -2.446631316708895 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137150_0.png resize: (200, 128) 1383509464 -2.628830094440638 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137219_0.png resize: (429, 237) 1383509466 -3.141760709425214 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137221_0.png resize: (112, 248) 1383509468 -2.8787682382979054 treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137225_0.png resize: (356, 363) 1383509469 -4.137230238010861 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137234_0.png resize: (262, 200) 1383509471 -4.695654464917307 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137236_0.png resize: (219, 165) 1383509473 -4.514583050655116 treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137242_0.png resize: (152, 178) 1383509474 -3.543678923822435 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137173_0.png resize: (188, 178) 1383509501 -4.705619277925132 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137154_0.png resize: (117, 248) 1383509562 -3.9295338752972477 treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137157_0.png resize: (113, 241) 1383509563 -3.5483605954533273 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137169_0.png resize: (86, 193) 1383509565 -3.9759198275343386 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137176_0.png resize: (133, 183) 1383509566 -3.385365280318142 treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137180_0.png resize: (154, 235) 1383509567 -4.017950115286104 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137189_0.png resize: (610, 436) 1383509569 -5.325189619010861 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137197_0.png resize: (251, 422) 1383509570 -4.794248574924222 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137201_0.png resize: (497, 175) 1383509571 -4.68779686461514 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137207_0.png resize: (324, 347) 1383509573 -3.642173834187001 treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137209_0.png resize: (240, 389) 1383509574 -4.768985404928334 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137222_0.png resize: (236, 405) 1383509575 -4.257273375751985 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137164_0.png resize: (147, 153) 1383509595 -3.2540989888375527 treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137167_0.png resize: (121, 118) 1383509596 -4.367607584557606 treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137188_0.png resize: (191, 157) 1383509597 -3.1987971974427953 treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137217_0.png resize: (110, 132) 1383509599 -3.420417412947265 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 127 time used for this insertion : 0.01996636390686035 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 127 time used for this insertion : 0.03256678581237793 save missing photos in datou_result : time spend for datou_step_exec : 41.774128675460815 time spend to save output : 0.058312416076660156 total time spend for step 6 : 41.832441091537476 step7:brightness Fri Sep 12 17:45:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760.jpg treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015.jpg treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54.jpg treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3.jpg treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3.jpg treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8.jpg treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2.jpg treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16.jpg treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2.jpg treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d.jpg treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137140_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137141_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137142_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137143_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137144_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137145_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137146_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137147_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137148_0.png treat image : temp/1757691628_3351246_1383490790_59b4f8edb73b1d861660eb25b36ca760_rle_crop_3957137149_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137151_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137152_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137153_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137155_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137156_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137158_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137159_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137160_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137161_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137162_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137163_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137165_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137166_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137168_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137170_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137171_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137172_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137174_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137175_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137177_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137178_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137179_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137181_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137182_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137183_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137184_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137185_0.png treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137186_0.png treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137187_0.png treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137190_0.png treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137191_0.png treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137192_0.png treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137193_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137194_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137195_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137196_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137198_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137199_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137200_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137202_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137203_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137204_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137205_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137206_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137208_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137210_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137211_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137212_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137213_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137214_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137215_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137216_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137218_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137220_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137223_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137224_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137226_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137227_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137228_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137229_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137230_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137231_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137232_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137233_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137235_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137237_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137238_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137239_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137240_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137241_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137243_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137244_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137245_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137246_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137247_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137248_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137249_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137250_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137251_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137252_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137253_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137254_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137255_0.png treat image : temp/1757691628_3351246_1383490479_6f2479ad5149e026ddced2d13e3e799d_rle_crop_3957137256_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137150_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137219_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137221_0.png treat image : temp/1757691628_3351246_1383490563_12166e434d55b06aff262e5b85cc2d16_rle_crop_3957137225_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137234_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137236_0.png treat image : temp/1757691628_3351246_1383490482_561e31881442b8f3cf11ff93082957e2_rle_crop_3957137242_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137173_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137154_0.png treat image : temp/1757691628_3351246_1383490783_6f137633147ca217cd190f4a28463015_rle_crop_3957137157_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137169_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137176_0.png treat image : temp/1757691628_3351246_1383490639_1dda9179b25ae2222e5855810403d0c3_rle_crop_3957137180_0.png treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137189_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137197_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137201_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137207_0.png treat image : temp/1757691628_3351246_1383490635_b0648fa81d9c9f90c88158d4bda2f6d8_rle_crop_3957137209_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137222_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137164_0.png treat image : temp/1757691628_3351246_1383490775_a394bb4a3edd98eff9799f19550b5d54_rle_crop_3957137167_0.png treat image : temp/1757691628_3351246_1383490637_3a533aeab68c6fe0c675ac79051c30c3_rle_crop_3957137188_0.png treat image : temp/1757691628_3351246_1383490625_487d8f1511a64db889fb554ed1b1a1a2_rle_crop_3957137217_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 127 time used for this insertion : 0.017435073852539062 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 127 time used for this insertion : 0.028987884521484375 save missing photos in datou_result : time spend for datou_step_exec : 10.653252363204956 time spend to save output : 0.05199742317199707 total time spend for step 7 : 10.705249786376953 step8:velours_tree Fri Sep 12 17:45:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3038177490234375 time spend to save output : 3.910064697265625e-05 total time spend for step 8 : 0.30385684967041016 step9:send_mail_cod Fri Sep 12 17:45:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26801185_12-09-2025_17_45_16.pdf 26801727 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268017271757691916 26801728 imagette268017281757691916 26801729 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268017291757691916 26801730 change filename to text .change filename to text .change filename to text .change filename to text .imagette268017301757691917 26801731 imagette268017311757691917 26801732 imagette268017321757691917 26801733 imagette268017331757691917 26801734 change filename to text .imagette268017341757691917 26801735 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette268017351757691917 26801737 imagette268017371757691920 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26801185 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26801727,26801728,26801729,26801730,26801731,26801732,26801733,26801734,26801735,26801736,26801737?tags=carton,pehd,pet_clair,autre,flou,pet_fonce,background,metal,papier,environnement,mal_croppe args[1383490790] : ((1383490790, -6.007919130015685, 492609224), (1383490790, 0.46277148131715334, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490783] : ((1383490783, -6.89217884764307, 492609224), (1383490783, 1.439498458272939, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490775] : ((1383490775, -6.28949757088783, 492609224), (1383490775, 0.45704241351742136, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490639] : ((1383490639, -6.947648949704232, 492609224), (1383490639, 1.302207845273435, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490637] : ((1383490637, -6.911867009067123, 492609224), (1383490637, 0.7898766091510967, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490635] : ((1383490635, -6.9860911645463935, 492609224), (1383490635, 0.8629060045111211, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490625] : ((1383490625, -6.064380577704754, 492609224), (1383490625, 0.4549679687093036, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490563] : ((1383490563, -7.094124345957223, 492609224), (1383490563, 0.9125436984246262, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490482] : ((1383490482, -6.867461257044363, 492609224), (1383490482, 1.0956242741078024, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com args[1383490479] : ((1383490479, -5.965723767599607, 492609224), (1383490479, 0.3527892310100093, 2107752395), '0.07230691792052471') We are sending mail with results at report@fotonower.com refus_total : 0.07230691792052471 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26801185 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26801185_12-09-2025_17_45_16.pdf results_Auto_P26801185_12-09-2025_17_45_16.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26801185_12-09-2025_17_45_16.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26801185','results_Auto_P26801185_12-09-2025_17_45_16.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26801185_12-09-2025_17_45_16.pdf','pdf','','0.55','0.07230691792052471') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26801185

https://www.fotonower.com/image?json=false&list_photos_id=1383490790
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490783
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490775
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490639
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490637
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490635
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490625
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490563
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490482
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383490479
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 7.23%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26801727?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26801729?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26801730?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26801734?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26801735?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26801185_12-09-2025_17_45_16.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26801727,26801728,26801729,26801730,26801731,26801732,26801733,26801734,26801735,26801736,26801737?tags=carton,pehd,pet_clair,autre,flou,pet_fonce,background,metal,papier,environnement,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 12 Sep 2025 15:45:23 GMT Content-Length: 0 Connection: close X-Message-Id: jsYkIENdTTWSbVXeDSSZtA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1383490790, 1383490783, 1383490775, 1383490639, 1383490637, 1383490635, 1383490625, 1383490563, 1383490482, 1383490479] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490790', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490783', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490775', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490639', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490637', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490635', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490625', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490563', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490482', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490479', None, None, None, None, None, '3713624') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.015450477600097656 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.865063190460205 time spend to save output : 0.01568007469177246 total time spend for step 9 : 7.8807432651519775 step10:split_time_score Fri Sep 12 17:45:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12092025 26801185 Nombre de photos uploadées : 10 / 23040 (0%) 12092025 26801185 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 12092025 26801185 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005695819854736328 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2045741081237793 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09855040220835105 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26790282_12-09-2025_13_37_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26790282 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26790282 AND mptpi.`type`=3726 To do Qualite : 0.06031261731167197 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26790301_12-09-2025_13_42_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26790301 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26790301 AND mptpi.`type`=3726 To do Qualite : 0.01879654768990015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26790302_12-09-2025_13_33_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26790302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26790302 AND mptpi.`type`=3726 To do Qualite : 0.03521513383741446 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26787528_12-09-2025_12_28_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26787528 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26787528 AND mptpi.`type`=3726 To do Qualite : 0.019965025320831484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26787541_12-09-2025_12_32_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26787541 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26787541 AND mptpi.`type`=3726 To do Qualite : 0.03181074805365979 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26787542_12-09-2025_12_20_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26787542 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26787542 AND mptpi.`type`=3726 To do Qualite : 0.09511554783950618 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26783341_12-09-2025_11_03_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26783341 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26783341 AND mptpi.`type`=3594 To do Qualite : 0.030019639895333485 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26787561_12-09-2025_12_19_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26787561 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26787561 AND mptpi.`type`=3726 To do Qualite : 0.020974738899427206 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26787563_12-09-2025_12_08_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26787563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26787563 AND mptpi.`type`=3726 To do Qualite : 0.08055683457461084 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26790345_12-09-2025_15_52_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26790345 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26790345 AND mptpi.`type`=3594 To do Qualite : 0.02817616775860093 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26792965_12-09-2025_14_46_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26792965 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26792965 AND mptpi.`type`=3726 To do Qualite : 0.04452984816972721 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26797054_12-09-2025_16_35_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26797054 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26797054 AND mptpi.`type`=3726 To do Qualite : 0.07230691792052471 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26801185_12-09-2025_17_45_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26801185 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26801185 AND mptpi.`type`=3594 To do Qualite : 0.05686751365224734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26801189_12-09-2025_17_37_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26801189 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26801189 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12092025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1383490790, 1383490783, 1383490775, 1383490639, 1383490637, 1383490635, 1383490625, 1383490563, 1383490482, 1383490479] Looping around the photos to save general results len do output : 1 /26801185Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490790', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490783', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490775', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490639', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490637', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490635', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490625', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490563', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490482', None, None, None, None, None, '3713624') ('3318', None, None, None, None, None, None, None, '3713624') ('3318', '26801185', '1383490479', None, None, None, None, None, '3713624') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01669144630432129 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.277209758758545 time spend to save output : 0.016916275024414062 total time spend for step 10 : 1.294126033782959 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 128.16user 123.65system 4:59.41elapsed 84%CPU (0avgtext+0avgdata 4660912maxresident)k 829168inputs+111888outputs (13946major+12075625minor)pagefaults 0swaps