python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3326676 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3573928'] with mtr_portfolio_ids : ['26145859'] and first list_photo_ids : [] new path : /proc/3326676/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.12422776222229 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 22 11:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10390 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-22 11:20:33.375237: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-22 11:20:33.404500: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-22 11:20:33.406709: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f92a0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-22 11:20:33.406741: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-22 11:20:33.410914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-22 11:20:33.561720: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x34624430 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-22 11:20:33.561778: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-22 11:20:33.563325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-22 11:20:33.563770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-22 11:20:33.567042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-22 11:20:33.569940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-22 11:20:33.570450: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-22 11:20:33.573390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-22 11:20:33.574976: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-22 11:20:33.580078: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-22 11:20:33.581610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-22 11:20:33.581696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-22 11:20:33.582454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-22 11:20:33.582470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-22 11:20:33.582484: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-22 11:20:33.583769: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9336 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-22 11:20:33.868121: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-22 11:20:33.868206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-22 11:20:33.868227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-22 11:20:33.868247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-22 11:20:33.868265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-22 11:20:33.868283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-22 11:20:33.868301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-22 11:20:33.868319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-22 11:20:33.869904: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-22 11:20:33.871837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-22 11:20:33.871914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-22 11:20:33.871934: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-22 11:20:33.871951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-22 11:20:33.871969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-22 11:20:33.871986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-22 11:20:33.872004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-22 11:20:33.872022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-22 11:20:33.873833: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-22 11:20:33.873884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-22 11:20:33.873895: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-22 11:20:33.873906: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-22 11:20:33.875389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9336 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-22 11:20:43.365987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-22 11:20:43.568563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 54.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 53.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 52.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 51.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 54.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 53.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 56.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 54.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 Detection mask done ! Trying to reset tf kernel 3327150 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1324 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6613 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0004515647888183594 nb_pixel_total : 12558 time to create 1 rle with old method : 0.014699935913085938 length of segment : 83 time for calcul the mask position with numpy : 0.004004716873168945 nb_pixel_total : 125553 time to create 1 rle with old method : 0.14740490913391113 length of segment : 581 time for calcul the mask position with numpy : 0.00018525123596191406 nb_pixel_total : 6650 time to create 1 rle with old method : 0.0073697566986083984 length of segment : 147 time for calcul the mask position with numpy : 0.0002868175506591797 nb_pixel_total : 6405 time to create 1 rle with old method : 0.007132768630981445 length of segment : 110 time for calcul the mask position with numpy : 0.0005056858062744141 nb_pixel_total : 10677 time to create 1 rle with old method : 0.012118816375732422 length of segment : 126 time for calcul the mask position with numpy : 0.0023794174194335938 nb_pixel_total : 107542 time to create 1 rle with old method : 0.11429691314697266 length of segment : 557 time for calcul the mask position with numpy : 0.0005867481231689453 nb_pixel_total : 15613 time to create 1 rle with old method : 0.017789840698242188 length of segment : 157 time for calcul the mask position with numpy : 0.00023245811462402344 nb_pixel_total : 5495 time to create 1 rle with old method : 0.006659507751464844 length of segment : 66 time for calcul the mask position with numpy : 0.0005495548248291016 nb_pixel_total : 11186 time to create 1 rle with old method : 0.018924951553344727 length of segment : 136 time for calcul the mask position with numpy : 0.00045990943908691406 nb_pixel_total : 14649 time to create 1 rle with old method : 0.02470111846923828 length of segment : 111 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 5660 time to create 1 rle with old method : 0.006664276123046875 length of segment : 107 time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 13537 time to create 1 rle with old method : 0.016098976135253906 length of segment : 147 time for calcul the mask position with numpy : 0.05997467041015625 nb_pixel_total : 1485136 time to create 1 rle with new method : 0.3747429847717285 length of segment : 1398 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 2478 time to create 1 rle with old method : 0.002970457077026367 length of segment : 57 time for calcul the mask position with numpy : 0.0004353523254394531 nb_pixel_total : 16436 time to create 1 rle with old method : 0.019134044647216797 length of segment : 159 time for calcul the mask position with numpy : 0.01729440689086914 nb_pixel_total : 1029189 time to create 1 rle with new method : 0.2187962532043457 length of segment : 1072 time for calcul the mask position with numpy : 0.0016973018646240234 nb_pixel_total : 82414 time to create 1 rle with old method : 0.09756731986999512 length of segment : 454 time for calcul the mask position with numpy : 0.0007390975952148438 nb_pixel_total : 28851 time to create 1 rle with old method : 0.03694796562194824 length of segment : 197 time for calcul the mask position with numpy : 0.00030350685119628906 nb_pixel_total : 4661 time to create 1 rle with old method : 0.005571842193603516 length of segment : 120 time for calcul the mask position with numpy : 0.0002593994140625 nb_pixel_total : 5823 time to create 1 rle with old method : 0.0071032047271728516 length of segment : 72 time for calcul the mask position with numpy : 0.0003275871276855469 nb_pixel_total : 5636 time to create 1 rle with old method : 0.0068476200103759766 length of segment : 136 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 6456 time to create 1 rle with old method : 0.007837057113647461 length of segment : 84 time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 13988 time to create 1 rle with old method : 0.016666650772094727 length of segment : 104 time for calcul the mask position with numpy : 0.0005376338958740234 nb_pixel_total : 17131 time to create 1 rle with old method : 0.02290177345275879 length of segment : 70 time for calcul the mask position with numpy : 0.017148494720458984 nb_pixel_total : 677047 time to create 1 rle with new method : 0.03128242492675781 length of segment : 1149 time for calcul the mask position with numpy : 0.00038623809814453125 nb_pixel_total : 9981 time to create 1 rle with old method : 0.01659560203552246 length of segment : 108 time for calcul the mask position with numpy : 0.0024895668029785156 nb_pixel_total : 100677 time to create 1 rle with old method : 0.11196303367614746 length of segment : 544 time for calcul the mask position with numpy : 0.0005247592926025391 nb_pixel_total : 12951 time to create 1 rle with old method : 0.015102863311767578 length of segment : 189 time for calcul the mask position with numpy : 0.0003228187561035156 nb_pixel_total : 8386 time to create 1 rle with old method : 0.009880781173706055 length of segment : 92 time for calcul the mask position with numpy : 0.0010497570037841797 nb_pixel_total : 44334 time to create 1 rle with old method : 0.050549983978271484 length of segment : 238 time for calcul the mask position with numpy : 0.0012061595916748047 nb_pixel_total : 27273 time to create 1 rle with old method : 0.032906532287597656 length of segment : 82 time for calcul the mask position with numpy : 0.0005674362182617188 nb_pixel_total : 15735 time to create 1 rle with old method : 0.018366575241088867 length of segment : 135 time for calcul the mask position with numpy : 0.0006206035614013672 nb_pixel_total : 18922 time to create 1 rle with old method : 0.021883487701416016 length of segment : 279 time for calcul the mask position with numpy : 0.0008730888366699219 nb_pixel_total : 27049 time to create 1 rle with old method : 0.03101515769958496 length of segment : 217 time for calcul the mask position with numpy : 0.0004162788391113281 nb_pixel_total : 10108 time to create 1 rle with old method : 0.012772321701049805 length of segment : 102 time for calcul the mask position with numpy : 0.00022935867309570312 nb_pixel_total : 7368 time to create 1 rle with old method : 0.009012699127197266 length of segment : 69 time for calcul the mask position with numpy : 0.01649308204650879 nb_pixel_total : 772156 time to create 1 rle with new method : 0.023679256439208984 length of segment : 1000 time for calcul the mask position with numpy : 0.00048542022705078125 nb_pixel_total : 6721 time to create 1 rle with old method : 0.010807991027832031 length of segment : 168 time for calcul the mask position with numpy : 0.015074968338012695 nb_pixel_total : 688927 time to create 1 rle with new method : 0.018485069274902344 length of segment : 924 time for calcul the mask position with numpy : 0.0003235340118408203 nb_pixel_total : 9312 time to create 1 rle with old method : 0.010981082916259766 length of segment : 241 time for calcul the mask position with numpy : 0.0004851818084716797 nb_pixel_total : 23165 time to create 1 rle with old method : 0.03421211242675781 length of segment : 160 time for calcul the mask position with numpy : 0.0004258155822753906 nb_pixel_total : 3478 time to create 1 rle with old method : 0.0057828426361083984 length of segment : 74 time for calcul the mask position with numpy : 0.002323627471923828 nb_pixel_total : 101401 time to create 1 rle with old method : 0.11235523223876953 length of segment : 540 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 8095 time to create 1 rle with old method : 0.009428024291992188 length of segment : 116 time for calcul the mask position with numpy : 0.0001976490020751953 nb_pixel_total : 3784 time to create 1 rle with old method : 0.004602193832397461 length of segment : 83 time for calcul the mask position with numpy : 0.0030341148376464844 nb_pixel_total : 118501 time to create 1 rle with old method : 0.13159704208374023 length of segment : 586 time for calcul the mask position with numpy : 0.0003871917724609375 nb_pixel_total : 16250 time to create 1 rle with old method : 0.01871490478515625 length of segment : 190 time for calcul the mask position with numpy : 0.0008301734924316406 nb_pixel_total : 32553 time to create 1 rle with old method : 0.03742837905883789 length of segment : 233 time for calcul the mask position with numpy : 0.0005333423614501953 nb_pixel_total : 18338 time to create 1 rle with old method : 0.020943164825439453 length of segment : 285 time for calcul the mask position with numpy : 0.0003387928009033203 nb_pixel_total : 4723 time to create 1 rle with old method : 0.00569605827331543 length of segment : 129 time for calcul the mask position with numpy : 0.0002894401550292969 nb_pixel_total : 7165 time to create 1 rle with old method : 0.00855112075805664 length of segment : 105 time spent for convertir_results : 4.5527403354644775 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 51 chid ids of type : 3594 Number RLEs to save : 14289 save missing photos in datou_result : time spend for datou_step_exec : 31.804787397384644 time spend to save output : 1.0985796451568604 total time spend for step 1 : 32.903367042541504 step2:crop_condition Fri Aug 22 11:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755854465_3326676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.1516358852386475 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755854470_3326676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0286645889282227 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755854495_3326676 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.807404518127441 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1378493500, 1378493454, 1378493411, 1378493365, 1378493314, 1378493258, 1378492945, 1378492901, 1378492858, 1378492814, 1378492766, 1378492719, 1378492454] Looping around the photos to save general results len do output : 51 /1378499645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1378499818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493500', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493454', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493411', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493365', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493314', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493258', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492945', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492901', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492858', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492814', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492766', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492719', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492454', None, None, None, None, None, '3573928') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 166 time used for this insertion : 0.16458988189697266 save_final save missing photos in datou_result : time spend for datou_step_exec : 39.900543212890625 time spend to save output : 0.16648364067077637 total time spend for step 2 : 40.0670268535614 step3:rle_unique_nms_with_priority Fri Aug 22 11:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.9471921920776367 time for calcul the mask position with numpy : 0.05819368362426758 nb_pixel_total : 1928839 time to create 1 rle with new method : 0.24898838996887207 time for calcul the mask position with numpy : 0.006414890289306641 nb_pixel_total : 6650 time to create 1 rle with old method : 0.007245779037475586 time for calcul the mask position with numpy : 0.007474422454833984 nb_pixel_total : 125553 time to create 1 rle with old method : 0.15467500686645508 time for calcul the mask position with numpy : 0.007205963134765625 nb_pixel_total : 12558 time to create 1 rle with old method : 0.014323949813842773 create new chi : 0.5147185325622559 time to delete rle : 0.029039382934570312 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2702 TO DO : save crop sub photo not yet done ! save time : 0.3328731060028076 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.6499102115631104 time for calcul the mask position with numpy : 0.13952922821044922 nb_pixel_total : 1927868 time to create 1 rle with new method : 0.2791166305541992 time for calcul the mask position with numpy : 0.007546901702880859 nb_pixel_total : 5495 time to create 1 rle with old method : 0.006224632263183594 time for calcul the mask position with numpy : 0.00666356086730957 nb_pixel_total : 15613 time to create 1 rle with old method : 0.01750469207763672 time for calcul the mask position with numpy : 0.0068209171295166016 nb_pixel_total : 107542 time to create 1 rle with old method : 0.14545869827270508 time for calcul the mask position with numpy : 0.006518363952636719 nb_pixel_total : 10677 time to create 1 rle with old method : 0.012124300003051758 time for calcul the mask position with numpy : 0.0066258907318115234 nb_pixel_total : 6405 time to create 1 rle with old method : 0.007213115692138672 create new chi : 0.6528482437133789 time to delete rle : 0.0005056858062744141 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3112 TO DO : save crop sub photo not yet done ! save time : 0.3783879280090332 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05262160301208496 time for calcul the mask position with numpy : 0.02251410484313965 nb_pixel_total : 2062414 time to create 1 rle with new method : 0.10912871360778809 time for calcul the mask position with numpy : 0.006899356842041016 nb_pixel_total : 11186 time to create 1 rle with old method : 0.012492895126342773 create new chi : 0.151289701461792 time to delete rle : 0.0002491474151611328 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1352 TO DO : save crop sub photo not yet done ! save time : 0.20287489891052246 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07542085647583008 time for calcul the mask position with numpy : 0.010677099227905273 nb_pixel_total : 580976 time to create 1 rle with new method : 0.11902093887329102 time for calcul the mask position with numpy : 0.025104522705078125 nb_pixel_total : 1458778 time to create 1 rle with new method : 0.1654973030090332 time for calcul the mask position with numpy : 0.006573677062988281 nb_pixel_total : 13537 time to create 1 rle with old method : 0.015290975570678711 time for calcul the mask position with numpy : 0.006134510040283203 nb_pixel_total : 5660 time to create 1 rle with old method : 0.006370067596435547 time for calcul the mask position with numpy : 0.006795644760131836 nb_pixel_total : 14649 time to create 1 rle with old method : 0.016289234161376953 create new chi : 0.39632272720336914 time to delete rle : 0.0007102489471435547 batch 1 Loaded 10 chid ids of type : 3594 ++++++Number RLEs to save : 4606 TO DO : save crop sub photo not yet done ! save time : 0.550703763961792 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06969833374023438 time for calcul the mask position with numpy : 0.013087034225463867 nb_pixel_total : 959494 time to create 1 rle with new method : 0.3075988292694092 time for calcul the mask position with numpy : 0.006655454635620117 nb_pixel_total : 82414 time to create 1 rle with old method : 0.09165740013122559 time for calcul the mask position with numpy : 0.013129711151123047 nb_pixel_total : 1015256 time to create 1 rle with new method : 0.030037403106689453 time for calcul the mask position with numpy : 0.010072946548461914 nb_pixel_total : 16436 time to create 1 rle with old method : 0.019519567489624023 create new chi : 0.49246907234191895 time to delete rle : 0.0006487369537353516 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 4444 TO DO : save crop sub photo not yet done ! save time : 0.5064313411712646 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.2013988494873047 time for calcul the mask position with numpy : 0.07708263397216797 nb_pixel_total : 2028629 time to create 1 rle with new method : 0.23685216903686523 time for calcul the mask position with numpy : 0.007704734802246094 nb_pixel_total : 5636 time to create 1 rle with old method : 0.007203817367553711 time for calcul the mask position with numpy : 0.0072116851806640625 nb_pixel_total : 5823 time to create 1 rle with old method : 0.007348060607910156 time for calcul the mask position with numpy : 0.0073740482330322266 nb_pixel_total : 4661 time to create 1 rle with old method : 0.0058786869049072266 time for calcul the mask position with numpy : 0.006998300552368164 nb_pixel_total : 28851 time to create 1 rle with old method : 0.032877206802368164 create new chi : 0.4086332321166992 time to delete rle : 0.0003752708435058594 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2130 TO DO : save crop sub photo not yet done ! save time : 0.2537345886230469 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.45609474182128906 time for calcul the mask position with numpy : 0.204970121383667 nb_pixel_total : 1248320 time to create 1 rle with new method : 0.2772200107574463 time for calcul the mask position with numpy : 0.006807565689086914 nb_pixel_total : 100677 time to create 1 rle with old method : 0.1351933479309082 time for calcul the mask position with numpy : 0.006422519683837891 nb_pixel_total : 9981 time to create 1 rle with old method : 0.011256694793701172 time for calcul the mask position with numpy : 0.011668920516967773 nb_pixel_total : 677047 time to create 1 rle with new method : 0.08611655235290527 time for calcul the mask position with numpy : 0.006630420684814453 nb_pixel_total : 17131 time to create 1 rle with old method : 0.019366979598999023 time for calcul the mask position with numpy : 0.006979227066040039 nb_pixel_total : 13988 time to create 1 rle with old method : 0.0157930850982666 time for calcul the mask position with numpy : 0.006463766098022461 nb_pixel_total : 6456 time to create 1 rle with old method : 0.007292747497558594 create new chi : 0.8199703693389893 time to delete rle : 0.0008878707885742188 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 5198 TO DO : save crop sub photo not yet done ! save time : 0.5298235416412354 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04271554946899414 time for calcul the mask position with numpy : 0.020652055740356445 nb_pixel_total : 2052263 time to create 1 rle with new method : 1.4054031372070312 time for calcul the mask position with numpy : 0.005823612213134766 nb_pixel_total : 8386 time to create 1 rle with old method : 0.008917570114135742 time for calcul the mask position with numpy : 0.005861520767211914 nb_pixel_total : 12951 time to create 1 rle with old method : 0.013660669326782227 create new chi : 1.460599422454834 time to delete rle : 0.0002472400665283203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1642 TO DO : save crop sub photo not yet done ! save time : 0.20920681953430176 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06514692306518555 time for calcul the mask position with numpy : 0.06449627876281738 nb_pixel_total : 1967336 time to create 1 rle with new method : 1.0268135070800781 time for calcul the mask position with numpy : 0.0067577362060546875 nb_pixel_total : 18922 time to create 1 rle with old method : 0.021494150161743164 time for calcul the mask position with numpy : 0.0068438053131103516 nb_pixel_total : 15735 time to create 1 rle with old method : 0.017978191375732422 time for calcul the mask position with numpy : 0.006808757781982422 nb_pixel_total : 27273 time to create 1 rle with old method : 0.030711650848388672 time for calcul the mask position with numpy : 0.007010221481323242 nb_pixel_total : 44334 time to create 1 rle with old method : 0.04988217353820801 create new chi : 1.2501685619354248 time to delete rle : 0.0004305839538574219 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2548 TO DO : save crop sub photo not yet done ! save time : 0.3088366985321045 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.4236414432525635 time for calcul the mask position with numpy : 0.03749227523803711 nb_pixel_total : 1256919 time to create 1 rle with new method : 0.5044283866882324 time for calcul the mask position with numpy : 0.011427640914916992 nb_pixel_total : 772156 time to create 1 rle with new method : 0.39334797859191895 time for calcul the mask position with numpy : 0.0063626766204833984 nb_pixel_total : 7368 time to create 1 rle with old method : 0.008121013641357422 time for calcul the mask position with numpy : 0.006030082702636719 nb_pixel_total : 10108 time to create 1 rle with old method : 0.011317968368530273 time for calcul the mask position with numpy : 0.0061604976654052734 nb_pixel_total : 27049 time to create 1 rle with old method : 0.029869556427001953 create new chi : 1.0321245193481445 time to delete rle : 0.0005891323089599609 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3856 TO DO : save crop sub photo not yet done ! save time : 0.28650617599487305 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.2939574718475342 time for calcul the mask position with numpy : 0.04297780990600586 nb_pixel_total : 1345475 time to create 1 rle with new method : 0.3127310276031494 time for calcul the mask position with numpy : 0.0062901973724365234 nb_pixel_total : 23165 time to create 1 rle with old method : 0.025343894958496094 time for calcul the mask position with numpy : 0.005944013595581055 nb_pixel_total : 9312 time to create 1 rle with old method : 0.010265350341796875 time for calcul the mask position with numpy : 0.010715484619140625 nb_pixel_total : 688927 time to create 1 rle with new method : 0.32391905784606934 time for calcul the mask position with numpy : 0.006880044937133789 nb_pixel_total : 6721 time to create 1 rle with old method : 0.007646799087524414 create new chi : 0.7701501846313477 time to delete rle : 0.0007333755493164062 batch 1 Loaded 9 chid ids of type : 3594 +++++++++Number RLEs to save : 4066 TO DO : save crop sub photo not yet done ! save time : 0.3753209114074707 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0632009506225586 time for calcul the mask position with numpy : 0.2003624439239502 nb_pixel_total : 1956842 time to create 1 rle with new method : 0.22308349609375 time for calcul the mask position with numpy : 0.0065457820892333984 nb_pixel_total : 3784 time to create 1 rle with old method : 0.004487037658691406 time for calcul the mask position with numpy : 0.006291627883911133 nb_pixel_total : 8095 time to create 1 rle with old method : 0.009774446487426758 time for calcul the mask position with numpy : 0.006876468658447266 nb_pixel_total : 101401 time to create 1 rle with old method : 0.11192965507507324 time for calcul the mask position with numpy : 0.006079673767089844 nb_pixel_total : 3478 time to create 1 rle with old method : 0.004040718078613281 create new chi : 0.5904319286346436 time to delete rle : 0.0002760887145996094 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2706 TO DO : save crop sub photo not yet done ! save time : 0.37694621086120605 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.1363070011138916 time for calcul the mask position with numpy : 0.5078094005584717 nb_pixel_total : 1876070 time to create 1 rle with new method : 0.467043399810791 time for calcul the mask position with numpy : 0.00636601448059082 nb_pixel_total : 7165 time to create 1 rle with old method : 0.008337259292602539 time for calcul the mask position with numpy : 0.006105661392211914 nb_pixel_total : 4723 time to create 1 rle with old method : 0.005345821380615234 time for calcul the mask position with numpy : 0.0073108673095703125 nb_pixel_total : 18338 time to create 1 rle with old method : 0.022164583206176758 time for calcul the mask position with numpy : 0.006311655044555664 nb_pixel_total : 32553 time to create 1 rle with old method : 0.035950422286987305 time for calcul the mask position with numpy : 0.006524562835693359 nb_pixel_total : 16250 time to create 1 rle with old method : 0.01801013946533203 time for calcul the mask position with numpy : 0.006734371185302734 nb_pixel_total : 118501 time to create 1 rle with old method : 0.12979531288146973 create new chi : 1.2440178394317627 time to delete rle : 0.0006358623504638672 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 4136 TO DO : save crop sub photo not yet done ! save time : 1.5217678546905518 map_output_result : {1378493500: (0.0, 'Should be the crop_list due to order', 0), 1378493454: (0.0, 'Should be the crop_list due to order', 0), 1378493411: (0.0, 'Should be the crop_list due to order', 0), 1378493365: (0.0, 'Should be the crop_list due to order', 0), 1378493314: (0.0, 'Should be the crop_list due to order', 0), 1378493258: (0.0, 'Should be the crop_list due to order', 0), 1378492945: (0.0, 'Should be the crop_list due to order', 0), 1378492901: (0.0, 'Should be the crop_list due to order', 0), 1378492858: (0.0, 'Should be the crop_list due to order', 0), 1378492814: (0.0, 'Should be the crop_list due to order', 0), 1378492766: (0.0, 'Should be the crop_list due to order', 0), 1378492719: (0.0, 'Should be the crop_list due to order', 0), 1378492454: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1378493500, 1378493454, 1378493411, 1378493365, 1378493314, 1378493258, 1378492945, 1378492901, 1378492858, 1378492814, 1378492766, 1378492719, 1378492454] Looping around the photos to save general results len do output : 13 /1378493500.Didn't retrieve data . /1378493454.Didn't retrieve data . /1378493411.Didn't retrieve data . /1378493365.Didn't retrieve data . /1378493314.Didn't retrieve data . /1378493258.Didn't retrieve data . /1378492945.Didn't retrieve data . /1378492901.Didn't retrieve data . /1378492858.Didn't retrieve data . /1378492814.Didn't retrieve data . /1378492766.Didn't retrieve data . /1378492719.Didn't retrieve data . /1378492454.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493500', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493454', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493411', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493365', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493314', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493258', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492945', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492901', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492858', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492814', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492766', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492719', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492454', None, None, None, None, None, '3573928') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.08076357841491699 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.29100465774536 time spend to save output : 0.08121967315673828 total time spend for step 3 : 20.3722243309021 step4:ventilate_hashtags_in_portfolio Fri Aug 22 11:22:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26145859 get user id for portfolio 26145859 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26145859 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','carton','flou','pet_clair','pet_fonce','background','papier','pehd','environnement','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26145859 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','carton','flou','pet_clair','pet_fonce','background','papier','pehd','environnement','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26145859 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','carton','flou','pet_clair','pet_fonce','background','papier','pehd','environnement','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26146001,26146002,26146003,26146004,26146005,26146006,26146007,26146008,26146009,26146010,26146011?tags=autre,carton,flou,pet_clair,pet_fonce,background,papier,pehd,environnement,metal,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1378493500, 1378493454, 1378493411, 1378493365, 1378493314, 1378493258, 1378492945, 1378492901, 1378492858, 1378492814, 1378492766, 1378492719, 1378492454] Looping around the photos to save general results len do output : 1 /26145859. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493500', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493454', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493411', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493365', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493314', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493258', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492945', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492901', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492858', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492814', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492766', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492719', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492454', None, None, None, None, None, '3573928') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.05440330505371094 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.455078363418579 time spend to save output : 0.05468487739562988 total time spend for step 4 : 1.509763240814209 step5:final Fri Aug 22 11:22:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1378493500: ('0.21387386485042736',), 1378493454: ('0.21387386485042736',), 1378493411: ('0.21387386485042736',), 1378493365: ('0.21387386485042736',), 1378493314: ('0.21387386485042736',), 1378493258: ('0.21387386485042736',), 1378492945: ('0.21387386485042736',), 1378492901: ('0.21387386485042736',), 1378492858: ('0.21387386485042736',), 1378492814: ('0.21387386485042736',), 1378492766: ('0.21387386485042736',), 1378492719: ('0.21387386485042736',), 1378492454: ('0.21387386485042736',)} new output for save of step final : {1378493500: ('0.21387386485042736',), 1378493454: ('0.21387386485042736',), 1378493411: ('0.21387386485042736',), 1378493365: ('0.21387386485042736',), 1378493314: ('0.21387386485042736',), 1378493258: ('0.21387386485042736',), 1378492945: ('0.21387386485042736',), 1378492901: ('0.21387386485042736',), 1378492858: ('0.21387386485042736',), 1378492814: ('0.21387386485042736',), 1378492766: ('0.21387386485042736',), 1378492719: ('0.21387386485042736',), 1378492454: ('0.21387386485042736',)} [1378493500, 1378493454, 1378493411, 1378493365, 1378493314, 1378493258, 1378492945, 1378492901, 1378492858, 1378492814, 1378492766, 1378492719, 1378492454] Looping around the photos to save general results len do output : 13 /1378493500.Didn't retrieve data . /1378493454.Didn't retrieve data . /1378493411.Didn't retrieve data . /1378493365.Didn't retrieve data . /1378493314.Didn't retrieve data . /1378493258.Didn't retrieve data . /1378492945.Didn't retrieve data . /1378492901.Didn't retrieve data . /1378492858.Didn't retrieve data . /1378492814.Didn't retrieve data . /1378492766.Didn't retrieve data . /1378492719.Didn't retrieve data . /1378492454.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493500', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493454', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493411', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493365', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493314', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493258', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492945', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492901', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492858', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492814', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492766', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492719', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492454', None, None, None, None, None, '3573928') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.04717731475830078 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.21236419677734375 time spend to save output : 0.04779672622680664 total time spend for step 5 : 0.2601609230041504 step6:blur_detection Fri Aug 22 11:22:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755854428_3326676_1378493500_b182c1a12ff689f26c8958dea40663d1.jpg resize: (1080, 1920) 1378493500 -2.803508683902003 treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124.jpg resize: (1080, 1920) 1378493454 -0.7263561480503593 treat image : temp/1755854428_3326676_1378493411_9071066584803856d3bd3c3a7708eb85.jpg resize: (1080, 1920) 1378493411 0.7021243167279058 treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6.jpg resize: (1080, 1920) 1378493365 1.1612837900076451 treat image : temp/1755854428_3326676_1378493314_10dd986777c141b11e5d2df052701b99.jpg resize: (1080, 1920) 1378493314 1.5699539769756758 treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700.jpg resize: (1080, 1920) 1378493258 0.2073181503517582 treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4.jpg resize: (1080, 1920) 1378492945 2.4716908418039205 treat image : temp/1755854428_3326676_1378492901_b52e3613b0904a611acea4eff9a973a7.jpg resize: (1080, 1920) 1378492901 0.7379736554567692 treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39.jpg resize: (1080, 1920) 1378492858 2.3550571768779176 treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca.jpg resize: (1080, 1920) 1378492814 0.8505213240621815 treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d.jpg resize: (1080, 1920) 1378492766 2.3597099623253923 treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2.jpg resize: (1080, 1920) 1378492719 0.7873763325805339 treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e.jpg resize: (1080, 1920) 1378492454 -2.884255634866169 treat image : temp/1755854428_3326676_1378493500_b182c1a12ff689f26c8958dea40663d1_rle_crop_3925038595_0.png resize: (83, 181) 1378499645 -1.6259202299616604 treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038598_0.png resize: (110, 110) 1378499646 -1.607116581480533 treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038599_0.png resize: (123, 152) 1378499647 -0.763875632698327 treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038602_0.png resize: (66, 122) 1378499648 -1.8554967689862314 treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038604_0.png resize: (110, 162) 1378499649 1.1802421650252775 treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038605_0.png resize: (107, 70) 1378499650 0.08145501406329468 treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038608_0.png resize: (56, 65) 1378499651 0.789922241339707 treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700_rle_crop_3925038612_0.png resize: (172, 208) 1378499652 -0.7659524271331765 treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700_rle_crop_3925038614_0.png resize: (72, 106) 1378499653 0.9798732978883912 treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700_rle_crop_3925038615_0.png resize: (136, 106) 1378499654 -2.246214373632046 treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038617_0.png resize: (101, 221) 1378499655 -0.03457433326553615 treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038620_0.png resize: (107, 152) 1378499656 -1.406049836188862 treat image : temp/1755854428_3326676_1378492901_b52e3613b0904a611acea4eff9a973a7_rle_crop_3925038622_0.png resize: (188, 123) 1378499657 -0.2714332044407108 treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca_rle_crop_3925038628_0.png resize: (211, 217) 1378499658 0.01470154651884947 treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d_rle_crop_3925038632_0.png resize: (168, 84) 1378499659 -2.0542201333086525 treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d_rle_crop_3925038634_0.png resize: (125, 149) 1378499660 -2.317787077598405 treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2_rle_crop_3925038636_0.png resize: (74, 106) 1378499661 -1.6675803629966308 treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2_rle_crop_3925038638_0.png resize: (112, 114) 1378499662 -1.569887626218206 treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2_rle_crop_3925038639_0.png resize: (83, 65) 1378499663 -1.0962384251013808 treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038644_0.png resize: (128, 77) 1378499664 -1.593886447070318 treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700_rle_crop_3925038613_0.png resize: (118, 66) 1378499669 -2.6082813025057083 treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39_rle_crop_3925038624_0.png resize: (236, 285) 1378499670 -0.7683719551028326 treat image : temp/1755854428_3326676_1378493500_b182c1a12ff689f26c8958dea40663d1_rle_crop_3925038596_0.png resize: (575, 359) 1378499767 0.3466860899662882 treat image : temp/1755854428_3326676_1378493500_b182c1a12ff689f26c8958dea40663d1_rle_crop_3925038597_0.png resize: (99, 112) 1378499768 -3.000837859190063 treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038600_0.png resize: (545, 330) 1378499771 0.14805655010267973 treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038601_0.png resize: (140, 129) 1378499772 -2.2071914968183783 treat image : temp/1755854428_3326676_1378493411_9071066584803856d3bd3c3a7708eb85_rle_crop_3925038603_0.png resize: (135, 113) 1378499773 -2.581300310728842 treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038606_0.png resize: (133, 131) 1378499776 -1.8315766140397816 treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038607_0.png resize: (1004, 1604) 1378499777 -0.5609653187149659 treat image : temp/1755854428_3326676_1378493314_10dd986777c141b11e5d2df052701b99_rle_crop_3925038609_0.png resize: (142, 147) 1378499779 -2.4730135454532065 treat image : temp/1755854428_3326676_1378493314_10dd986777c141b11e5d2df052701b99_rle_crop_3925038610_0.png resize: (942, 1303) 1378499781 0.05794846478596414 treat image : temp/1755854428_3326676_1378493314_10dd986777c141b11e5d2df052701b99_rle_crop_3925038611_0.png resize: (460, 338) 1378499782 -0.23313462556740347 treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038616_0.png resize: (84, 117) 1378499785 -0.522656624089151 treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038618_0.png resize: (65, 375) 1378499787 0.15031366337132948 treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038619_0.png resize: (959, 1067) 1378499789 0.7273229188748611 treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038621_0.png resize: (536, 320) 1378499792 0.20436840828136565 treat image : temp/1755854428_3326676_1378492901_b52e3613b0904a611acea4eff9a973a7_rle_crop_3925038623_0.png resize: (92, 153) 1378499793 -4.044835261884222 treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39_rle_crop_3925038625_0.png resize: (77, 542) 1378499794 -2.4742912645282003 treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39_rle_crop_3925038626_0.png resize: (135, 148) 1378499797 -0.09284138243429493 treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39_rle_crop_3925038627_0.png resize: (188, 133) 1378499798 -1.9414157705108714 treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca_rle_crop_3925038629_0.png resize: (101, 118) 1378499800 -1.4779334071482624 treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca_rle_crop_3925038630_0.png resize: (68, 158) 1378499802 -1.4859169047021141 treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca_rle_crop_3925038631_0.png resize: (996, 1106) 1378499803 0.26103450084027413 treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d_rle_crop_3925038633_0.png resize: (886, 1011) 1378499806 0.669334231821156 treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d_rle_crop_3925038635_0.png resize: (158, 260) 1378499808 -0.3740509109741898 treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2_rle_crop_3925038637_0.png resize: (525, 340) 1378499809 -0.07033203164194152 treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038640_0.png resize: (572, 345) 1378499811 0.2640513419554344 treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038641_0.png resize: (146, 156) 1378499813 -4.267767997401887 treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038642_0.png resize: (220, 221) 1378499814 -4.182847025055702 treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038643_0.png resize: (141, 224) 1378499816 -3.6917869776987975 treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038645_0.png resize: (100, 87) 1378499818 -1.0699407507829772 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 64 time used for this insertion : 0.01638197898864746 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 64 time used for this insertion : 0.27475881576538086 save missing photos in datou_result : time spend for datou_step_exec : 13.08826470375061 time spend to save output : 0.2965676784515381 total time spend for step 6 : 13.384832382202148 step7:brightness Fri Aug 22 11:22:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755854428_3326676_1378493500_b182c1a12ff689f26c8958dea40663d1.jpg treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124.jpg treat image : temp/1755854428_3326676_1378493411_9071066584803856d3bd3c3a7708eb85.jpg treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6.jpg treat image : temp/1755854428_3326676_1378493314_10dd986777c141b11e5d2df052701b99.jpg treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700.jpg treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4.jpg treat image : temp/1755854428_3326676_1378492901_b52e3613b0904a611acea4eff9a973a7.jpg treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39.jpg treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca.jpg treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d.jpg treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2.jpg treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e.jpg treat image : temp/1755854428_3326676_1378493500_b182c1a12ff689f26c8958dea40663d1_rle_crop_3925038595_0.png treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038598_0.png treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038599_0.png treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038602_0.png treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038604_0.png treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038605_0.png treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038608_0.png treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700_rle_crop_3925038612_0.png treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700_rle_crop_3925038614_0.png treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700_rle_crop_3925038615_0.png treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038617_0.png treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038620_0.png treat image : temp/1755854428_3326676_1378492901_b52e3613b0904a611acea4eff9a973a7_rle_crop_3925038622_0.png treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca_rle_crop_3925038628_0.png treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d_rle_crop_3925038632_0.png treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d_rle_crop_3925038634_0.png treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2_rle_crop_3925038636_0.png treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2_rle_crop_3925038638_0.png treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2_rle_crop_3925038639_0.png treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038644_0.png treat image : temp/1755854428_3326676_1378493258_c9d107d70334baf4a91b5751227df700_rle_crop_3925038613_0.png treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39_rle_crop_3925038624_0.png treat image : temp/1755854428_3326676_1378493500_b182c1a12ff689f26c8958dea40663d1_rle_crop_3925038596_0.png treat image : temp/1755854428_3326676_1378493500_b182c1a12ff689f26c8958dea40663d1_rle_crop_3925038597_0.png treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038600_0.png treat image : temp/1755854428_3326676_1378493454_389eb834256a0425672e267667233124_rle_crop_3925038601_0.png treat image : temp/1755854428_3326676_1378493411_9071066584803856d3bd3c3a7708eb85_rle_crop_3925038603_0.png treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038606_0.png treat image : temp/1755854428_3326676_1378493365_724ea7fa811bea75d23a1dfb47d2e9e6_rle_crop_3925038607_0.png treat image : temp/1755854428_3326676_1378493314_10dd986777c141b11e5d2df052701b99_rle_crop_3925038609_0.png treat image : temp/1755854428_3326676_1378493314_10dd986777c141b11e5d2df052701b99_rle_crop_3925038610_0.png treat image : temp/1755854428_3326676_1378493314_10dd986777c141b11e5d2df052701b99_rle_crop_3925038611_0.png treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038616_0.png treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038618_0.png treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038619_0.png treat image : temp/1755854428_3326676_1378492945_2ef32ab290350eb1465678b0cb7b3ec4_rle_crop_3925038621_0.png treat image : temp/1755854428_3326676_1378492901_b52e3613b0904a611acea4eff9a973a7_rle_crop_3925038623_0.png treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39_rle_crop_3925038625_0.png treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39_rle_crop_3925038626_0.png treat image : temp/1755854428_3326676_1378492858_0c25a56c6cbe4a518aac44b69afd6d39_rle_crop_3925038627_0.png treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca_rle_crop_3925038629_0.png treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca_rle_crop_3925038630_0.png treat image : temp/1755854428_3326676_1378492814_1692e481864ab7dfc503b4ec62fd62ca_rle_crop_3925038631_0.png treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d_rle_crop_3925038633_0.png treat image : temp/1755854428_3326676_1378492766_2f1e6a988a76be41d98b5ada561a368d_rle_crop_3925038635_0.png treat image : temp/1755854428_3326676_1378492719_c98e08fdebad6caede26486414eacaa2_rle_crop_3925038637_0.png treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038640_0.png treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038641_0.png treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038642_0.png treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038643_0.png treat image : temp/1755854428_3326676_1378492454_77798a00d4b6d6ecc500bb04f5ab2a8e_rle_crop_3925038645_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 64 time used for this insertion : 0.016937971115112305 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 64 time used for this insertion : 0.22889137268066406 save missing photos in datou_result : time spend for datou_step_exec : 3.6401631832122803 time spend to save output : 0.2503359317779541 total time spend for step 7 : 3.8904991149902344 step8:velours_tree Fri Aug 22 11:22:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09238100051879883 time spend to save output : 5.316734313964844e-05 total time spend for step 8 : 0.09243416786193848 step9:send_mail_cod Fri Aug 22 11:22:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26145859_22-08-2025_11_22_22.pdf 26146001 imagette261460011755854542 26146002 change filename to text .change filename to text .imagette261460021755854542 26146003 imagette261460031755854542 26146004 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette261460041755854542 26146005 imagette261460051755854544 26146006 imagette261460061755854544 26146007 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette261460071755854544 26146008 imagette261460081755854545 26146010 imagette261460101755854545 26146011 imagette261460111755854545 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26145859 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26146001,26146002,26146003,26146004,26146005,26146006,26146007,26146008,26146009,26146010,26146011?tags=autre,carton,flou,pet_clair,pet_fonce,background,papier,pehd,environnement,metal,mal_croppe args[1378493500] : ((1378493500, -2.803508683902003, 492609224), (1378493500, 0.7237662777163694, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378493454] : ((1378493454, -0.7263561480503593, 492688767), (1378493454, 0.5029524227339058, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378493411] : ((1378493411, 0.7021243167279058, 492688767), (1378493411, 0.9408084068214578, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378493365] : ((1378493365, 1.1612837900076451, 492688767), (1378493365, 0.742166789020104, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378493314] : ((1378493314, 1.5699539769756758, 492688767), (1378493314, 0.3693258741170335, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378493258] : ((1378493258, 0.2073181503517582, 492688767), (1378493258, 0.8783906534510454, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378492945] : ((1378492945, 2.4716908418039205, 492688767), (1378492945, 0.8674054242620151, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378492901] : ((1378492901, 0.7379736554567692, 492688767), (1378492901, 0.6811591826939245, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378492858] : ((1378492858, 2.3550571768779176, 492688767), (1378492858, 0.42443143957375734, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378492814] : ((1378492814, 0.8505213240621815, 492688767), (1378492814, 0.6349053805378901, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378492766] : ((1378492766, 2.3597099623253923, 492688767), (1378492766, 0.6760638669451291, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378492719] : ((1378492719, 0.7873763325805339, 492688767), (1378492719, 0.9149070503561545, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com args[1378492454] : ((1378492454, -2.884255634866169, 492609224), (1378492454, 0.5446868641050119, 2107752395), '0.21387386485042736') We are sending mail with results at report@fotonower.com refus_total : 0.21387386485042736 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26145859 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26145859_22-08-2025_11_22_22.pdf results_Auto_P26145859_22-08-2025_11_22_22.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26145859_22-08-2025_11_22_22.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26145859','results_Auto_P26145859_22-08-2025_11_22_22.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26145859_22-08-2025_11_22_22.pdf','pdf','','0.39','0.21387386485042736') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26145859

https://www.fotonower.com/image?json=false&list_photos_id=1378493500
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378493454
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378493411
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378493365
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1612837900076451)
https://www.fotonower.com/image?json=false&list_photos_id=1378493314
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5699539769756758)
https://www.fotonower.com/image?json=false&list_photos_id=1378493258
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378492945
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.4716908418039205)
https://www.fotonower.com/image?json=false&list_photos_id=1378492901
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378492858
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.3550571768779176)
https://www.fotonower.com/image?json=false&list_photos_id=1378492814
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378492766
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.3597099623253923)
https://www.fotonower.com/image?json=false&list_photos_id=1378492719
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1378492454
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 21.39%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26146002?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26146004?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26146007?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26145859_22-08-2025_11_22_22.pdf.

Lien vers velours :https://www.fotonower.com/velours/26146001,26146002,26146003,26146004,26146005,26146006,26146007,26146008,26146009,26146010,26146011?tags=autre,carton,flou,pet_clair,pet_fonce,background,papier,pehd,environnement,metal,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 22 Aug 2025 09:22:27 GMT Content-Length: 0 Connection: close X-Message-Id: Rk8w2F_rQ9OCwQ1iPivvtw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1378493500, 1378493454, 1378493411, 1378493365, 1378493314, 1378493258, 1378492945, 1378492901, 1378492858, 1378492814, 1378492766, 1378492719, 1378492454] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493500', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493454', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493411', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493365', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493314', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493258', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492945', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492901', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492858', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492814', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492766', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492719', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492454', None, None, None, None, None, '3573928') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.0605626106262207 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.813613414764404 time spend to save output : 0.06094861030578613 total time spend for step 9 : 4.87456202507019 step10:split_time_score Fri Aug 22 11:22:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 8), ('11', 5)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22082025 26145859 Nombre de photos uploadées : 13 / 23040 (0%) 22082025 26145859 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 22082025 26145859 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 9.298324584960938e-06 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0011076927185058594 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24026799201965332 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.053570387517146746 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26141104_22-08-2025_09_21_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26141104 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26141104 AND mptpi.`type`=3594 To do Qualite : 0.16548168572984748 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26143316_22-08-2025_10_12_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26143316 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26143316 AND mptpi.`type`=3594 To do Qualite : 0.16004099151234566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26143317_22-08-2025_10_01_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26143317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26143317 AND mptpi.`type`=3594 To do Qualite : 0.1262686011904762 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26143318_22-08-2025_09_51_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26143318 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26143318 AND mptpi.`type`=3594 To do Qualite : 0.062375230409808004 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26143320_22-08-2025_11_12_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26143320 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26143320 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26144654 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26144656 order by id desc limit 1 Qualite : 0.21387386485042736 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26145859_22-08-2025_11_22_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26145859 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26145859 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22082025': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1378493500, 1378493454, 1378493411, 1378493365, 1378493314, 1378493258, 1378492945, 1378492901, 1378492858, 1378492814, 1378492766, 1378492719, 1378492454] Looping around the photos to save general results len do output : 1 /26145859Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493500', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493454', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493411', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493365', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493314', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378493258', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492945', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492901', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492858', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492814', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492766', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492719', None, None, None, None, None, '3573928') ('3318', None, None, None, None, None, None, None, '3573928') ('3318', '26145859', '1378492454', None, None, None, None, None, '3573928') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.015972614288330078 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.778494358062744 time spend to save output : 0.01635265350341797 total time spend for step 10 : 2.794847011566162 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 66.62user 30.90system 2:05.03elapsed 78%CPU (0avgtext+0avgdata 2851972maxresident)k 503504inputs+33752outputs (41major+1821106minor)pagefaults 0swaps