python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 150631 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3611870'] with mtr_portfolio_ids : ['26260990'] and first list_photo_ids : [] new path : /proc/150631/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 1.5624902248382568 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Aug 27 13:00:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6830 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-27 13:00:33.641192: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-27 13:00:33.664579: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-27 13:00:33.666541: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f89d4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-27 13:00:33.666585: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-27 13:00:33.669960: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-27 13:00:33.799138: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1249a050 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-27 13:00:33.799180: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-27 13:00:33.800294: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-27 13:00:33.800645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-27 13:00:33.803294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-27 13:00:33.805785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-27 13:00:33.806246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-27 13:00:33.809269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-27 13:00:33.810425: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-27 13:00:33.814258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-27 13:00:33.815406: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-27 13:00:33.815461: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-27 13:00:33.816120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-27 13:00:33.816135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-27 13:00:33.816143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-27 13:00:33.817322: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6134 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-27 13:00:34.075039: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-27 13:00:34.075150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-27 13:00:34.075183: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-27 13:00:34.075211: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-27 13:00:34.075240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-27 13:00:34.075268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-27 13:00:34.075295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-27 13:00:34.075322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-27 13:00:34.077088: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-27 13:00:34.078195: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-27 13:00:34.078232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-27 13:00:34.078248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-27 13:00:34.078263: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-27 13:00:34.078277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-27 13:00:34.078290: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-27 13:00:34.078303: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-27 13:00:34.078316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-27 13:00:34.079293: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-27 13:00:34.079319: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-27 13:00:34.079328: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-27 13:00:34.079335: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-27 13:00:34.080432: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6134 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-27 13:00:42.039530: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-27 13:00:42.230542: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-27 13:00:43.725579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:43.726200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:43.726779: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:43.727494: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:43.728100: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:43.728722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:44.073634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.37G (3614021120 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:44.073735: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-08-27 13:00:44.142901: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:44.143003: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-27 13:00:44.144131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:44.144162: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-27 13:00:44.147140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:44.147181: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-27 13:00:44.148217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-27 13:00:44.148246: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.08GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 151224 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 742 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5637 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00018358230590820312 nb_pixel_total : 3564 time to create 1 rle with old method : 0.0043697357177734375 length of segment : 58 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 3443 time to create 1 rle with old method : 0.004190921783447266 length of segment : 93 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 15139 time to create 1 rle with old method : 0.01784348487854004 length of segment : 130 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 6829 time to create 1 rle with old method : 0.008321285247802734 length of segment : 92 time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 15087 time to create 1 rle with old method : 0.019692182540893555 length of segment : 175 time for calcul the mask position with numpy : 0.0003898143768310547 nb_pixel_total : 13060 time to create 1 rle with old method : 0.019904136657714844 length of segment : 184 time for calcul the mask position with numpy : 0.00020885467529296875 nb_pixel_total : 6951 time to create 1 rle with old method : 0.010781049728393555 length of segment : 85 time for calcul the mask position with numpy : 0.0002956390380859375 nb_pixel_total : 13321 time to create 1 rle with old method : 0.01540374755859375 length of segment : 181 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 4017 time to create 1 rle with old method : 0.0047647953033447266 length of segment : 80 time for calcul the mask position with numpy : 0.0004210472106933594 nb_pixel_total : 12813 time to create 1 rle with old method : 0.015290021896362305 length of segment : 236 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 3844 time to create 1 rle with old method : 0.004836320877075195 length of segment : 102 time for calcul the mask position with numpy : 0.0001857280731201172 nb_pixel_total : 7446 time to create 1 rle with old method : 0.008629798889160156 length of segment : 127 time for calcul the mask position with numpy : 0.0002334117889404297 nb_pixel_total : 14974 time to create 1 rle with old method : 0.017804861068725586 length of segment : 88 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 4517 time to create 1 rle with old method : 0.005372524261474609 length of segment : 85 time for calcul the mask position with numpy : 0.00030994415283203125 nb_pixel_total : 21730 time to create 1 rle with old method : 0.02509021759033203 length of segment : 119 time for calcul the mask position with numpy : 0.0001380443572998047 nb_pixel_total : 4706 time to create 1 rle with old method : 0.0057942867279052734 length of segment : 80 time for calcul the mask position with numpy : 0.002286195755004883 nb_pixel_total : 123524 time to create 1 rle with old method : 0.1366879940032959 length of segment : 615 time for calcul the mask position with numpy : 0.0001773834228515625 nb_pixel_total : 8162 time to create 1 rle with old method : 0.009588003158569336 length of segment : 124 time for calcul the mask position with numpy : 0.00027370452880859375 nb_pixel_total : 11197 time to create 1 rle with old method : 0.013090848922729492 length of segment : 188 time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 5816 time to create 1 rle with old method : 0.007017612457275391 length of segment : 85 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 3624 time to create 1 rle with old method : 0.004462242126464844 length of segment : 45 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 2709 time to create 1 rle with old method : 0.0033457279205322266 length of segment : 63 time for calcul the mask position with numpy : 0.0001499652862548828 nb_pixel_total : 5638 time to create 1 rle with old method : 0.006526470184326172 length of segment : 130 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 8547 time to create 1 rle with old method : 0.010164022445678711 length of segment : 124 time for calcul the mask position with numpy : 0.0002753734588623047 nb_pixel_total : 9313 time to create 1 rle with old method : 0.010926485061645508 length of segment : 132 time for calcul the mask position with numpy : 0.00016498565673828125 nb_pixel_total : 8053 time to create 1 rle with old method : 0.0095672607421875 length of segment : 138 time for calcul the mask position with numpy : 0.00013566017150878906 nb_pixel_total : 6286 time to create 1 rle with old method : 0.007387399673461914 length of segment : 169 time for calcul the mask position with numpy : 0.0001709461212158203 nb_pixel_total : 9443 time to create 1 rle with old method : 0.011163711547851562 length of segment : 125 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 5953 time to create 1 rle with old method : 0.007280588150024414 length of segment : 78 time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 7897 time to create 1 rle with old method : 0.009120464324951172 length of segment : 118 time for calcul the mask position with numpy : 0.00015807151794433594 nb_pixel_total : 7948 time to create 1 rle with old method : 0.009804487228393555 length of segment : 157 time for calcul the mask position with numpy : 0.0001125335693359375 nb_pixel_total : 4362 time to create 1 rle with old method : 0.005108833312988281 length of segment : 92 time for calcul the mask position with numpy : 0.0001251697540283203 nb_pixel_total : 5145 time to create 1 rle with old method : 0.00615692138671875 length of segment : 100 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 19495 time to create 1 rle with old method : 0.02198624610900879 length of segment : 245 time for calcul the mask position with numpy : 0.0019080638885498047 nb_pixel_total : 121378 time to create 1 rle with old method : 0.1396629810333252 length of segment : 559 time for calcul the mask position with numpy : 0.00022363662719726562 nb_pixel_total : 12957 time to create 1 rle with old method : 0.014867782592773438 length of segment : 109 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 3641 time to create 1 rle with old method : 0.004411458969116211 length of segment : 57 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 4530 time to create 1 rle with old method : 0.005370616912841797 length of segment : 76 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 9633 time to create 1 rle with old method : 0.0112457275390625 length of segment : 130 time for calcul the mask position with numpy : 0.0002753734588623047 nb_pixel_total : 15171 time to create 1 rle with old method : 0.01739811897277832 length of segment : 133 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 3020 time to create 1 rle with old method : 0.003701925277709961 length of segment : 55 time for calcul the mask position with numpy : 0.0002536773681640625 nb_pixel_total : 12712 time to create 1 rle with old method : 0.01844000816345215 length of segment : 124 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 2865 time to create 1 rle with old method : 0.0036156177520751953 length of segment : 51 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 9279 time to create 1 rle with old method : 0.010726451873779297 length of segment : 185 time for calcul the mask position with numpy : 0.00015664100646972656 nb_pixel_total : 5450 time to create 1 rle with old method : 0.00646209716796875 length of segment : 74 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 2141 time to create 1 rle with old method : 0.002694368362426758 length of segment : 49 time for calcul the mask position with numpy : 0.0002117156982421875 nb_pixel_total : 14763 time to create 1 rle with old method : 0.01735663414001465 length of segment : 145 time for calcul the mask position with numpy : 0.00037932395935058594 nb_pixel_total : 21008 time to create 1 rle with old method : 0.030979633331298828 length of segment : 218 time spent for convertir_results : 1.9744091033935547 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 48 chid ids of type : 3594 Number RLEs to save : 6608 save missing photos in datou_result : time spend for datou_step_exec : 25.847347259521484 time spend to save output : 0.7762477397918701 total time spend for step 1 : 26.623594999313354 step2:crop_condition Wed Aug 27 13:00:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 48 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3736932 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756292459_150631 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 31 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.974567413330078 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756292468_150631 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7714359760284424 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756292469_150631 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5859615802764893 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756292472_150631 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.6162776947021484 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756292476_150631 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7314403057098389 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379633763, 1379633760, 1379633724, 1379633669, 1379633666, 1379633657, 1379633654, 1379633638, 1379633483, 1379633449, 1379633443, 1379633440] Looping around the photos to save general results len do output : 48 /1379662464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379662516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633763', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633760', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633724', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633669', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633666', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633657', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633654', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633638', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633483', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633449', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633443', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633440', None, None, None, None, None, '3611870') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 156 time used for this insertion : 0.37413835525512695 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.22548747062683 time spend to save output : 0.3762242794036865 total time spend for step 2 : 19.601711750030518 step3:rle_unique_nms_with_priority Wed Aug 27 13:01:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 48 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.6374585628509521 time for calcul the mask position with numpy : 0.3533923625946045 nb_pixel_total : 2066593 time to create 1 rle with new method : 0.07494950294494629 time for calcul the mask position with numpy : 0.006571054458618164 nb_pixel_total : 3443 time to create 1 rle with old method : 0.0037484169006347656 time for calcul the mask position with numpy : 0.006381034851074219 nb_pixel_total : 3564 time to create 1 rle with old method : 0.0038535594940185547 create new chi : 0.4597651958465576 time to delete rle : 0.02114701271057129 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1382 TO DO : save crop sub photo not yet done ! save time : 0.12172842025756836 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.6598789691925049 time for calcul the mask position with numpy : 0.09264421463012695 nb_pixel_total : 1990465 time to create 1 rle with new method : 0.07682538032531738 time for calcul the mask position with numpy : 0.006196737289428711 nb_pixel_total : 8731 time to create 1 rle with old method : 0.009604930877685547 time for calcul the mask position with numpy : 0.005895376205444336 nb_pixel_total : 4017 time to create 1 rle with old method : 0.004488706588745117 time for calcul the mask position with numpy : 0.007906198501586914 nb_pixel_total : 13321 time to create 1 rle with old method : 0.014607906341552734 time for calcul the mask position with numpy : 0.006545543670654297 nb_pixel_total : 6951 time to create 1 rle with old method : 0.0074579715728759766 time for calcul the mask position with numpy : 0.0061702728271484375 nb_pixel_total : 13060 time to create 1 rle with old method : 0.014125585556030273 time for calcul the mask position with numpy : 0.006032705307006836 nb_pixel_total : 15087 time to create 1 rle with old method : 0.016539812088012695 time for calcul the mask position with numpy : 0.006128549575805664 nb_pixel_total : 6829 time to create 1 rle with old method : 0.007355928421020508 time for calcul the mask position with numpy : 0.006131172180175781 nb_pixel_total : 15139 time to create 1 rle with old method : 0.016674041748046875 create new chi : 0.32227540016174316 time to delete rle : 0.00042057037353515625 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 3365 TO DO : save crop sub photo not yet done ! save time : 0.25330471992492676 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032949209213256836 time for calcul the mask position with numpy : 0.02044200897216797 nb_pixel_total : 2069756 time to create 1 rle with new method : 0.029329776763916016 time for calcul the mask position with numpy : 0.010194063186645508 nb_pixel_total : 3844 time to create 1 rle with old method : 0.004430532455444336 create new chi : 0.06465744972229004 time to delete rle : 0.0003917217254638672 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1284 TO DO : save crop sub photo not yet done ! save time : 0.23810577392578125 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.3236057758331299 time for calcul the mask position with numpy : 0.18682551383972168 nb_pixel_total : 2027781 time to create 1 rle with new method : 0.07592320442199707 time for calcul the mask position with numpy : 0.0062999725341796875 nb_pixel_total : 18882 time to create 1 rle with old method : 0.02162790298461914 time for calcul the mask position with numpy : 0.006258726119995117 nb_pixel_total : 4517 time to create 1 rle with old method : 0.005205631256103516 time for calcul the mask position with numpy : 0.0063419342041015625 nb_pixel_total : 14974 time to create 1 rle with old method : 0.016889095306396484 time for calcul the mask position with numpy : 0.0064237117767333984 nb_pixel_total : 7446 time to create 1 rle with old method : 0.008330821990966797 create new chi : 0.35117340087890625 time to delete rle : 0.00030040740966796875 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1834 TO DO : save crop sub photo not yet done ! save time : 0.496859073638916 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.061058759689331055 time for calcul the mask position with numpy : 0.5978386402130127 nb_pixel_total : 1926011 time to create 1 rle with new method : 0.08595132827758789 time for calcul the mask position with numpy : 0.006032228469848633 nb_pixel_total : 11197 time to create 1 rle with old method : 0.012691497802734375 time for calcul the mask position with numpy : 0.006312131881713867 nb_pixel_total : 8162 time to create 1 rle with old method : 0.008901119232177734 time for calcul the mask position with numpy : 0.00719904899597168 nb_pixel_total : 123524 time to create 1 rle with old method : 0.1329817771911621 time for calcul the mask position with numpy : 0.0060214996337890625 nb_pixel_total : 4706 time to create 1 rle with old method : 0.0052642822265625 create new chi : 0.8800876140594482 time to delete rle : 0.0004482269287109375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3094 TO DO : save crop sub photo not yet done ! save time : 0.22897982597351074 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.0816190242767334 time for calcul the mask position with numpy : 0.3633284568786621 nb_pixel_total : 2047266 time to create 1 rle with new method : 0.1930532455444336 time for calcul the mask position with numpy : 0.0065152645111083984 nb_pixel_total : 8547 time to create 1 rle with old method : 0.009933948516845703 time for calcul the mask position with numpy : 0.006448507308959961 nb_pixel_total : 5638 time to create 1 rle with old method : 0.006777286529541016 time for calcul the mask position with numpy : 0.006857395172119141 nb_pixel_total : 2709 time to create 1 rle with old method : 0.0034835338592529297 time for calcul the mask position with numpy : 0.006334066390991211 nb_pixel_total : 3624 time to create 1 rle with old method : 0.00446629524230957 time for calcul the mask position with numpy : 0.006903171539306641 nb_pixel_total : 5816 time to create 1 rle with old method : 0.007714748382568359 create new chi : 0.634784460067749 time to delete rle : 0.00037932395935058594 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 1974 TO DO : save crop sub photo not yet done ! save time : 0.16611933708190918 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.36388301849365234 time for calcul the mask position with numpy : 0.05729413032531738 nb_pixel_total : 2014345 time to create 1 rle with new method : 0.16907405853271484 time for calcul the mask position with numpy : 0.006131887435913086 nb_pixel_total : 4362 time to create 1 rle with old method : 0.0046062469482421875 time for calcul the mask position with numpy : 0.0059053897857666016 nb_pixel_total : 7948 time to create 1 rle with old method : 0.01152944564819336 time for calcul the mask position with numpy : 0.006573677062988281 nb_pixel_total : 7897 time to create 1 rle with old method : 0.012630462646484375 time for calcul the mask position with numpy : 0.00678706169128418 nb_pixel_total : 5953 time to create 1 rle with old method : 0.00962376594543457 time for calcul the mask position with numpy : 0.006666660308837891 nb_pixel_total : 9443 time to create 1 rle with old method : 0.015140295028686523 time for calcul the mask position with numpy : 0.006833076477050781 nb_pixel_total : 6286 time to create 1 rle with old method : 0.010527849197387695 time for calcul the mask position with numpy : 0.006240129470825195 nb_pixel_total : 8053 time to create 1 rle with old method : 0.009054899215698242 time for calcul the mask position with numpy : 0.006142377853393555 nb_pixel_total : 9313 time to create 1 rle with old method : 0.010714530944824219 create new chi : 0.3723409175872803 time to delete rle : 0.0004372596740722656 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 3098 TO DO : save crop sub photo not yet done ! save time : 0.24544358253479004 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.062259674072265625 time for calcul the mask position with numpy : 0.018903017044067383 nb_pixel_total : 1914625 time to create 1 rle with new method : 0.15099787712097168 time for calcul the mask position with numpy : 0.006917715072631836 nb_pixel_total : 12957 time to create 1 rle with old method : 0.021170854568481445 time for calcul the mask position with numpy : 0.0073893070220947266 nb_pixel_total : 121378 time to create 1 rle with old method : 0.19729232788085938 time for calcul the mask position with numpy : 0.00785684585571289 nb_pixel_total : 19495 time to create 1 rle with old method : 0.024402141571044922 time for calcul the mask position with numpy : 0.0067021846771240234 nb_pixel_total : 5145 time to create 1 rle with old method : 0.005780220031738281 create new chi : 0.44806861877441406 time to delete rle : 0.00043702125549316406 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3106 TO DO : save crop sub photo not yet done ! save time : 0.37673425674438477 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.12578439712524414 time for calcul the mask position with numpy : 0.3414318561553955 nb_pixel_total : 2037605 time to create 1 rle with new method : 0.2943410873413086 time for calcul the mask position with numpy : 0.006581544876098633 nb_pixel_total : 3020 time to create 1 rle with old method : 0.003361940383911133 time for calcul the mask position with numpy : 0.005987405776977539 nb_pixel_total : 15171 time to create 1 rle with old method : 0.01669168472290039 time for calcul the mask position with numpy : 0.006320953369140625 nb_pixel_total : 9633 time to create 1 rle with old method : 0.01056671142578125 time for calcul the mask position with numpy : 0.006173133850097656 nb_pixel_total : 4530 time to create 1 rle with old method : 0.005400896072387695 time for calcul the mask position with numpy : 0.006335020065307617 nb_pixel_total : 3641 time to create 1 rle with old method : 0.004072904586791992 create new chi : 0.7185711860656738 time to delete rle : 0.0003466606140136719 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 1982 TO DO : save crop sub photo not yet done ! save time : 0.18895578384399414 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.24889874458312988 time for calcul the mask position with numpy : 0.1463918685913086 nb_pixel_total : 2041153 time to create 1 rle with new method : 0.10143589973449707 time for calcul the mask position with numpy : 0.006391763687133789 nb_pixel_total : 2141 time to create 1 rle with old method : 0.0024788379669189453 time for calcul the mask position with numpy : 0.0061495304107666016 nb_pixel_total : 5450 time to create 1 rle with old method : 0.006204366683959961 time for calcul the mask position with numpy : 0.006462574005126953 nb_pixel_total : 9279 time to create 1 rle with old method : 0.010382890701293945 time for calcul the mask position with numpy : 0.006319284439086914 nb_pixel_total : 2865 time to create 1 rle with old method : 0.003216266632080078 time for calcul the mask position with numpy : 0.006370067596435547 nb_pixel_total : 12712 time to create 1 rle with old method : 0.01433420181274414 create new chi : 0.33246469497680664 time to delete rle : 0.00036144256591796875 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2046 TO DO : save crop sub photo not yet done ! save time : 0.40819430351257324 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03427839279174805 time for calcul the mask position with numpy : 0.02100348472595215 nb_pixel_total : 2058837 time to create 1 rle with new method : 0.05133414268493652 time for calcul the mask position with numpy : 0.00677490234375 nb_pixel_total : 14763 time to create 1 rle with old method : 0.01644730567932129 create new chi : 0.09582853317260742 time to delete rle : 0.0002617835998535156 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1370 TO DO : save crop sub photo not yet done ! save time : 0.13382506370544434 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.20912504196166992 time for calcul the mask position with numpy : 0.21650171279907227 nb_pixel_total : 2052592 time to create 1 rle with new method : 0.07552313804626465 time for calcul the mask position with numpy : 0.00638127326965332 nb_pixel_total : 21008 time to create 1 rle with old method : 0.02435445785522461 create new chi : 0.3336775302886963 time to delete rle : 0.0002486705780029297 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 1516 TO DO : save crop sub photo not yet done ! save time : 0.16307973861694336 map_output_result : {1379633763: (0.0, 'Should be the crop_list due to order', 0), 1379633760: (0.0, 'Should be the crop_list due to order', 0), 1379633724: (0.0, 'Should be the crop_list due to order', 0), 1379633669: (0.0, 'Should be the crop_list due to order', 0), 1379633666: (0.0, 'Should be the crop_list due to order', 0), 1379633657: (0.0, 'Should be the crop_list due to order', 0), 1379633654: (0.0, 'Should be the crop_list due to order', 0), 1379633638: (0.0, 'Should be the crop_list due to order', 0), 1379633483: (0.0, 'Should be the crop_list due to order', 0), 1379633449: (0.0, 'Should be the crop_list due to order', 0), 1379633443: (0.0, 'Should be the crop_list due to order', 0), 1379633440: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379633763, 1379633760, 1379633724, 1379633669, 1379633666, 1379633657, 1379633654, 1379633638, 1379633483, 1379633449, 1379633443, 1379633440] Looping around the photos to save general results len do output : 12 /1379633763.Didn't retrieve data . /1379633760.Didn't retrieve data . /1379633724.Didn't retrieve data . /1379633669.Didn't retrieve data . /1379633666.Didn't retrieve data . /1379633657.Didn't retrieve data . /1379633654.Didn't retrieve data . /1379633638.Didn't retrieve data . /1379633483.Didn't retrieve data . /1379633449.Didn't retrieve data . /1379633443.Didn't retrieve data . /1379633440.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633763', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633760', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633724', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633669', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633666', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633657', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633654', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633638', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633483', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633449', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633443', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633440', None, None, None, None, None, '3611870') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.01853466033935547 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.310866117477417 time spend to save output : 0.019316434860229492 total time spend for step 3 : 11.330182552337646 step4:ventilate_hashtags_in_portfolio Wed Aug 27 13:01:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26260990 get user id for portfolio 26260990 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26260990 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','environnement','carton','metal','pet_clair','mal_croppe','pet_fonce','flou','autre','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26260990 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','environnement','carton','metal','pet_clair','mal_croppe','pet_fonce','flou','autre','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26260990 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','environnement','carton','metal','pet_clair','mal_croppe','pet_fonce','flou','autre','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26262757,26262758,26262759,26262760,26262761,26262762,26262763,26262764,26262765,26262766,26262767?tags=background,pehd,environnement,carton,metal,pet_clair,mal_croppe,pet_fonce,flou,autre,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379633763, 1379633760, 1379633724, 1379633669, 1379633666, 1379633657, 1379633654, 1379633638, 1379633483, 1379633449, 1379633443, 1379633440] Looping around the photos to save general results len do output : 1 /26260990. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633763', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633760', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633724', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633669', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633666', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633657', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633654', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633638', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633483', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633449', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633443', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633440', None, None, None, None, None, '3611870') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.18869829177856445 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4984145164489746 time spend to save output : 0.18901729583740234 total time spend for step 4 : 2.687431812286377 step5:final Wed Aug 27 13:01:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379633763: ('0.025566285686728387',), 1379633760: ('0.025566285686728387',), 1379633724: ('0.025566285686728387',), 1379633669: ('0.025566285686728387',), 1379633666: ('0.025566285686728387',), 1379633657: ('0.025566285686728387',), 1379633654: ('0.025566285686728387',), 1379633638: ('0.025566285686728387',), 1379633483: ('0.025566285686728387',), 1379633449: ('0.025566285686728387',), 1379633443: ('0.025566285686728387',), 1379633440: ('0.025566285686728387',)} new output for save of step final : {1379633763: ('0.025566285686728387',), 1379633760: ('0.025566285686728387',), 1379633724: ('0.025566285686728387',), 1379633669: ('0.025566285686728387',), 1379633666: ('0.025566285686728387',), 1379633657: ('0.025566285686728387',), 1379633654: ('0.025566285686728387',), 1379633638: ('0.025566285686728387',), 1379633483: ('0.025566285686728387',), 1379633449: ('0.025566285686728387',), 1379633443: ('0.025566285686728387',), 1379633440: ('0.025566285686728387',)} [1379633763, 1379633760, 1379633724, 1379633669, 1379633666, 1379633657, 1379633654, 1379633638, 1379633483, 1379633449, 1379633443, 1379633440] Looping around the photos to save general results len do output : 12 /1379633763.Didn't retrieve data . /1379633760.Didn't retrieve data . /1379633724.Didn't retrieve data . /1379633669.Didn't retrieve data . /1379633666.Didn't retrieve data . /1379633657.Didn't retrieve data . /1379633654.Didn't retrieve data . /1379633638.Didn't retrieve data . /1379633483.Didn't retrieve data . /1379633449.Didn't retrieve data . /1379633443.Didn't retrieve data . /1379633440.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633763', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633760', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633724', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633669', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633666', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633657', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633654', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633638', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633483', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633449', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633443', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633440', None, None, None, None, None, '3611870') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.02059149742126465 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11584234237670898 time spend to save output : 0.021251678466796875 total time spend for step 5 : 0.13709402084350586 step6:blur_detection Wed Aug 27 13:01:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756292429_150631_1379633763_615de6b5dc7e2a8403d865fc5956aa61.jpg resize: (1080, 1920) 1379633763 0.419926484219807 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8.jpg resize: (1080, 1920) 1379633760 -0.13201568534851418 treat image : temp/1756292429_150631_1379633724_8119ffc1c34e0d0d410f2001364fa1c8.jpg resize: (1080, 1920) 1379633724 0.507868811513531 treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51.jpg resize: (1080, 1920) 1379633669 3.353767850169927 treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539.jpg resize: (1080, 1920) 1379633666 -4.280562311356263 treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32.jpg resize: (1080, 1920) 1379633657 1.5051524560058152 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c.jpg resize: (1080, 1920) 1379633654 -3.825927452249542 treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d.jpg resize: (1080, 1920) 1379633638 0.2846843453239119 treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f.jpg resize: (1080, 1920) 1379633483 -0.20997061154195082 treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619.jpg resize: (1080, 1920) 1379633449 -2.5861880850958 treat image : temp/1756292429_150631_1379633443_828b9f792e0c21b7010320be1de1f177.jpg resize: (1080, 1920) 1379633443 0.6518920964456327 treat image : temp/1756292429_150631_1379633440_cc9cb50b199de9d66ca70b1d8bbf97b9.jpg resize: (1080, 1920) 1379633440 0.12833689839608373 treat image : temp/1756292429_150631_1379633763_615de6b5dc7e2a8403d865fc5956aa61_rle_crop_3932529175_0.png resize: (58, 83) 1379662464 1.0742831279301783 treat image : temp/1756292429_150631_1379633763_615de6b5dc7e2a8403d865fc5956aa61_rle_crop_3932529176_0.png resize: (93, 56) 1379662465 -1.1471829622441314 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529180_0.png resize: (184, 126) 1379662466 -0.5562280102255504 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529184_0.png resize: (214, 250) 1379662467 -2.212284861807903 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529177_0.png resize: (125, 172) 1379662468 -1.1540564853423287 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529179_0.png resize: (134, 166) 1379662469 -3.546133019703674 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529178_0.png resize: (92, 116) 1379662470 -1.067609134855767 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529183_0.png resize: (79, 74) 1379662471 -2.917936457717005 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529181_0.png resize: (85, 122) 1379662472 -1.4344441413884206 treat image : temp/1756292429_150631_1379633724_8119ffc1c34e0d0d410f2001364fa1c8_rle_crop_3932529185_0.png resize: (101, 67) 1379662473 -1.3350240145710819 treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51_rle_crop_3932529186_0.png resize: (127, 104) 1379662475 -1.1107933064705564 treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539_rle_crop_3932529193_0.png resize: (187, 115) 1379662476 -1.78529281330782 treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539_rle_crop_3932529190_0.png resize: (80, 100) 1379662477 -2.262608913769958 treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529194_0.png resize: (85, 109) 1379662478 0.14790747214508485 treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529197_0.png resize: (127, 59) 1379662480 0.24893817960118927 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529199_0.png resize: (132, 128) 1379662481 -1.867561241720824 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529203_0.png resize: (58, 128) 1379662482 -1.5335983452844915 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529200_0.png resize: (121, 122) 1379662483 -2.672667638019613 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529206_0.png resize: (89, 62) 1379662484 -2.8282900599976726 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529204_0.png resize: (118, 96) 1379662485 -3.5219098947100376 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529201_0.png resize: (169, 53) 1379662486 -0.5843901404376284 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529202_0.png resize: (119, 116) 1379662487 -1.0197646084917753 treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d_rle_crop_3932529207_0.png resize: (103, 94) 1379662488 -1.0627549981432443 treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d_rle_crop_3932529208_0.png resize: (245, 114) 1379662489 -1.7404694769101945 treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529212_0.png resize: (75, 86) 1379662490 -2.693222408946783 treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529214_0.png resize: (124, 182) 1379662491 -1.055488177114386 treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529218_0.png resize: (185, 79) 1379662492 -0.44415726310403364 treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529217_0.png resize: (50, 82) 1379662493 0.033082057375293725 treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529219_0.png resize: (74, 94) 1379662494 1.4121133106822603 treat image : temp/1756292429_150631_1379633443_828b9f792e0c21b7010320be1de1f177_rle_crop_3932529221_0.png resize: (132, 158) 1379662495 0.7278732137809638 treat image : temp/1756292429_150631_1379633440_cc9cb50b199de9d66ca70b1d8bbf97b9_rle_crop_3932529222_0.png resize: (188, 173) 1379662496 -0.8082338756423768 treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529215_0.png resize: (55, 76) 1379662498 1.3592877618979442 treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529213_0.png resize: (107, 149) 1379662499 -2.2695407869398814 treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529220_0.png resize: (48, 59) 1379662500 2.8712904756770232 treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529182_0.png resize: (174, 156) 1379662503 -2.459810169377018 treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51_rle_crop_3932529187_0.png resize: (87, 241) 1379662504 0.2472044956308213 treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51_rle_crop_3932529189_0.png resize: (102, 252) 1379662505 0.627222873292196 treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51_rle_crop_3932529188_0.png resize: (85, 71) 1379662506 0.21123018086897596 treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539_rle_crop_3932529192_0.png resize: (124, 88) 1379662507 -3.0032209688205294 treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539_rle_crop_3932529191_0.png resize: (611, 346) 1379662508 -0.23327178755768999 treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529198_0.png resize: (109, 117) 1379662509 -0.7637724844395758 treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529196_0.png resize: (63, 59) 1379662510 -0.27868267855343615 treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529195_0.png resize: (43, 96) 1379662511 2.870772339417394 treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529205_0.png resize: (126, 90) 1379662512 -2.704636624797052 treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d_rle_crop_3932529210_0.png resize: (104, 167) 1379662513 -0.9864686692519846 treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d_rle_crop_3932529209_0.png resize: (554, 366) 1379662514 0.23524493220798362 treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529211_0.png resize: (57, 83) 1379662515 -1.7473250021929767 treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529216_0.png resize: (121, 117) 1379662516 -1.1527176688387855 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 60 time used for this insertion : 0.015293598175048828 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 60 time used for this insertion : 0.06693220138549805 save missing photos in datou_result : time spend for datou_step_exec : 9.727670907974243 time spend to save output : 0.0870201587677002 total time spend for step 6 : 9.814691066741943 step7:brightness Wed Aug 27 13:01:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756292429_150631_1379633763_615de6b5dc7e2a8403d865fc5956aa61.jpg treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8.jpg treat image : temp/1756292429_150631_1379633724_8119ffc1c34e0d0d410f2001364fa1c8.jpg treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51.jpg treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539.jpg treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32.jpg treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c.jpg treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d.jpg treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f.jpg treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619.jpg treat image : temp/1756292429_150631_1379633443_828b9f792e0c21b7010320be1de1f177.jpg treat image : temp/1756292429_150631_1379633440_cc9cb50b199de9d66ca70b1d8bbf97b9.jpg treat image : temp/1756292429_150631_1379633763_615de6b5dc7e2a8403d865fc5956aa61_rle_crop_3932529175_0.png treat image : temp/1756292429_150631_1379633763_615de6b5dc7e2a8403d865fc5956aa61_rle_crop_3932529176_0.png treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529180_0.png treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529184_0.png treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529177_0.png treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529179_0.png treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529178_0.png treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529183_0.png treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529181_0.png treat image : temp/1756292429_150631_1379633724_8119ffc1c34e0d0d410f2001364fa1c8_rle_crop_3932529185_0.png treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51_rle_crop_3932529186_0.png treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539_rle_crop_3932529193_0.png treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539_rle_crop_3932529190_0.png treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529194_0.png treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529197_0.png treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529199_0.png treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529203_0.png treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529200_0.png treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529206_0.png treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529204_0.png treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529201_0.png treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529202_0.png treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d_rle_crop_3932529207_0.png treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d_rle_crop_3932529208_0.png treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529212_0.png treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529214_0.png treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529218_0.png treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529217_0.png treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529219_0.png treat image : temp/1756292429_150631_1379633443_828b9f792e0c21b7010320be1de1f177_rle_crop_3932529221_0.png treat image : temp/1756292429_150631_1379633440_cc9cb50b199de9d66ca70b1d8bbf97b9_rle_crop_3932529222_0.png treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529215_0.png treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529213_0.png treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529220_0.png treat image : temp/1756292429_150631_1379633760_d47724a7066b267a152de8718f1f7db8_rle_crop_3932529182_0.png treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51_rle_crop_3932529187_0.png treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51_rle_crop_3932529189_0.png treat image : temp/1756292429_150631_1379633669_28b9cb0e94df272e27a2948dc3e36c51_rle_crop_3932529188_0.png treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539_rle_crop_3932529192_0.png treat image : temp/1756292429_150631_1379633666_2219d3b577ac2d364d82fd2d81ff7539_rle_crop_3932529191_0.png treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529198_0.png treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529196_0.png treat image : temp/1756292429_150631_1379633657_ff7ef1b74ffbb84c3d7a0038ae3fce32_rle_crop_3932529195_0.png treat image : temp/1756292429_150631_1379633654_f0cd52c3df3ad12c4d156cf57f259e5c_rle_crop_3932529205_0.png treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d_rle_crop_3932529210_0.png treat image : temp/1756292429_150631_1379633638_707ffcd726e0028c758c26c44d35c98d_rle_crop_3932529209_0.png treat image : temp/1756292429_150631_1379633483_2885d0a4d1eca762478fa8302780759f_rle_crop_3932529211_0.png treat image : temp/1756292429_150631_1379633449_fbc7aa7eee92be5b54ebe98a9b233619_rle_crop_3932529216_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 60 time used for this insertion : 0.013971567153930664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 60 time used for this insertion : 0.0400242805480957 save missing photos in datou_result : time spend for datou_step_exec : 2.842261791229248 time spend to save output : 0.05873680114746094 total time spend for step 7 : 2.900998592376709 step8:velours_tree Wed Aug 27 13:01:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13441038131713867 time spend to save output : 3.4809112548828125e-05 total time spend for step 8 : 0.1344451904296875 step9:send_mail_cod Wed Aug 27 13:01:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26260990_27-08-2025_13_01_44.pdf 26262757 imagette262627571756292504 26262758 imagette262627581756292504 26262760 change filename to text .change filename to text .imagette262627601756292504 26262761 change filename to text .imagette262627611756292504 26262762 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262627621756292504 26262763 imagette262627631756292505 26262764 imagette262627641756292505 26262765 imagette262627651756292505 26262766 change filename to text .imagette262627661756292505 26262767 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262627671756292505 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26260990 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26262757,26262758,26262759,26262760,26262761,26262762,26262763,26262764,26262765,26262766,26262767?tags=background,pehd,environnement,carton,metal,pet_clair,mal_croppe,pet_fonce,flou,autre,papier args[1379633763] : ((1379633763, 0.419926484219807, 492688767), (1379633763, 0.7974361575249355, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633760] : ((1379633760, -0.13201568534851418, 492688767), (1379633760, 0.22041510092671393, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633724] : ((1379633724, 0.507868811513531, 492688767), (1379633724, 0.521435491348129, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633669] : ((1379633669, 3.353767850169927, 492688767), (1379633669, 0.7776753816740217, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633666] : ((1379633666, -4.280562311356263, 492609224), (1379633666, 0.49530393999111955, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633657] : ((1379633657, 1.5051524560058152, 492688767), (1379633657, 0.7939290732567552, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633654] : ((1379633654, -3.825927452249542, 492609224), (1379633654, 0.3346485660663903, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633638] : ((1379633638, 0.2846843453239119, 492688767), (1379633638, 0.6018077333614682, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633483] : ((1379633483, -0.20997061154195082, 492688767), (1379633483, 0.6007348274990801, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633449] : ((1379633449, -2.5861880850958, 492609224), (1379633449, 1.315747767700826, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633443] : ((1379633443, 0.6518920964456327, 492688767), (1379633443, 0.92248033953504, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com args[1379633440] : ((1379633440, 0.12833689839608373, 492688767), (1379633440, 0.5147209050773156, 2107752395), '0.025566285686728387') We are sending mail with results at report@fotonower.com refus_total : 0.025566285686728387 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26260990 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26260990_27-08-2025_13_01_44.pdf results_Auto_P26260990_27-08-2025_13_01_44.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26260990_27-08-2025_13_01_44.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26260990','results_Auto_P26260990_27-08-2025_13_01_44.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26260990_27-08-2025_13_01_44.pdf','pdf','','0.18','0.025566285686728387') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26260990

https://www.fotonower.com/image?json=false&list_photos_id=1379633763
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633760
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633724
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633669
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.353767850169927)
https://www.fotonower.com/image?json=false&list_photos_id=1379633666
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633657
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5051524560058152)
https://www.fotonower.com/image?json=false&list_photos_id=1379633654
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633638
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633483
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633449
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633443
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379633440
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 2.56%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26262760?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26262761?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26262762?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26262766?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26262767?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26260990_27-08-2025_13_01_44.pdf.

Lien vers velours :https://www.fotonower.com/velours/26262757,26262758,26262759,26262760,26262761,26262762,26262763,26262764,26262765,26262766,26262767?tags=background,pehd,environnement,carton,metal,pet_clair,mal_croppe,pet_fonce,flou,autre,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 27 Aug 2025 11:01:47 GMT Content-Length: 0 Connection: close X-Message-Id: HdDiJlmwRzC817w3mN1KwA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379633763, 1379633760, 1379633724, 1379633669, 1379633666, 1379633657, 1379633654, 1379633638, 1379633483, 1379633449, 1379633443, 1379633440] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633763', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633760', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633724', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633669', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633666', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633657', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633654', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633638', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633483', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633449', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633443', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633440', None, None, None, None, None, '3611870') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.05177593231201172 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.6948418617248535 time spend to save output : 0.052077531814575195 total time spend for step 9 : 3.7469193935394287 step10:split_time_score Wed Aug 27 13:01:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27082025 26260990 Nombre de photos uploadées : 12 / 23040 (0%) 27082025 26260990 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 27082025 26260990 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 9.775161743164062e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006506443023681641 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.1957712173461914 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.062204378858024684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26256001_27-08-2025_09_32_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26256001 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26256001 AND mptpi.`type`=3594 To do Qualite : 0.07180745918615984 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26258328_27-08-2025_10_02_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26258328 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26258328 AND mptpi.`type`=3594 To do Qualite : 0.12330058834876545 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26258329_27-08-2025_10_12_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26258329 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26258329 AND mptpi.`type`=3594 To do Qualite : 0.07669382122507122 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26258331_27-08-2025_09_54_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26258331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26258331 AND mptpi.`type`=3594 To do Qualite : 0.025566285686728387 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26260990_27-08-2025_13_01_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26260990 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26260990 AND mptpi.`type`=3594 To do Qualite : 0.05087973192573884 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26260994_27-08-2025_11_43_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26260994 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26260994 AND mptpi.`type`=3594 To do Qualite : 0.1781512104552469 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26262423_27-08-2025_12_53_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26262423 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26262423 AND mptpi.`type`=3594 To do Qualite : 0.163993932379349 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26262424_27-08-2025_12_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26262424 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26262424 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27082025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379633763, 1379633760, 1379633724, 1379633669, 1379633666, 1379633657, 1379633654, 1379633638, 1379633483, 1379633449, 1379633443, 1379633440] Looping around the photos to save general results len do output : 1 /26260990Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633763', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633760', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633724', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633669', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633666', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633657', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633654', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633638', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633483', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633449', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633443', None, None, None, None, None, '3611870') ('3318', None, None, None, None, None, None, None, '3611870') ('3318', '26260990', '1379633440', None, None, None, None, None, '3611870') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.01490473747253418 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.81288743019104 time spend to save output : 0.015189170837402344 total time spend for step 10 : 0.8280766010284424 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 37.04user 21.96system 1:23.98elapsed 70%CPU (0avgtext+0avgdata 2777244maxresident)k 7600inputs+12912outputs (39major+1499643minor)pagefaults 0swaps