python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 746359 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3234676'] with mtr_portfolio_ids : ['24581228'] and first list_photo_ids : [] new path : /proc/746359/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.9574317932128906 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jul 4 09:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10512 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-04 09:10:35.088473: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-04 09:10:35.127422: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-04 09:10:35.130243: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3aa0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-04 09:10:35.130307: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-04 09:10:35.137818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-04 09:10:35.302158: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x23a6a640 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-04 09:10:35.302225: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-04 09:10:35.304528: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-04 09:10:35.306937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-04 09:10:35.337003: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-04 09:10:35.364127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-04 09:10:35.368205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-04 09:10:35.404742: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-04 09:10:35.410969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-04 09:10:35.471486: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-04 09:10:35.473705: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-04 09:10:35.474283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-04 09:10:35.475519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-04 09:10:35.475545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-04 09:10:35.475556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-04 09:10:35.478048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9739 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-04 09:10:35.920741: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-04 09:10:35.920890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-04 09:10:35.920920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-04 09:10:35.920944: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-04 09:10:35.920966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-04 09:10:35.920989: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-04 09:10:35.921011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-04 09:10:35.921033: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-04 09:10:35.922643: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-04 09:10:35.924216: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-04 09:10:35.924275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-04 09:10:35.924295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-04 09:10:35.924329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-04 09:10:35.924343: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-04 09:10:35.924357: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-04 09:10:35.924370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-04 09:10:35.924383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-04 09:10:35.925558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-04 09:10:35.925597: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-04 09:10:35.925606: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-04 09:10:35.925613: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-04 09:10:35.926829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9739 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-04 09:10:49.219938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-04 09:10:49.599173: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 Detection mask done ! Trying to reset tf kernel 746841 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 155 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5444 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001987457275390625 nb_pixel_total : 27990 time to create 1 rle with old method : 0.04547476768493652 length of segment : 267 time for calcul the mask position with numpy : 0.008234024047851562 nb_pixel_total : 197584 time to create 1 rle with new method : 0.01625680923461914 length of segment : 368 time for calcul the mask position with numpy : 0.002393007278442383 nb_pixel_total : 74934 time to create 1 rle with old method : 0.10089540481567383 length of segment : 347 time for calcul the mask position with numpy : 0.002750396728515625 nb_pixel_total : 90985 time to create 1 rle with old method : 0.10625982284545898 length of segment : 352 time for calcul the mask position with numpy : 0.0004153251647949219 nb_pixel_total : 14225 time to create 1 rle with old method : 0.016828060150146484 length of segment : 106 time for calcul the mask position with numpy : 0.0006506443023681641 nb_pixel_total : 14319 time to create 1 rle with old method : 0.016656875610351562 length of segment : 207 time for calcul the mask position with numpy : 0.0002932548522949219 nb_pixel_total : 10673 time to create 1 rle with old method : 0.013349771499633789 length of segment : 79 time for calcul the mask position with numpy : 0.018942832946777344 nb_pixel_total : 341775 time to create 1 rle with new method : 0.08577299118041992 length of segment : 802 time for calcul the mask position with numpy : 0.0011076927185058594 nb_pixel_total : 17470 time to create 1 rle with old method : 0.020233631134033203 length of segment : 208 time for calcul the mask position with numpy : 0.0021500587463378906 nb_pixel_total : 55732 time to create 1 rle with old method : 0.06412386894226074 length of segment : 335 time for calcul the mask position with numpy : 0.0022568702697753906 nb_pixel_total : 58988 time to create 1 rle with old method : 0.06754589080810547 length of segment : 275 time for calcul the mask position with numpy : 0.0007045269012451172 nb_pixel_total : 21220 time to create 1 rle with old method : 0.024935007095336914 length of segment : 118 time for calcul the mask position with numpy : 0.0022308826446533203 nb_pixel_total : 105106 time to create 1 rle with old method : 0.12246918678283691 length of segment : 263 time for calcul the mask position with numpy : 0.004171609878540039 nb_pixel_total : 176817 time to create 1 rle with new method : 0.011210441589355469 length of segment : 664 time for calcul the mask position with numpy : 0.0009438991546630859 nb_pixel_total : 19871 time to create 1 rle with old method : 0.0229947566986084 length of segment : 188 time for calcul the mask position with numpy : 0.00037550926208496094 nb_pixel_total : 18296 time to create 1 rle with old method : 0.021653175354003906 length of segment : 106 time for calcul the mask position with numpy : 0.0008389949798583984 nb_pixel_total : 20856 time to create 1 rle with old method : 0.024102210998535156 length of segment : 174 time for calcul the mask position with numpy : 0.0011415481567382812 nb_pixel_total : 28916 time to create 1 rle with old method : 0.03387093544006348 length of segment : 133 time for calcul the mask position with numpy : 0.004994869232177734 nb_pixel_total : 146658 time to create 1 rle with old method : 0.16887855529785156 length of segment : 447 time for calcul the mask position with numpy : 0.0004286766052246094 nb_pixel_total : 7734 time to create 1 rle with old method : 0.009183645248413086 length of segment : 80 time for calcul the mask position with numpy : 0.001280069351196289 nb_pixel_total : 22300 time to create 1 rle with old method : 0.026653766632080078 length of segment : 234 time for calcul the mask position with numpy : 0.0013370513916015625 nb_pixel_total : 32550 time to create 1 rle with old method : 0.037011146545410156 length of segment : 364 time for calcul the mask position with numpy : 0.0007035732269287109 nb_pixel_total : 16933 time to create 1 rle with old method : 0.0233306884765625 length of segment : 151 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 8440 time to create 1 rle with old method : 0.010330677032470703 length of segment : 137 time for calcul the mask position with numpy : 0.0009324550628662109 nb_pixel_total : 19442 time to create 1 rle with old method : 0.023255348205566406 length of segment : 133 time for calcul the mask position with numpy : 0.0016252994537353516 nb_pixel_total : 34228 time to create 1 rle with old method : 0.03989601135253906 length of segment : 268 time for calcul the mask position with numpy : 0.0018146038055419922 nb_pixel_total : 43297 time to create 1 rle with old method : 0.049712181091308594 length of segment : 339 time for calcul the mask position with numpy : 0.0018439292907714844 nb_pixel_total : 42018 time to create 1 rle with old method : 0.0487523078918457 length of segment : 287 time for calcul the mask position with numpy : 0.0009293556213378906 nb_pixel_total : 12968 time to create 1 rle with old method : 0.015536308288574219 length of segment : 428 time for calcul the mask position with numpy : 0.000247955322265625 nb_pixel_total : 4435 time to create 1 rle with old method : 0.005435466766357422 length of segment : 72 time for calcul the mask position with numpy : 0.0020830631256103516 nb_pixel_total : 54359 time to create 1 rle with old method : 0.06184220314025879 length of segment : 262 time for calcul the mask position with numpy : 0.0008265972137451172 nb_pixel_total : 20864 time to create 1 rle with old method : 0.02388143539428711 length of segment : 154 time for calcul the mask position with numpy : 0.0013730525970458984 nb_pixel_total : 25640 time to create 1 rle with old method : 0.02977132797241211 length of segment : 210 time for calcul the mask position with numpy : 0.0014657974243164062 nb_pixel_total : 34472 time to create 1 rle with old method : 0.039537668228149414 length of segment : 193 time for calcul the mask position with numpy : 0.0013561248779296875 nb_pixel_total : 28144 time to create 1 rle with old method : 0.032792091369628906 length of segment : 262 time for calcul the mask position with numpy : 0.0026776790618896484 nb_pixel_total : 46020 time to create 1 rle with old method : 0.05384516716003418 length of segment : 248 time for calcul the mask position with numpy : 0.0009522438049316406 nb_pixel_total : 18448 time to create 1 rle with old method : 0.02145242691040039 length of segment : 226 time for calcul the mask position with numpy : 0.0016286373138427734 nb_pixel_total : 40186 time to create 1 rle with old method : 0.047113895416259766 length of segment : 300 time for calcul the mask position with numpy : 0.0018506050109863281 nb_pixel_total : 28565 time to create 1 rle with old method : 0.03294205665588379 length of segment : 702 time for calcul the mask position with numpy : 0.0009198188781738281 nb_pixel_total : 20915 time to create 1 rle with old method : 0.024400949478149414 length of segment : 198 time for calcul the mask position with numpy : 0.0005462169647216797 nb_pixel_total : 11081 time to create 1 rle with old method : 0.013018608093261719 length of segment : 153 time for calcul the mask position with numpy : 0.001386880874633789 nb_pixel_total : 22769 time to create 1 rle with old method : 0.02639913558959961 length of segment : 266 time for calcul the mask position with numpy : 0.0010116100311279297 nb_pixel_total : 22482 time to create 1 rle with old method : 0.026422739028930664 length of segment : 165 time for calcul the mask position with numpy : 0.0020453929901123047 nb_pixel_total : 65723 time to create 1 rle with old method : 0.07576680183410645 length of segment : 207 time for calcul the mask position with numpy : 0.0021648406982421875 nb_pixel_total : 56089 time to create 1 rle with old method : 0.06441187858581543 length of segment : 320 time for calcul the mask position with numpy : 0.0003402233123779297 nb_pixel_total : 7208 time to create 1 rle with old method : 0.008261919021606445 length of segment : 111 time for calcul the mask position with numpy : 0.0018563270568847656 nb_pixel_total : 44272 time to create 1 rle with old method : 0.05062103271484375 length of segment : 268 time for calcul the mask position with numpy : 0.011253118515014648 nb_pixel_total : 323659 time to create 1 rle with new method : 0.0325627326965332 length of segment : 768 time for calcul the mask position with numpy : 0.0005800724029541016 nb_pixel_total : 13356 time to create 1 rle with old method : 0.015474319458007812 length of segment : 170 time for calcul the mask position with numpy : 0.0020101070404052734 nb_pixel_total : 52820 time to create 1 rle with old method : 0.06163620948791504 length of segment : 380 time for calcul the mask position with numpy : 0.0004239082336425781 nb_pixel_total : 10397 time to create 1 rle with old method : 0.012476205825805664 length of segment : 104 time for calcul the mask position with numpy : 0.00502324104309082 nb_pixel_total : 163395 time to create 1 rle with new method : 0.00937342643737793 length of segment : 439 time for calcul the mask position with numpy : 0.0014836788177490234 nb_pixel_total : 24429 time to create 1 rle with old method : 0.030529499053955078 length of segment : 183 time for calcul the mask position with numpy : 0.0023660659790039062 nb_pixel_total : 70881 time to create 1 rle with old method : 0.08078432083129883 length of segment : 403 time for calcul the mask position with numpy : 0.000598907470703125 nb_pixel_total : 20070 time to create 1 rle with old method : 0.02486252784729004 length of segment : 200 time for calcul the mask position with numpy : 0.0003876686096191406 nb_pixel_total : 10680 time to create 1 rle with old method : 0.012933969497680664 length of segment : 220 time for calcul the mask position with numpy : 0.0005624294281005859 nb_pixel_total : 26218 time to create 1 rle with old method : 0.03044271469116211 length of segment : 159 time for calcul the mask position with numpy : 0.0007390975952148438 nb_pixel_total : 15867 time to create 1 rle with old method : 0.01906108856201172 length of segment : 165 time for calcul the mask position with numpy : 0.0003108978271484375 nb_pixel_total : 4364 time to create 1 rle with old method : 0.005214691162109375 length of segment : 102 time for calcul the mask position with numpy : 0.0057756900787353516 nb_pixel_total : 198364 time to create 1 rle with new method : 0.007642507553100586 length of segment : 688 time for calcul the mask position with numpy : 0.002473592758178711 nb_pixel_total : 76205 time to create 1 rle with old method : 0.08875131607055664 length of segment : 395 time for calcul the mask position with numpy : 0.009919881820678711 nb_pixel_total : 224237 time to create 1 rle with new method : 0.017176389694213867 length of segment : 609 time for calcul the mask position with numpy : 0.0056476593017578125 nb_pixel_total : 131427 time to create 1 rle with old method : 0.14710140228271484 length of segment : 643 time for calcul the mask position with numpy : 0.0007245540618896484 nb_pixel_total : 10756 time to create 1 rle with old method : 0.012295961380004883 length of segment : 151 time for calcul the mask position with numpy : 0.0030493736267089844 nb_pixel_total : 63570 time to create 1 rle with old method : 0.07899332046508789 length of segment : 320 time for calcul the mask position with numpy : 0.0013365745544433594 nb_pixel_total : 32017 time to create 1 rle with old method : 0.035758256912231445 length of segment : 210 time for calcul the mask position with numpy : 0.0026395320892333984 nb_pixel_total : 53405 time to create 1 rle with old method : 0.059655189514160156 length of segment : 302 time for calcul the mask position with numpy : 0.0041656494140625 nb_pixel_total : 115965 time to create 1 rle with old method : 0.131699800491333 length of segment : 375 time for calcul the mask position with numpy : 0.0025877952575683594 nb_pixel_total : 52389 time to create 1 rle with old method : 0.05658864974975586 length of segment : 332 time for calcul the mask position with numpy : 0.002733945846557617 nb_pixel_total : 51166 time to create 1 rle with old method : 0.05583763122558594 length of segment : 349 time for calcul the mask position with numpy : 0.0033380985260009766 nb_pixel_total : 69366 time to create 1 rle with old method : 0.07704567909240723 length of segment : 241 time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 3841 time to create 1 rle with old method : 0.004352569580078125 length of segment : 94 time for calcul the mask position with numpy : 0.0009670257568359375 nb_pixel_total : 24328 time to create 1 rle with old method : 0.027091026306152344 length of segment : 206 time for calcul the mask position with numpy : 0.0004611015319824219 nb_pixel_total : 11394 time to create 1 rle with old method : 0.013162851333618164 length of segment : 83 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 25514 time to create 1 rle with old method : 0.02889108657836914 length of segment : 125 time for calcul the mask position with numpy : 0.0016407966613769531 nb_pixel_total : 50270 time to create 1 rle with old method : 0.055321693420410156 length of segment : 361 time for calcul the mask position with numpy : 0.0008614063262939453 nb_pixel_total : 25225 time to create 1 rle with old method : 0.029437780380249023 length of segment : 96 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 7730 time to create 1 rle with old method : 0.008903026580810547 length of segment : 111 time for calcul the mask position with numpy : 0.002482891082763672 nb_pixel_total : 44655 time to create 1 rle with old method : 0.04923272132873535 length of segment : 337 time for calcul the mask position with numpy : 0.0005574226379394531 nb_pixel_total : 12388 time to create 1 rle with old method : 0.014037609100341797 length of segment : 181 time for calcul the mask position with numpy : 0.007612705230712891 nb_pixel_total : 190953 time to create 1 rle with new method : 0.014503240585327148 length of segment : 594 time for calcul the mask position with numpy : 0.0016243457794189453 nb_pixel_total : 29812 time to create 1 rle with old method : 0.03287458419799805 length of segment : 288 time spent for convertir_results : 8.61889934539795 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 82 chid ids of type : 3594 Number RLEs to save : 22561 save missing photos in datou_result : time spend for datou_step_exec : 61.81110954284668 time spend to save output : 6.592702150344849 total time spend for step 1 : 68.40381169319153 step2:crop_condition Fri Jul 4 09:11:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 82 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 57 About to insert : list_path_to_insert length 57 new photo from crops ! About to upload 57 photos upload in portfolio : 3736932 init cache_photo without model_param we have 57 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751613113_746359 we have uploaded 57 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.229198455810547 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751613128_746359 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2765297889709473 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751613130_746359 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.820368766784668 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751613139_746359 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.60897970199585 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1751613146_746359 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2306108474731445 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1370460705, 1370460704, 1370460703, 1370460701, 1370460663] Looping around the photos to save general results len do output : 82 /1370511611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1370511847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460705', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460704', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460703', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460701', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460663', None, None, None, None, None, '3234676') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 251 time used for this insertion : 0.09955334663391113 save_final save missing photos in datou_result : time spend for datou_step_exec : 48.25482153892517 time spend to save output : 0.10236406326293945 total time spend for step 2 : 48.35718560218811 step3:rle_unique_nms_with_priority Fri Jul 4 09:12:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 82 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 5.579371452331543 time for calcul the mask position with numpy : 0.5395116806030273 nb_pixel_total : 7048415 time to create 1 rle with new method : 0.6810922622680664 time for calcul the mask position with numpy : 0.0414886474609375 nb_pixel_total : 18296 time to create 1 rle with old method : 0.020794391632080078 time for calcul the mask position with numpy : 0.0431981086730957 nb_pixel_total : 19871 time to create 1 rle with old method : 0.022367000579833984 time for calcul the mask position with numpy : 0.04269814491271973 nb_pixel_total : 176817 time to create 1 rle with new method : 0.62628173828125 time for calcul the mask position with numpy : 0.02668595314025879 nb_pixel_total : 105106 time to create 1 rle with old method : 0.1188204288482666 time for calcul the mask position with numpy : 0.027292490005493164 nb_pixel_total : 21220 time to create 1 rle with old method : 0.030065536499023438 time for calcul the mask position with numpy : 0.02904987335205078 nb_pixel_total : 58988 time to create 1 rle with old method : 0.06643128395080566 time for calcul the mask position with numpy : 0.02639293670654297 nb_pixel_total : 55732 time to create 1 rle with old method : 0.0691688060760498 time for calcul the mask position with numpy : 0.02604508399963379 nb_pixel_total : 17470 time to create 1 rle with old method : 0.019568443298339844 time for calcul the mask position with numpy : 0.03263139724731445 nb_pixel_total : 341775 time to create 1 rle with new method : 0.5879747867584229 time for calcul the mask position with numpy : 0.0275881290435791 nb_pixel_total : 10673 time to create 1 rle with old method : 0.012154102325439453 time for calcul the mask position with numpy : 0.026543855667114258 nb_pixel_total : 14319 time to create 1 rle with old method : 0.016115427017211914 time for calcul the mask position with numpy : 0.030990123748779297 nb_pixel_total : 14225 time to create 1 rle with old method : 0.01595783233642578 time for calcul the mask position with numpy : 0.027943849563598633 nb_pixel_total : 90985 time to create 1 rle with old method : 0.10220742225646973 time for calcul the mask position with numpy : 0.02638411521911621 nb_pixel_total : 74934 time to create 1 rle with old method : 0.09760165214538574 time for calcul the mask position with numpy : 0.02986431121826172 nb_pixel_total : 197584 time to create 1 rle with new method : 0.6842386722564697 time for calcul the mask position with numpy : 0.02859210968017578 nb_pixel_total : 27990 time to create 1 rle with old method : 0.031616926193237305 create new chi : 4.3563220500946045 time to delete rle : 0.02271270751953125 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 11530 TO DO : save crop sub photo not yet done ! save time : 4.387934446334839 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 5.1635801792144775 time for calcul the mask position with numpy : 0.453265905380249 nb_pixel_total : 7799266 time to create 1 rle with new method : 0.8491697311401367 time for calcul the mask position with numpy : 0.06267547607421875 nb_pixel_total : 54359 time to create 1 rle with old method : 0.05803036689758301 time for calcul the mask position with numpy : 0.05836057662963867 nb_pixel_total : 4435 time to create 1 rle with old method : 0.005026578903198242 time for calcul the mask position with numpy : 0.05340266227722168 nb_pixel_total : 12968 time to create 1 rle with old method : 0.014157295227050781 time for calcul the mask position with numpy : 0.05628657341003418 nb_pixel_total : 42018 time to create 1 rle with old method : 0.04479169845581055 time for calcul the mask position with numpy : 0.05773115158081055 nb_pixel_total : 43297 time to create 1 rle with old method : 0.04634428024291992 time for calcul the mask position with numpy : 0.057120561599731445 nb_pixel_total : 34228 time to create 1 rle with old method : 0.036101579666137695 time for calcul the mask position with numpy : 0.05876016616821289 nb_pixel_total : 19442 time to create 1 rle with old method : 0.021667957305908203 time for calcul the mask position with numpy : 0.061574459075927734 nb_pixel_total : 8440 time to create 1 rle with old method : 0.010028600692749023 time for calcul the mask position with numpy : 0.06302189826965332 nb_pixel_total : 16933 time to create 1 rle with old method : 0.019800901412963867 time for calcul the mask position with numpy : 0.0578155517578125 nb_pixel_total : 32550 time to create 1 rle with old method : 0.040366411209106445 time for calcul the mask position with numpy : 0.04256248474121094 nb_pixel_total : 22300 time to create 1 rle with old method : 0.02792048454284668 time for calcul the mask position with numpy : 0.03819751739501953 nb_pixel_total : 7734 time to create 1 rle with old method : 0.009398937225341797 time for calcul the mask position with numpy : 0.04184460639953613 nb_pixel_total : 146658 time to create 1 rle with old method : 0.18042540550231934 time for calcul the mask position with numpy : 0.04473519325256348 nb_pixel_total : 28916 time to create 1 rle with old method : 0.03821134567260742 time for calcul the mask position with numpy : 0.05236959457397461 nb_pixel_total : 20856 time to create 1 rle with old method : 0.023646831512451172 create new chi : 2.7414910793304443 time to delete rle : 0.0026559829711914062 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 9178 TO DO : save crop sub photo not yet done ! save time : 3.3479533195495605 nb_obj : 14 nb_hashtags : 5 time to prepare the origin masks : 7.430700063705444 time for calcul the mask position with numpy : 0.47345614433288574 nb_pixel_total : 7853493 time to create 1 rle with new method : 0.7998147010803223 time for calcul the mask position with numpy : 0.032532453536987305 nb_pixel_total : 56089 time to create 1 rle with old method : 0.06438064575195312 time for calcul the mask position with numpy : 0.029723167419433594 nb_pixel_total : 65723 time to create 1 rle with old method : 0.0735316276550293 time for calcul the mask position with numpy : 0.02872014045715332 nb_pixel_total : 22482 time to create 1 rle with old method : 0.025603771209716797 time for calcul the mask position with numpy : 0.04619002342224121 nb_pixel_total : 22769 time to create 1 rle with old method : 0.02546858787536621 time for calcul the mask position with numpy : 0.04491400718688965 nb_pixel_total : 11081 time to create 1 rle with old method : 0.012420892715454102 time for calcul the mask position with numpy : 0.04143977165222168 nb_pixel_total : 20915 time to create 1 rle with old method : 0.023789644241333008 time for calcul the mask position with numpy : 0.04841756820678711 nb_pixel_total : 28565 time to create 1 rle with old method : 0.03228569030761719 time for calcul the mask position with numpy : 0.05936145782470703 nb_pixel_total : 40186 time to create 1 rle with old method : 0.04510092735290527 time for calcul the mask position with numpy : 0.04345226287841797 nb_pixel_total : 18448 time to create 1 rle with old method : 0.020849943161010742 time for calcul the mask position with numpy : 0.03305339813232422 nb_pixel_total : 45529 time to create 1 rle with old method : 0.051239728927612305 time for calcul the mask position with numpy : 0.041004180908203125 nb_pixel_total : 28144 time to create 1 rle with old method : 0.031676292419433594 time for calcul the mask position with numpy : 0.0359189510345459 nb_pixel_total : 34472 time to create 1 rle with old method : 0.04207301139831543 time for calcul the mask position with numpy : 0.03210568428039551 nb_pixel_total : 25640 time to create 1 rle with old method : 0.02934432029724121 time for calcul the mask position with numpy : 0.033965110778808594 nb_pixel_total : 20864 time to create 1 rle with old method : 0.02329111099243164 create new chi : 2.400174140930176 time to delete rle : 0.002160787582397461 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9342 TO DO : save crop sub photo not yet done ! save time : 5.213759899139404 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 9.139608383178711 time for calcul the mask position with numpy : 0.8558797836303711 nb_pixel_total : 6877420 time to create 1 rle with new method : 1.0049293041229248 time for calcul the mask position with numpy : 0.05313873291015625 nb_pixel_total : 131393 time to create 1 rle with old method : 0.14687061309814453 time for calcul the mask position with numpy : 0.05310702323913574 nb_pixel_total : 224237 time to create 1 rle with new method : 0.7127835750579834 time for calcul the mask position with numpy : 0.05036520957946777 nb_pixel_total : 75377 time to create 1 rle with old method : 0.08441329002380371 time for calcul the mask position with numpy : 0.050841331481933594 nb_pixel_total : 198364 time to create 1 rle with new method : 0.6189486980438232 time for calcul the mask position with numpy : 0.0398402214050293 nb_pixel_total : 4364 time to create 1 rle with old method : 0.005034685134887695 time for calcul the mask position with numpy : 0.04063272476196289 nb_pixel_total : 15867 time to create 1 rle with old method : 0.019811153411865234 time for calcul the mask position with numpy : 0.048753976821899414 nb_pixel_total : 26211 time to create 1 rle with old method : 0.030511856079101562 time for calcul the mask position with numpy : 0.04380059242248535 nb_pixel_total : 10680 time to create 1 rle with old method : 0.014256477355957031 time for calcul the mask position with numpy : 0.041089773178100586 nb_pixel_total : 20070 time to create 1 rle with old method : 0.022559404373168945 time for calcul the mask position with numpy : 0.033783674240112305 nb_pixel_total : 70881 time to create 1 rle with old method : 0.08056378364562988 time for calcul the mask position with numpy : 0.025961875915527344 nb_pixel_total : 24429 time to create 1 rle with old method : 0.02732706069946289 time for calcul the mask position with numpy : 0.025990009307861328 nb_pixel_total : 163395 time to create 1 rle with new method : 0.5790560245513916 time for calcul the mask position with numpy : 0.027173757553100586 nb_pixel_total : 10397 time to create 1 rle with old method : 0.011598587036132812 time for calcul the mask position with numpy : 0.02696990966796875 nb_pixel_total : 52820 time to create 1 rle with old method : 0.05901479721069336 time for calcul the mask position with numpy : 0.025821685791015625 nb_pixel_total : 13356 time to create 1 rle with old method : 0.015074014663696289 time for calcul the mask position with numpy : 0.02784109115600586 nb_pixel_total : 323659 time to create 1 rle with new method : 0.7666425704956055 time for calcul the mask position with numpy : 0.04826045036315918 nb_pixel_total : 44272 time to create 1 rle with old method : 0.049817800521850586 time for calcul the mask position with numpy : 0.042226552963256836 nb_pixel_total : 7208 time to create 1 rle with old method : 0.008220434188842773 create new chi : 5.98676609992981 time to delete rle : 0.0019648075103759766 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 14010 TO DO : save crop sub photo not yet done ! save time : 2.366703748703003 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 8.188324451446533 time for calcul the mask position with numpy : 0.4898796081542969 nb_pixel_total : 7419657 time to create 1 rle with new method : 0.5269017219543457 time for calcul the mask position with numpy : 0.05427742004394531 nb_pixel_total : 29812 time to create 1 rle with old method : 0.03684067726135254 time for calcul the mask position with numpy : 0.05500340461730957 nb_pixel_total : 190953 time to create 1 rle with new method : 0.5758230686187744 time for calcul the mask position with numpy : 0.054123878479003906 nb_pixel_total : 12388 time to create 1 rle with old method : 0.013936996459960938 time for calcul the mask position with numpy : 0.05362224578857422 nb_pixel_total : 44655 time to create 1 rle with old method : 0.05065417289733887 time for calcul the mask position with numpy : 0.058379173278808594 nb_pixel_total : 7730 time to create 1 rle with old method : 0.008902311325073242 time for calcul the mask position with numpy : 0.05343914031982422 nb_pixel_total : 25225 time to create 1 rle with old method : 0.028441190719604492 time for calcul the mask position with numpy : 0.05345797538757324 nb_pixel_total : 50269 time to create 1 rle with old method : 0.05642390251159668 time for calcul the mask position with numpy : 0.05328774452209473 nb_pixel_total : 25514 time to create 1 rle with old method : 0.028779029846191406 time for calcul the mask position with numpy : 0.05634331703186035 nb_pixel_total : 11394 time to create 1 rle with old method : 0.01296377182006836 time for calcul the mask position with numpy : 0.04196310043334961 nb_pixel_total : 24328 time to create 1 rle with old method : 0.027181148529052734 time for calcul the mask position with numpy : 0.032318830490112305 nb_pixel_total : 3841 time to create 1 rle with old method : 0.004377126693725586 time for calcul the mask position with numpy : 0.03392791748046875 nb_pixel_total : 69366 time to create 1 rle with old method : 0.0774831771850586 time for calcul the mask position with numpy : 0.033805131912231445 nb_pixel_total : 51166 time to create 1 rle with old method : 0.05720639228820801 time for calcul the mask position with numpy : 0.03457951545715332 nb_pixel_total : 52389 time to create 1 rle with old method : 0.05992698669433594 time for calcul the mask position with numpy : 0.03462386131286621 nb_pixel_total : 115965 time to create 1 rle with old method : 0.13485383987426758 time for calcul the mask position with numpy : 0.033138275146484375 nb_pixel_total : 53405 time to create 1 rle with old method : 0.05980181694030762 time for calcul the mask position with numpy : 0.03091907501220703 nb_pixel_total : 32017 time to create 1 rle with old method : 0.04189777374267578 time for calcul the mask position with numpy : 0.053681135177612305 nb_pixel_total : 63570 time to create 1 rle with old method : 0.07180953025817871 time for calcul the mask position with numpy : 0.04439353942871094 nb_pixel_total : 10756 time to create 1 rle with old method : 0.012145042419433594 create new chi : 3.33081316947937 time to delete rle : 0.0015146732330322266 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 11651 TO DO : save crop sub photo not yet done ! save time : 1.3631792068481445 map_output_result : {1370460705: (0.0, 'Should be the crop_list due to order', 0), 1370460704: (0.0, 'Should be the crop_list due to order', 0), 1370460703: (0.0, 'Should be the crop_list due to order', 0), 1370460701: (0.0, 'Should be the crop_list due to order', 0), 1370460663: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1370460705, 1370460704, 1370460703, 1370460701, 1370460663] Looping around the photos to save general results len do output : 5 /1370460705.Didn't retrieve data . /1370460704.Didn't retrieve data . /1370460703.Didn't retrieve data . /1370460701.Didn't retrieve data . /1370460663.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460705', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460704', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460703', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460701', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460663', None, None, None, None, None, '3234676') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013059139251708984 save_final save missing photos in datou_result : time spend for datou_step_exec : 72.38346314430237 time spend to save output : 0.01347661018371582 total time spend for step 3 : 72.39693975448608 step4:ventilate_hashtags_in_portfolio Fri Jul 4 09:13:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 24581228 get user id for portfolio 24581228 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581228 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','carton','metal','flou','papier','autre','pet_clair','mal_croppe','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581228 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','carton','metal','flou','papier','autre','pet_clair','mal_croppe','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581228 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','background','carton','metal','flou','papier','autre','pet_clair','mal_croppe','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/24583637,24583638,24583639,24583640,24583641,24583642,24583643,24583644,24583645,24583646,24583647?tags=pehd,background,carton,metal,flou,papier,autre,pet_clair,mal_croppe,pet_fonce,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1370460705, 1370460704, 1370460703, 1370460701, 1370460663] Looping around the photos to save general results len do output : 1 /24581228. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460705', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460704', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460703', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460701', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460663', None, None, None, None, None, '3234676') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013069868087768555 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6378521919250488 time spend to save output : 0.013402700424194336 total time spend for step 4 : 1.6512548923492432 step5:final Fri Jul 4 09:13:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1370460705: ('0.1078739631558642',), 1370460704: ('0.1078739631558642',), 1370460703: ('0.1078739631558642',), 1370460701: ('0.1078739631558642',), 1370460663: ('0.1078739631558642',)} new output for save of step final : {1370460705: ('0.1078739631558642',), 1370460704: ('0.1078739631558642',), 1370460703: ('0.1078739631558642',), 1370460701: ('0.1078739631558642',), 1370460663: ('0.1078739631558642',)} [1370460705, 1370460704, 1370460703, 1370460701, 1370460663] Looping around the photos to save general results len do output : 5 /1370460705.Didn't retrieve data . /1370460704.Didn't retrieve data . /1370460703.Didn't retrieve data . /1370460701.Didn't retrieve data . /1370460663.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460705', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460704', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460703', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460701', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460663', None, None, None, None, None, '3234676') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01155853271484375 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12348580360412598 time spend to save output : 0.012022972106933594 total time spend for step 5 : 0.13550877571105957 step6:blur_detection Fri Jul 4 09:13:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834.jpg resize: (2160, 3840) 1370460705 -7.10982732380071 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526.jpg resize: (2160, 3840) 1370460704 -7.19824880040854 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850.jpg resize: (2160, 3840) 1370460703 -7.22735078222771 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019.jpg resize: (2160, 3840) 1370460701 -7.080159107371469 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183.jpg resize: (2160, 3840) 1370460663 -7.209132804956914 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580396_0.png resize: (266, 216) 1370511611 -2.2707886354167113 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580398_0.png resize: (347, 438) 1370511612 -3.1381519757113527 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580400_0.png resize: (106, 166) 1370511613 3.1584182168751482 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580401_0.png resize: (207, 103) 1370511614 -4.0174410629595165 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580402_0.png resize: (77, 176) 1370511615 3.936643796533596 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580404_0.png resize: (158, 253) 1370511616 -2.8373308368919425 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580409_0.png resize: (614, 406) 1370511617 -4.411236139148632 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580410_0.png resize: (185, 203) 1370511618 -1.2522189702976079 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580411_0.png resize: (100, 232) 1370511619 -2.9166210787307802 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580412_0.png resize: (174, 188) 1370511620 -2.1571982869694866 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580413_0.png resize: (129, 305) 1370511621 -2.180455593362965 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580414_0.png resize: (447, 463) 1370511622 -5.307138330935308 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580415_0.png resize: (78, 142) 1370511623 -0.5836458128982048 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580416_0.png resize: (190, 274) 1370511624 -1.5632472411189071 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580417_0.png resize: (364, 130) 1370511625 -2.9797447465485747 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580418_0.png resize: (150, 142) 1370511626 -0.9595035245222471 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580419_0.png resize: (106, 139) 1370511627 -2.1409333052747 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580421_0.png resize: (201, 273) 1370511628 -4.263239768670965 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580422_0.png resize: (300, 215) 1370511629 -1.7346242219458072 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580424_0.png resize: (229, 154) 1370511630 -2.822576420988495 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580426_0.png resize: (251, 294) 1370511631 -3.78348703889605 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580427_0.png resize: (154, 149) 1370511632 1.8925704691883825 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580428_0.png resize: (197, 229) 1370511633 -0.24180297673878057 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580429_0.png resize: (193, 231) 1370511634 -2.8491305141221597 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580431_0.png resize: (191, 348) 1370511635 -2.5740332621163904 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580433_0.png resize: (265, 247) 1370511636 -4.049432349687282 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580434_0.png resize: (325, 219) 1370511637 -3.932016461943291 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580436_0.png resize: (150, 98) 1370511638 -3.9681448762950002 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580438_0.png resize: (162, 219) 1370511639 -2.8970069789167985 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580441_0.png resize: (111, 81) 1370511640 -4.333853141931241 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580442_0.png resize: (266, 293) 1370511641 -1.954084868940373 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580443_0.png resize: (716, 667) 1370511642 -1.8473659691411957 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580444_0.png resize: (168, 104) 1370511643 -2.539239774151619 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580445_0.png resize: (346, 280) 1370511644 -1.88317213251063 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580446_0.png resize: (102, 133) 1370511645 -4.1941836571567555 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580448_0.png resize: (182, 200) 1370511646 -3.6784261006434176 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580450_0.png resize: (200, 129) 1370511647 -3.198005933685251 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580451_0.png resize: (153, 144) 1370511648 -4.729947922807284 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580452_0.png resize: (156, 210) 1370511649 -4.626105293472699 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580453_0.png resize: (165, 203) 1370511650 -3.5331205993577557 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580455_0.png resize: (687, 391) 1370511651 -1.3339430265657906 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580456_0.png resize: (395, 339) 1370511652 -2.3749863677570895 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580459_0.png resize: (150, 91) 1370511653 -3.522846696560717 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580460_0.png resize: (286, 361) 1370511654 -3.2392177882649245 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580461_0.png resize: (210, 201) 1370511655 -4.575310970987697 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580462_0.png resize: (302, 270) 1370511656 3.078921847690465 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580463_0.png resize: (331, 507) 1370511657 -5.001624065847142 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580464_0.png resize: (331, 225) 1370511658 -4.5007062173253045 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580465_0.png resize: (334, 227) 1370511659 -2.54805709861392 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580466_0.png resize: (239, 437) 1370511660 -0.615286708229451 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580467_0.png resize: (90, 51) 1370511661 -2.66637293521598 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580469_0.png resize: (81, 166) 1370511662 -4.534883298369565 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580471_0.png resize: (361, 202) 1370511663 -5.471220674215033 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580473_0.png resize: (111, 91) 1370511664 -3.688781722270237 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580474_0.png resize: (331, 264) 1370511665 -4.043139605454635 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580475_0.png resize: (180, 89) 1370511667 -4.709452955295126 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580477_0.png resize: (244, 209) 1370511668 -4.573932179462365 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580430_0.png resize: (262, 178) 1370511685 -3.1794048719822166 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580432_0.png resize: (226, 133) 1370511686 -3.992460627928459 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580454_0.png resize: (95, 56) 1370511688 -2.5101719669779863 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580468_0.png resize: (194, 146) 1370511690 -4.557341942963377 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580425_0.png resize: (72, 78) 1370511712 -3.7233620476294824 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580435_0.png resize: (191, 164) 1370511714 -4.019752089388981 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580397_0.png resize: (363, 878) 1370511798 -3.693229492471002 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580399_0.png resize: (352, 360) 1370511800 -5.114781628956251 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580403_0.png resize: (802, 728) 1370511802 -4.376153367313475 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580405_0.png resize: (335, 263) 1370511803 -4.75167100290918 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580406_0.png resize: (249, 315) 1370511805 -4.410692301580279 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580407_0.png resize: (116, 213) 1370511806 -4.528152084500925 treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580408_0.png resize: (233, 597) 1370511807 -5.007714046665621 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580420_0.png resize: (133, 223) 1370511809 -3.9899300040355534 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580439_0.png resize: (187, 482) 1370511810 -4.464169217207631 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580440_0.png resize: (318, 234) 1370511811 -5.504882939612102 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580447_0.png resize: (439, 563) 1370511812 -5.082467954558297 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580449_0.png resize: (365, 240) 1370511814 -4.615952365285381 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580457_0.png resize: (609, 498) 1370511815 -4.061150596323199 treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580458_0.png resize: (633, 297) 1370511816 -5.491709785648395 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580476_0.png resize: (553, 402) 1370511818 -5.764457927011081 treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580423_0.png resize: (245, 294) 1370511842 -4.552472004671512 treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580437_0.png resize: (266, 163) 1370511844 -3.747627217544299 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580470_0.png resize: (124, 245) 1370511845 -1.7946167445092254 treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580472_0.png resize: (89, 344) 1370511847 -5.175416658405978 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 87 time used for this insertion : 0.014603137969970703 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 87 time used for this insertion : 0.031049489974975586 save missing photos in datou_result : time spend for datou_step_exec : 22.501027584075928 time spend to save output : 0.05063033103942871 total time spend for step 6 : 22.551657915115356 step7:brightness Fri Jul 4 09:14:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834.jpg treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526.jpg treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850.jpg treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019.jpg treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183.jpg treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580396_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580398_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580400_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580401_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580402_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580404_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580409_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580410_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580411_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580412_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580413_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580414_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580415_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580416_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580417_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580418_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580419_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580421_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580422_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580424_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580426_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580427_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580428_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580429_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580431_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580433_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580434_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580436_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580438_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580441_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580442_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580443_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580444_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580445_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580446_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580448_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580450_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580451_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580452_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580453_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580455_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580456_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580459_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580460_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580461_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580462_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580463_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580464_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580465_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580466_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580467_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580469_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580471_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580473_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580474_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580475_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580477_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580430_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580432_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580454_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580468_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580425_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580435_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580397_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580399_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580403_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580405_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580406_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580407_0.png treat image : temp/1751613030_746359_1370460705_3365f872cbba67288e4f9da8363daa20_89523834_rle_crop_3871580408_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580420_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580439_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580440_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580447_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580449_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580457_0.png treat image : temp/1751613030_746359_1370460701_ea717764cfbca2ca1ed90a59a8e2a0dd_88162019_rle_crop_3871580458_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580476_0.png treat image : temp/1751613030_746359_1370460704_d600caea7c7f8d94b66acee5d01fbee4_10924526_rle_crop_3871580423_0.png treat image : temp/1751613030_746359_1370460703_325936975bd294753ca5dc11980d47a0_67577850_rle_crop_3871580437_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580470_0.png treat image : temp/1751613030_746359_1370460663_8163e43460120c1d63c862827175cece_53398183_rle_crop_3871580472_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 87 time used for this insertion : 0.014436483383178711 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 87 time used for this insertion : 0.10303759574890137 save missing photos in datou_result : time spend for datou_step_exec : 6.231092929840088 time spend to save output : 0.12241435050964355 total time spend for step 7 : 6.3535072803497314 step8:velours_tree Fri Jul 4 09:14:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.317549467086792 time spend to save output : 4.220008850097656e-05 total time spend for step 8 : 0.31759166717529297 step9:send_mail_cod Fri Jul 4 09:14:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P24581228_04-07-2025_09_14_11.pdf 24583637 imagette245836371751613251 24583638 imagette245836381751613251 24583639 change filename to text .change filename to text .change filename to text .change filename to text .imagette245836391751613251 24583640 change filename to text .change filename to text .imagette245836401751613251 24583641 imagette245836411751613251 24583642 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette245836421751613251 24583643 imagette245836431751613253 24583644 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette245836441751613253 24583645 imagette245836451751613254 24583646 change filename to text .change filename to text .change filename to text .change filename to text .imagette245836461751613254 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=24581228 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/24583637,24583638,24583639,24583640,24583641,24583642,24583643,24583644,24583645,24583646,24583647?tags=pehd,background,carton,metal,flou,papier,autre,pet_clair,mal_croppe,pet_fonce,environnement args[1370460705] : ((1370460705, -7.10982732380071, 492609224), (1370460705, 0.7597161263518394, 2107752395), '0.1078739631558642') We are sending mail with results at report@fotonower.com args[1370460704] : ((1370460704, -7.19824880040854, 492609224), (1370460704, 0.78833212576209, 2107752395), '0.1078739631558642') We are sending mail with results at report@fotonower.com args[1370460703] : ((1370460703, -7.22735078222771, 492609224), (1370460703, 0.7776133171710072, 2107752395), '0.1078739631558642') We are sending mail with results at report@fotonower.com args[1370460701] : ((1370460701, -7.080159107371469, 492609224), (1370460701, 0.7714247027207443, 2107752395), '0.1078739631558642') We are sending mail with results at report@fotonower.com args[1370460663] : ((1370460663, -7.209132804956914, 492609224), (1370460663, 0.7800415289181308, 2107752395), '0.1078739631558642') We are sending mail with results at report@fotonower.com refus_total : 0.1078739631558642 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=24581228 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581228_04-07-2025_09_14_11.pdf results_Auto_P24581228_04-07-2025_09_14_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581228_04-07-2025_09_14_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','24581228','results_Auto_P24581228_04-07-2025_09_14_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581228_04-07-2025_09_14_11.pdf','pdf','','0.57','0.1078739631558642') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/24581228

https://www.fotonower.com/image?json=false&list_photos_id=1370460705
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1370460704
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1370460703
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1370460701
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1370460663
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.79%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/24583639?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/24583640?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/24583642?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/24583644?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/24583646?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581228_04-07-2025_09_14_11.pdf.

Lien vers velours :https://www.fotonower.com/velours/24583637,24583638,24583639,24583640,24583641,24583642,24583643,24583644,24583645,24583646,24583647?tags=pehd,background,carton,metal,flou,papier,autre,pet_clair,mal_croppe,pet_fonce,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 04 Jul 2025 07:14:16 GMT Content-Length: 0 Connection: close X-Message-Id: QoITWdC7RPWJlpqLdH-JOQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1370460705, 1370460704, 1370460703, 1370460701, 1370460663] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460705', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460704', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460703', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460701', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460663', None, None, None, None, None, '3234676') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013123035430908203 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.63597559928894 time spend to save output : 0.013407468795776367 total time spend for step 9 : 5.649383068084717 step10:split_time_score Fri Jul 4 09:14:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03072025 24581228 Nombre de photos uploadées : 5 / 23040 (0%) 03072025 24581228 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 03072025 24581228 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00029921531677246094 elapsed_time : insert_dashboard_record_day_entry 0.02468562126159668 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07112368741734716 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581025_04-07-2025_09_02_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581025 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581025 AND mptpi.`type`=3726 To do Qualite : 0.029696513136184908 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24569263_03-07-2025_11_43_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24569263 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24569263 AND mptpi.`type`=3726 To do Qualite : 0.03129936084068947 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24569302_03-07-2025_11_44_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24569302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24569302 AND mptpi.`type`=3726 To do Qualite : 0.04215979239896914 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24571191_03-07-2025_12_26_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24571191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24571191 AND mptpi.`type`=3726 To do Qualite : 0.015375019127491259 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581039_04-07-2025_08_59_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581039 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581039 AND mptpi.`type`=3726 To do Qualite : 0.1078739631558642 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581228_04-07-2025_09_14_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581228 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581228 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581312 order by id desc limit 1 Qualite : 0.16029692322530867 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581421_04-07-2025_08_54_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581421 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581421 AND mptpi.`type`=3594 To do Qualite : 0.032759106967075576 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24581424_04-07-2025_08_51_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24581424 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24581424 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03072025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1370460705, 1370460704, 1370460703, 1370460701, 1370460663] Looping around the photos to save general results len do output : 1 /24581228Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460705', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460704', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460703', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460701', None, None, None, None, None, '3234676') ('3318', None, None, None, None, None, None, None, '3234676') ('3318', '24581228', '1370460663', None, None, None, None, None, '3234676') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01664257049560547 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7228124141693115 time spend to save output : 0.016844749450683594 total time spend for step 10 : 1.7396571636199951 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 90.29user 89.05system 3:52.72elapsed 77%CPU (0avgtext+0avgdata 4347444maxresident)k 2510288inputs+86544outputs (16871major+9064965minor)pagefaults 0swaps