python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1385354 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2856024'] with mtr_portfolio_ids : ['22988989'] and first list_photo_ids : [] new path : /proc/1385354/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.7874464988708496 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 15 03:20:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9621 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-15 03:20:34.906742: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-15 03:20:34.935144: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-15 03:20:34.937391: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5770000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-15 03:20:34.937422: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-15 03:20:34.941446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-15 03:20:35.182651: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xd1e41b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-15 03:20:35.182705: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-15 03:20:35.183725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 03:20:35.184165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 03:20:35.203869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 03:20:35.206595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 03:20:35.207152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 03:20:35.209995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 03:20:35.211517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 03:20:35.217419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 03:20:35.219315: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 03:20:35.219442: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 03:20:35.220456: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-15 03:20:35.220476: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-15 03:20:35.220489: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-15 03:20:35.222150: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8901 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-15 03:20:35.642960: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 03:20:35.643091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 03:20:35.643122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 03:20:35.643150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 03:20:35.643176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 03:20:35.643202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 03:20:35.643228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 03:20:35.643254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 03:20:35.644748: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 03:20:35.645888: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-15 03:20:35.645920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-15 03:20:35.645939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 03:20:35.645953: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-15 03:20:35.645967: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-15 03:20:35.645981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-15 03:20:35.645995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-15 03:20:35.646010: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-15 03:20:35.647155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-15 03:20:35.647190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-15 03:20:35.647198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-15 03:20:35.647205: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-15 03:20:35.648394: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8901 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-15 03:20:46.538760: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-15 03:20:46.722638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 Detection mask done ! Trying to reset tf kernel 1386011 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4332 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9621 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0009388923645019531 nb_pixel_total : 18329 time to create 1 rle with old method : 0.024703025817871094 length of segment : 142 time for calcul the mask position with numpy : 0.0040967464447021484 nb_pixel_total : 107333 time to create 1 rle with old method : 0.13086986541748047 length of segment : 375 time for calcul the mask position with numpy : 0.005692005157470703 nb_pixel_total : 170154 time to create 1 rle with new method : 0.012283802032470703 length of segment : 296 time for calcul the mask position with numpy : 0.0004096031188964844 nb_pixel_total : 11046 time to create 1 rle with old method : 0.01857614517211914 length of segment : 175 time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 19254 time to create 1 rle with old method : 0.025908946990966797 length of segment : 162 time for calcul the mask position with numpy : 0.00027298927307128906 nb_pixel_total : 6995 time to create 1 rle with old method : 0.010356903076171875 length of segment : 78 time for calcul the mask position with numpy : 0.0004038810729980469 nb_pixel_total : 7568 time to create 1 rle with old method : 0.01088094711303711 length of segment : 162 time for calcul the mask position with numpy : 0.00040340423583984375 nb_pixel_total : 2794 time to create 1 rle with old method : 0.016783475875854492 length of segment : 70 time for calcul the mask position with numpy : 0.0003540515899658203 nb_pixel_total : 7496 time to create 1 rle with old method : 0.012177467346191406 length of segment : 106 time for calcul the mask position with numpy : 0.0015528202056884766 nb_pixel_total : 21933 time to create 1 rle with old method : 0.030001163482666016 length of segment : 217 time for calcul the mask position with numpy : 0.0007412433624267578 nb_pixel_total : 20863 time to create 1 rle with old method : 0.034136056900024414 length of segment : 197 time for calcul the mask position with numpy : 0.00658106803894043 nb_pixel_total : 180272 time to create 1 rle with new method : 0.016492843627929688 length of segment : 991 time for calcul the mask position with numpy : 0.0016927719116210938 nb_pixel_total : 41381 time to create 1 rle with old method : 0.054451704025268555 length of segment : 329 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 6093 time to create 1 rle with old method : 0.007271766662597656 length of segment : 155 time for calcul the mask position with numpy : 0.0026340484619140625 nb_pixel_total : 69957 time to create 1 rle with old method : 0.10415816307067871 length of segment : 558 time for calcul the mask position with numpy : 0.0012416839599609375 nb_pixel_total : 22115 time to create 1 rle with old method : 0.026803016662597656 length of segment : 229 time for calcul the mask position with numpy : 0.0033669471740722656 nb_pixel_total : 79596 time to create 1 rle with old method : 0.10279536247253418 length of segment : 535 time for calcul the mask position with numpy : 0.001436471939086914 nb_pixel_total : 39157 time to create 1 rle with old method : 0.0489497184753418 length of segment : 321 time for calcul the mask position with numpy : 0.0005769729614257812 nb_pixel_total : 25934 time to create 1 rle with old method : 0.03385162353515625 length of segment : 226 time for calcul the mask position with numpy : 0.0015816688537597656 nb_pixel_total : 89419 time to create 1 rle with old method : 0.09868764877319336 length of segment : 476 time for calcul the mask position with numpy : 0.0015528202056884766 nb_pixel_total : 67687 time to create 1 rle with old method : 0.08117079734802246 length of segment : 247 time for calcul the mask position with numpy : 0.003149747848510742 nb_pixel_total : 134524 time to create 1 rle with old method : 0.15346026420593262 length of segment : 574 time for calcul the mask position with numpy : 0.0009298324584960938 nb_pixel_total : 57234 time to create 1 rle with old method : 0.06402039527893066 length of segment : 343 time for calcul the mask position with numpy : 0.0009942054748535156 nb_pixel_total : 56441 time to create 1 rle with old method : 0.09102749824523926 length of segment : 231 time for calcul the mask position with numpy : 0.001218557357788086 nb_pixel_total : 37090 time to create 1 rle with old method : 0.04186654090881348 length of segment : 182 time for calcul the mask position with numpy : 0.0014789104461669922 nb_pixel_total : 36110 time to create 1 rle with old method : 0.04149127006530762 length of segment : 201 time for calcul the mask position with numpy : 0.002093791961669922 nb_pixel_total : 64860 time to create 1 rle with old method : 0.07358050346374512 length of segment : 335 time for calcul the mask position with numpy : 0.001922607421875 nb_pixel_total : 63169 time to create 1 rle with old method : 0.07106876373291016 length of segment : 330 time for calcul the mask position with numpy : 0.003431081771850586 nb_pixel_total : 89803 time to create 1 rle with old method : 0.10260891914367676 length of segment : 417 time for calcul the mask position with numpy : 0.0015726089477539062 nb_pixel_total : 24598 time to create 1 rle with old method : 0.028435945510864258 length of segment : 202 time for calcul the mask position with numpy : 0.0005941390991210938 nb_pixel_total : 12060 time to create 1 rle with old method : 0.013640403747558594 length of segment : 202 time for calcul the mask position with numpy : 0.0016026496887207031 nb_pixel_total : 31758 time to create 1 rle with old method : 0.03635859489440918 length of segment : 298 time for calcul the mask position with numpy : 0.0014772415161132812 nb_pixel_total : 22915 time to create 1 rle with old method : 0.03596854209899902 length of segment : 169 time for calcul the mask position with numpy : 0.001056671142578125 nb_pixel_total : 28568 time to create 1 rle with old method : 0.03270459175109863 length of segment : 231 time for calcul the mask position with numpy : 0.0015392303466796875 nb_pixel_total : 37533 time to create 1 rle with old method : 0.04332590103149414 length of segment : 201 time for calcul the mask position with numpy : 0.0010907649993896484 nb_pixel_total : 28193 time to create 1 rle with old method : 0.03260183334350586 length of segment : 281 time for calcul the mask position with numpy : 0.0006136894226074219 nb_pixel_total : 12573 time to create 1 rle with old method : 0.015932083129882812 length of segment : 120 time for calcul the mask position with numpy : 0.0009100437164306641 nb_pixel_total : 24039 time to create 1 rle with old method : 0.02852463722229004 length of segment : 187 time for calcul the mask position with numpy : 0.0021033287048339844 nb_pixel_total : 34251 time to create 1 rle with old method : 0.03902888298034668 length of segment : 355 time for calcul the mask position with numpy : 0.0006184577941894531 nb_pixel_total : 9328 time to create 1 rle with old method : 0.01137399673461914 length of segment : 95 time for calcul the mask position with numpy : 0.001756906509399414 nb_pixel_total : 48919 time to create 1 rle with old method : 0.05475306510925293 length of segment : 357 time for calcul the mask position with numpy : 0.0017216205596923828 nb_pixel_total : 48482 time to create 1 rle with old method : 0.05416560173034668 length of segment : 266 time for calcul the mask position with numpy : 0.001233816146850586 nb_pixel_total : 36866 time to create 1 rle with old method : 0.041435956954956055 length of segment : 270 time for calcul the mask position with numpy : 0.0007364749908447266 nb_pixel_total : 19968 time to create 1 rle with old method : 0.025600194931030273 length of segment : 186 time for calcul the mask position with numpy : 0.0011687278747558594 nb_pixel_total : 23910 time to create 1 rle with old method : 0.03128314018249512 length of segment : 340 time for calcul the mask position with numpy : 0.0009062290191650391 nb_pixel_total : 27398 time to create 1 rle with old method : 0.03530263900756836 length of segment : 178 time for calcul the mask position with numpy : 0.001188039779663086 nb_pixel_total : 32819 time to create 1 rle with old method : 0.03783726692199707 length of segment : 296 time for calcul the mask position with numpy : 0.00041365623474121094 nb_pixel_total : 8160 time to create 1 rle with old method : 0.009693622589111328 length of segment : 93 time for calcul the mask position with numpy : 0.0013935565948486328 nb_pixel_total : 37979 time to create 1 rle with old method : 0.0440678596496582 length of segment : 485 time for calcul the mask position with numpy : 0.0019876956939697266 nb_pixel_total : 83913 time to create 1 rle with old method : 0.09688329696655273 length of segment : 264 time for calcul the mask position with numpy : 0.0011472702026367188 nb_pixel_total : 29153 time to create 1 rle with old method : 0.033484458923339844 length of segment : 221 time for calcul the mask position with numpy : 0.014158248901367188 nb_pixel_total : 271752 time to create 1 rle with new method : 0.012001276016235352 length of segment : 611 time for calcul the mask position with numpy : 0.0004303455352783203 nb_pixel_total : 9300 time to create 1 rle with old method : 0.010846853256225586 length of segment : 76 time for calcul the mask position with numpy : 0.0006175041198730469 nb_pixel_total : 19808 time to create 1 rle with old method : 0.023126840591430664 length of segment : 120 time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 9961 time to create 1 rle with old method : 0.011802911758422852 length of segment : 151 time for calcul the mask position with numpy : 0.0015206336975097656 nb_pixel_total : 35316 time to create 1 rle with old method : 0.04088425636291504 length of segment : 350 time for calcul the mask position with numpy : 0.0372469425201416 nb_pixel_total : 676782 time to create 1 rle with new method : 0.049639225006103516 length of segment : 879 time for calcul the mask position with numpy : 0.0006923675537109375 nb_pixel_total : 20959 time to create 1 rle with old method : 0.023888349533081055 length of segment : 147 time for calcul the mask position with numpy : 0.0005261898040771484 nb_pixel_total : 14872 time to create 1 rle with old method : 0.023592710494995117 length of segment : 172 time for calcul the mask position with numpy : 0.0004432201385498047 nb_pixel_total : 11410 time to create 1 rle with old method : 0.013258218765258789 length of segment : 152 time for calcul the mask position with numpy : 0.001950979232788086 nb_pixel_total : 58139 time to create 1 rle with old method : 0.06699395179748535 length of segment : 317 time for calcul the mask position with numpy : 0.0008170604705810547 nb_pixel_total : 18251 time to create 1 rle with old method : 0.021117448806762695 length of segment : 180 time for calcul the mask position with numpy : 0.0007224082946777344 nb_pixel_total : 24365 time to create 1 rle with old method : 0.028113842010498047 length of segment : 175 time for calcul the mask position with numpy : 0.0008111000061035156 nb_pixel_total : 24844 time to create 1 rle with old method : 0.02827620506286621 length of segment : 306 time for calcul the mask position with numpy : 0.0003037452697753906 nb_pixel_total : 5210 time to create 1 rle with old method : 0.006937503814697266 length of segment : 95 time for calcul the mask position with numpy : 0.0005974769592285156 nb_pixel_total : 18782 time to create 1 rle with old method : 0.021769046783447266 length of segment : 146 time for calcul the mask position with numpy : 0.0019783973693847656 nb_pixel_total : 77079 time to create 1 rle with old method : 0.08616876602172852 length of segment : 312 time for calcul the mask position with numpy : 0.002124786376953125 nb_pixel_total : 54055 time to create 1 rle with old method : 0.06151103973388672 length of segment : 400 time for calcul the mask position with numpy : 0.0013489723205566406 nb_pixel_total : 25351 time to create 1 rle with old method : 0.029176950454711914 length of segment : 233 time for calcul the mask position with numpy : 0.0005040168762207031 nb_pixel_total : 12364 time to create 1 rle with old method : 0.014356136322021484 length of segment : 134 time for calcul the mask position with numpy : 0.005341053009033203 nb_pixel_total : 196764 time to create 1 rle with new method : 0.00921630859375 length of segment : 447 time for calcul the mask position with numpy : 0.0012154579162597656 nb_pixel_total : 41171 time to create 1 rle with old method : 0.04784345626831055 length of segment : 263 time for calcul the mask position with numpy : 0.001020669937133789 nb_pixel_total : 28389 time to create 1 rle with old method : 0.033334970474243164 length of segment : 272 time for calcul the mask position with numpy : 0.0007245540618896484 nb_pixel_total : 19506 time to create 1 rle with old method : 0.022583723068237305 length of segment : 129 time for calcul the mask position with numpy : 0.0021479129791259766 nb_pixel_total : 81955 time to create 1 rle with old method : 0.09194684028625488 length of segment : 263 time for calcul the mask position with numpy : 0.0003211498260498047 nb_pixel_total : 11120 time to create 1 rle with old method : 0.014027833938598633 length of segment : 133 time for calcul the mask position with numpy : 0.0059053897857666016 nb_pixel_total : 186746 time to create 1 rle with new method : 0.008610248565673828 length of segment : 539 time for calcul the mask position with numpy : 0.0016410350799560547 nb_pixel_total : 48440 time to create 1 rle with old method : 0.05749678611755371 length of segment : 244 time for calcul the mask position with numpy : 0.0010390281677246094 nb_pixel_total : 31437 time to create 1 rle with old method : 0.0358729362487793 length of segment : 196 time for calcul the mask position with numpy : 0.0050754547119140625 nb_pixel_total : 144738 time to create 1 rle with old method : 0.16633319854736328 length of segment : 268 time for calcul the mask position with numpy : 0.0025894641876220703 nb_pixel_total : 70789 time to create 1 rle with old method : 0.08004546165466309 length of segment : 577 time for calcul the mask position with numpy : 0.0006842613220214844 nb_pixel_total : 16701 time to create 1 rle with old method : 0.019143104553222656 length of segment : 143 time for calcul the mask position with numpy : 0.001958131790161133 nb_pixel_total : 79877 time to create 1 rle with old method : 0.09260940551757812 length of segment : 309 time for calcul the mask position with numpy : 0.0014939308166503906 nb_pixel_total : 45820 time to create 1 rle with old method : 0.05235433578491211 length of segment : 247 time for calcul the mask position with numpy : 0.00480341911315918 nb_pixel_total : 148603 time to create 1 rle with old method : 0.16835737228393555 length of segment : 404 time for calcul the mask position with numpy : 0.0005593299865722656 nb_pixel_total : 12844 time to create 1 rle with old method : 0.016431331634521484 length of segment : 120 time for calcul the mask position with numpy : 0.0006282329559326172 nb_pixel_total : 14691 time to create 1 rle with old method : 0.017240285873413086 length of segment : 139 time for calcul the mask position with numpy : 0.0023546218872070312 nb_pixel_total : 79083 time to create 1 rle with old method : 0.09076404571533203 length of segment : 765 time for calcul the mask position with numpy : 0.003847837448120117 nb_pixel_total : 38471 time to create 1 rle with old method : 0.045502662658691406 length of segment : 464 time for calcul the mask position with numpy : 0.0015032291412353516 nb_pixel_total : 63053 time to create 1 rle with old method : 0.07868576049804688 length of segment : 285 time for calcul the mask position with numpy : 0.0014681816101074219 nb_pixel_total : 54913 time to create 1 rle with old method : 0.06337881088256836 length of segment : 230 time for calcul the mask position with numpy : 0.006822347640991211 nb_pixel_total : 273381 time to create 1 rle with new method : 0.025910377502441406 length of segment : 695 time for calcul the mask position with numpy : 0.0008871555328369141 nb_pixel_total : 30423 time to create 1 rle with old method : 0.041555166244506836 length of segment : 180 time for calcul the mask position with numpy : 0.0056111812591552734 nb_pixel_total : 180942 time to create 1 rle with new method : 0.009674310684204102 length of segment : 306 time for calcul the mask position with numpy : 0.0008945465087890625 nb_pixel_total : 31135 time to create 1 rle with old method : 0.04390120506286621 length of segment : 218 time for calcul the mask position with numpy : 0.0005218982696533203 nb_pixel_total : 8649 time to create 1 rle with old method : 0.010973691940307617 length of segment : 145 time for calcul the mask position with numpy : 0.0007307529449462891 nb_pixel_total : 15609 time to create 1 rle with old method : 0.018321752548217773 length of segment : 128 time for calcul the mask position with numpy : 0.0019762516021728516 nb_pixel_total : 45519 time to create 1 rle with old method : 0.05610847473144531 length of segment : 284 time for calcul the mask position with numpy : 0.0024378299713134766 nb_pixel_total : 53070 time to create 1 rle with old method : 0.07993078231811523 length of segment : 345 time for calcul the mask position with numpy : 0.0009298324584960938 nb_pixel_total : 24681 time to create 1 rle with old method : 0.02842569351196289 length of segment : 141 time for calcul the mask position with numpy : 0.0013041496276855469 nb_pixel_total : 57279 time to create 1 rle with old method : 0.06479430198669434 length of segment : 187 time for calcul the mask position with numpy : 0.0006403923034667969 nb_pixel_total : 17298 time to create 1 rle with old method : 0.019907474517822266 length of segment : 139 time for calcul the mask position with numpy : 0.002546548843383789 nb_pixel_total : 48472 time to create 1 rle with old method : 0.05435585975646973 length of segment : 414 time for calcul the mask position with numpy : 0.0014955997467041016 nb_pixel_total : 47529 time to create 1 rle with old method : 0.05412101745605469 length of segment : 161 time for calcul the mask position with numpy : 0.0005731582641601562 nb_pixel_total : 7830 time to create 1 rle with old method : 0.009256601333618164 length of segment : 138 time for calcul the mask position with numpy : 0.0008230209350585938 nb_pixel_total : 28494 time to create 1 rle with old method : 0.03325700759887695 length of segment : 172 time for calcul the mask position with numpy : 0.0013272762298583984 nb_pixel_total : 16906 time to create 1 rle with old method : 0.01950669288635254 length of segment : 387 time for calcul the mask position with numpy : 0.001794576644897461 nb_pixel_total : 35822 time to create 1 rle with old method : 0.04090285301208496 length of segment : 207 time for calcul the mask position with numpy : 0.00041365623474121094 nb_pixel_total : 11771 time to create 1 rle with old method : 0.013849735260009766 length of segment : 84 time for calcul the mask position with numpy : 0.0007312297821044922 nb_pixel_total : 32818 time to create 1 rle with old method : 0.03773999214172363 length of segment : 242 time spent for convertir_results : 9.784416198730469 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 110 chid ids of type : 3594 Number RLEs to save : 29923 save missing photos in datou_result : time spend for datou_step_exec : 62.98276662826538 time spend to save output : 1.971578598022461 total time spend for step 1 : 64.95434522628784 step2:crop_condition Thu May 15 03:21:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 110 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 65 About to insert : list_path_to_insert length 65 new photo from crops ! About to upload 65 photos upload in portfolio : 3736932 init cache_photo without model_param we have 65 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747272112_1385354 we have uploaded 65 photos in the portfolio 3736932 time of upload the photos Elapsed time : 19.660903453826904 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747272138_1385354 we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.856200456619263 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747272153_1385354 we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.290355682373047 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747272161_1385354 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7229714393615723 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747272163_1385354 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6920018196105957 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747272164_1385354 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5434980392456055 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358160700, 1358160696, 1358160693, 1358160629, 1358160626, 1358160624, 1358160500, 1358160497] Looping around the photos to save general results len do output : 110 /1358411969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358411999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358412092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160700', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160696', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160693', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160629', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160626', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160624', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160500', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160497', None, None, None, None, None, '2856024') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 338 time used for this insertion : 0.030458688735961914 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.88171219825745 time spend to save output : 0.03380417823791504 total time spend for step 2 : 67.91551637649536 step3:rle_unique_nms_with_priority Thu May 15 03:22:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 110 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 6.052411079406738 time for calcul the mask position with numpy : 0.5822775363922119 nb_pixel_total : 6220525 time to create 1 rle with new method : 0.6769614219665527 time for calcul the mask position with numpy : 0.02348494529724121 nb_pixel_total : 39157 time to create 1 rle with old method : 0.043032169342041016 time for calcul the mask position with numpy : 0.021959543228149414 nb_pixel_total : 79596 time to create 1 rle with old method : 0.08923196792602539 time for calcul the mask position with numpy : 0.021353960037231445 nb_pixel_total : 22115 time to create 1 rle with old method : 0.024043798446655273 time for calcul the mask position with numpy : 0.02391958236694336 nb_pixel_total : 69955 time to create 1 rle with old method : 0.07733988761901855 time for calcul the mask position with numpy : 0.024235248565673828 nb_pixel_total : 6093 time to create 1 rle with old method : 0.006921529769897461 time for calcul the mask position with numpy : 0.024527311325073242 nb_pixel_total : 41381 time to create 1 rle with old method : 0.046637773513793945 time for calcul the mask position with numpy : 0.024473190307617188 nb_pixel_total : 177653 time to create 1 rle with new method : 0.36368322372436523 time for calcul the mask position with numpy : 0.02275824546813965 nb_pixel_total : 20863 time to create 1 rle with old method : 0.02355337142944336 time for calcul the mask position with numpy : 0.023029327392578125 nb_pixel_total : 21933 time to create 1 rle with old method : 0.02440619468688965 time for calcul the mask position with numpy : 0.02162957191467285 nb_pixel_total : 7496 time to create 1 rle with old method : 0.008420467376708984 time for calcul the mask position with numpy : 0.022436141967773438 nb_pixel_total : 2794 time to create 1 rle with old method : 0.0031785964965820312 time for calcul the mask position with numpy : 0.022162199020385742 nb_pixel_total : 7568 time to create 1 rle with old method : 0.008405447006225586 time for calcul the mask position with numpy : 0.021871328353881836 nb_pixel_total : 6995 time to create 1 rle with old method : 0.007900238037109375 time for calcul the mask position with numpy : 0.02270674705505371 nb_pixel_total : 19254 time to create 1 rle with old method : 0.020658493041992188 time for calcul the mask position with numpy : 0.02149367332458496 nb_pixel_total : 11046 time to create 1 rle with old method : 0.012970209121704102 time for calcul the mask position with numpy : 0.021678447723388672 nb_pixel_total : 170154 time to create 1 rle with new method : 0.7031850814819336 time for calcul the mask position with numpy : 0.032592058181762695 nb_pixel_total : 107333 time to create 1 rle with old method : 0.11640381813049316 time for calcul the mask position with numpy : 0.033907413482666016 nb_pixel_total : 18329 time to create 1 rle with old method : 0.020782947540283203 create new chi : 3.3699090480804443 time to delete rle : 0.020226001739501953 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12330 TO DO : save crop sub photo not yet done ! save time : 0.811363697052002 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 4.863047122955322 time for calcul the mask position with numpy : 0.3431363105773926 nb_pixel_total : 6417772 time to create 1 rle with new method : 0.6494815349578857 time for calcul the mask position with numpy : 0.045772552490234375 nb_pixel_total : 63169 time to create 1 rle with old method : 0.09309673309326172 time for calcul the mask position with numpy : 0.04270291328430176 nb_pixel_total : 64860 time to create 1 rle with old method : 0.07739472389221191 time for calcul the mask position with numpy : 0.03710317611694336 nb_pixel_total : 36110 time to create 1 rle with old method : 0.04008007049560547 time for calcul the mask position with numpy : 0.036638498306274414 nb_pixel_total : 37090 time to create 1 rle with old method : 0.04144430160522461 time for calcul the mask position with numpy : 0.03645801544189453 nb_pixel_total : 56441 time to create 1 rle with old method : 0.0654759407043457 time for calcul the mask position with numpy : 0.03431820869445801 nb_pixel_total : 57234 time to create 1 rle with old method : 0.06777667999267578 time for calcul the mask position with numpy : 0.03447675704956055 nb_pixel_total : 134524 time to create 1 rle with old method : 0.1694939136505127 time for calcul the mask position with numpy : 0.03210115432739258 nb_pixel_total : 67687 time to create 1 rle with old method : 0.07952594757080078 time for calcul the mask position with numpy : 0.0387425422668457 nb_pixel_total : 89419 time to create 1 rle with old method : 0.09973955154418945 time for calcul the mask position with numpy : 0.03883981704711914 nb_pixel_total : 25934 time to create 1 rle with old method : 0.0288088321685791 create new chi : 2.186565637588501 time to delete rle : 0.0019617080688476562 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8450 TO DO : save crop sub photo not yet done ! save time : 0.6025567054748535 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.400821685791016 time for calcul the mask position with numpy : 0.5403146743774414 nb_pixel_total : 6597220 time to create 1 rle with new method : 0.6505837440490723 time for calcul the mask position with numpy : 0.021338939666748047 nb_pixel_total : 48482 time to create 1 rle with old method : 0.05359697341918945 time for calcul the mask position with numpy : 0.024492979049682617 nb_pixel_total : 48919 time to create 1 rle with old method : 0.05453944206237793 time for calcul the mask position with numpy : 0.021512508392333984 nb_pixel_total : 9328 time to create 1 rle with old method : 0.0106964111328125 time for calcul the mask position with numpy : 0.021582365036010742 nb_pixel_total : 34251 time to create 1 rle with old method : 0.03807425498962402 time for calcul the mask position with numpy : 0.021374940872192383 nb_pixel_total : 24039 time to create 1 rle with old method : 0.026979923248291016 time for calcul the mask position with numpy : 0.02136540412902832 nb_pixel_total : 12573 time to create 1 rle with old method : 0.014264106750488281 time for calcul the mask position with numpy : 0.02178049087524414 nb_pixel_total : 28193 time to create 1 rle with old method : 0.03147101402282715 time for calcul the mask position with numpy : 0.0299835205078125 nb_pixel_total : 37533 time to create 1 rle with old method : 0.04330563545227051 time for calcul the mask position with numpy : 0.03641462326049805 nb_pixel_total : 28568 time to create 1 rle with old method : 0.03223586082458496 time for calcul the mask position with numpy : 0.03543877601623535 nb_pixel_total : 22915 time to create 1 rle with old method : 0.02545452117919922 time for calcul the mask position with numpy : 0.03734636306762695 nb_pixel_total : 31758 time to create 1 rle with old method : 0.035166025161743164 time for calcul the mask position with numpy : 0.024132966995239258 nb_pixel_total : 12060 time to create 1 rle with old method : 0.013372659683227539 time for calcul the mask position with numpy : 0.02148747444152832 nb_pixel_total : 24598 time to create 1 rle with old method : 0.027781009674072266 time for calcul the mask position with numpy : 0.022257566452026367 nb_pixel_total : 89803 time to create 1 rle with old method : 0.10125732421875 create new chi : 2.098053455352783 time to delete rle : 0.0013341903686523438 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 8922 TO DO : save crop sub photo not yet done ! save time : 0.7518064975738525 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 4.177456378936768 time for calcul the mask position with numpy : 0.4743223190307617 nb_pixel_total : 6750074 time to create 1 rle with new method : 0.3961038589477539 time for calcul the mask position with numpy : 0.023136138916015625 nb_pixel_total : 29153 time to create 1 rle with old method : 0.04735088348388672 time for calcul the mask position with numpy : 0.027097702026367188 nb_pixel_total : 83913 time to create 1 rle with old method : 0.1015615463256836 time for calcul the mask position with numpy : 0.023280858993530273 nb_pixel_total : 37979 time to create 1 rle with old method : 0.042771339416503906 time for calcul the mask position with numpy : 0.023405790328979492 nb_pixel_total : 8160 time to create 1 rle with old method : 0.009224414825439453 time for calcul the mask position with numpy : 0.023770570755004883 nb_pixel_total : 32819 time to create 1 rle with old method : 0.03691887855529785 time for calcul the mask position with numpy : 0.023609638214111328 nb_pixel_total : 27398 time to create 1 rle with old method : 0.031026601791381836 time for calcul the mask position with numpy : 0.024138212203979492 nb_pixel_total : 23910 time to create 1 rle with old method : 0.026813268661499023 time for calcul the mask position with numpy : 0.02279043197631836 nb_pixel_total : 19968 time to create 1 rle with old method : 0.022302627563476562 time for calcul the mask position with numpy : 0.024354934692382812 nb_pixel_total : 36866 time to create 1 rle with old method : 0.04127240180969238 create new chi : 1.4982011318206787 time to delete rle : 0.001153707504272461 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 6826 TO DO : save crop sub photo not yet done ! save time : 0.5058791637420654 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 3.4499058723449707 time for calcul the mask position with numpy : 0.42219972610473633 nb_pixel_total : 5755753 time to create 1 rle with new method : 0.8112564086914062 time for calcul the mask position with numpy : 0.02365708351135254 nb_pixel_total : 74736 time to create 1 rle with old method : 0.08584117889404297 time for calcul the mask position with numpy : 0.022137880325317383 nb_pixel_total : 18782 time to create 1 rle with old method : 0.021751880645751953 time for calcul the mask position with numpy : 0.02477431297302246 nb_pixel_total : 5210 time to create 1 rle with old method : 0.006328582763671875 time for calcul the mask position with numpy : 0.023903846740722656 nb_pixel_total : 24844 time to create 1 rle with old method : 0.028360605239868164 time for calcul the mask position with numpy : 0.026996612548828125 nb_pixel_total : 24365 time to create 1 rle with old method : 0.03033280372619629 time for calcul the mask position with numpy : 0.0218658447265625 nb_pixel_total : 18251 time to create 1 rle with old method : 0.02056598663330078 time for calcul the mask position with numpy : 0.023406982421875 nb_pixel_total : 58139 time to create 1 rle with old method : 0.06693482398986816 time for calcul the mask position with numpy : 0.022603511810302734 nb_pixel_total : 11410 time to create 1 rle with old method : 0.012984991073608398 time for calcul the mask position with numpy : 0.022484302520751953 nb_pixel_total : 14872 time to create 1 rle with old method : 0.016694068908691406 time for calcul the mask position with numpy : 0.021315813064575195 nb_pixel_total : 20959 time to create 1 rle with old method : 0.027090072631835938 time for calcul the mask position with numpy : 0.029792070388793945 nb_pixel_total : 676782 time to create 1 rle with new method : 0.6483259201049805 time for calcul the mask position with numpy : 0.022618532180786133 nb_pixel_total : 35316 time to create 1 rle with old method : 0.040229082107543945 time for calcul the mask position with numpy : 0.024029970169067383 nb_pixel_total : 9961 time to create 1 rle with old method : 0.012867450714111328 time for calcul the mask position with numpy : 0.02378249168395996 nb_pixel_total : 19808 time to create 1 rle with old method : 0.02248835563659668 time for calcul the mask position with numpy : 0.024599313735961914 nb_pixel_total : 9300 time to create 1 rle with old method : 0.01239633560180664 time for calcul the mask position with numpy : 0.026215314865112305 nb_pixel_total : 271752 time to create 1 rle with new method : 0.4466404914855957 create new chi : 3.20479154586792 time to delete rle : 0.0018613338470458984 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10351 TO DO : save crop sub photo not yet done ! save time : 0.9345793724060059 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 6.260049104690552 time for calcul the mask position with numpy : 0.5813438892364502 nb_pixel_total : 5661325 time to create 1 rle with new method : 0.44286203384399414 time for calcul the mask position with numpy : 0.03128242492675781 nb_pixel_total : 38471 time to create 1 rle with old method : 0.043385982513427734 time for calcul the mask position with numpy : 0.02480173110961914 nb_pixel_total : 79083 time to create 1 rle with old method : 0.09932231903076172 time for calcul the mask position with numpy : 0.024372577667236328 nb_pixel_total : 14691 time to create 1 rle with old method : 0.01675248146057129 time for calcul the mask position with numpy : 0.02616095542907715 nb_pixel_total : 12844 time to create 1 rle with old method : 0.019257068634033203 time for calcul the mask position with numpy : 0.025058507919311523 nb_pixel_total : 148603 time to create 1 rle with old method : 0.17474889755249023 time for calcul the mask position with numpy : 0.02211475372314453 nb_pixel_total : 45820 time to create 1 rle with old method : 0.05170869827270508 time for calcul the mask position with numpy : 0.027130603790283203 nb_pixel_total : 79877 time to create 1 rle with old method : 0.09035062789916992 time for calcul the mask position with numpy : 0.023148059844970703 nb_pixel_total : 16701 time to create 1 rle with old method : 0.019160747528076172 time for calcul the mask position with numpy : 0.02307868003845215 nb_pixel_total : 70789 time to create 1 rle with old method : 0.08094263076782227 time for calcul the mask position with numpy : 0.024762392044067383 nb_pixel_total : 144738 time to create 1 rle with old method : 0.17775774002075195 time for calcul the mask position with numpy : 0.02192997932434082 nb_pixel_total : 31437 time to create 1 rle with old method : 0.03487420082092285 time for calcul the mask position with numpy : 0.023168325424194336 nb_pixel_total : 48440 time to create 1 rle with old method : 0.053067684173583984 time for calcul the mask position with numpy : 0.022469282150268555 nb_pixel_total : 186746 time to create 1 rle with new method : 0.38803648948669434 time for calcul the mask position with numpy : 0.022093772888183594 nb_pixel_total : 11120 time to create 1 rle with old method : 0.01797938346862793 time for calcul the mask position with numpy : 0.023998737335205078 nb_pixel_total : 81955 time to create 1 rle with old method : 0.10016345977783203 time for calcul the mask position with numpy : 0.02112436294555664 nb_pixel_total : 19506 time to create 1 rle with old method : 0.02176666259765625 time for calcul the mask position with numpy : 0.023013830184936523 nb_pixel_total : 28389 time to create 1 rle with old method : 0.03168225288391113 time for calcul the mask position with numpy : 0.0222165584564209 nb_pixel_total : 41171 time to create 1 rle with old method : 0.04609179496765137 time for calcul the mask position with numpy : 0.024823665618896484 nb_pixel_total : 196764 time to create 1 rle with new method : 0.4260706901550293 time for calcul the mask position with numpy : 0.021095752716064453 nb_pixel_total : 12364 time to create 1 rle with old method : 0.013797760009765625 time for calcul the mask position with numpy : 0.02136969566345215 nb_pixel_total : 25351 time to create 1 rle with old method : 0.02935338020324707 time for calcul the mask position with numpy : 0.021190881729125977 nb_pixel_total : 54055 time to create 1 rle with old method : 0.06405210494995117 create new chi : 3.6329517364501953 time to delete rle : 0.002369403839111328 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 15538 TO DO : save crop sub photo not yet done ! save time : 1.0054700374603271 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.3924107551574707 time for calcul the mask position with numpy : 0.31394362449645996 nb_pixel_total : 6628470 time to create 1 rle with new method : 0.5554490089416504 time for calcul the mask position with numpy : 0.024682044982910156 nb_pixel_total : 30423 time to create 1 rle with old method : 0.03659772872924805 time for calcul the mask position with numpy : 0.02412700653076172 nb_pixel_total : 273381 time to create 1 rle with new method : 0.464479923248291 time for calcul the mask position with numpy : 0.021775484085083008 nb_pixel_total : 54913 time to create 1 rle with old method : 0.06038618087768555 time for calcul the mask position with numpy : 0.02172064781188965 nb_pixel_total : 63053 time to create 1 rle with old method : 0.07018327713012695 create new chi : 1.6617159843444824 time to delete rle : 0.0006985664367675781 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 4940 TO DO : save crop sub photo not yet done ! save time : 0.4184432029724121 nb_obj : 17 nb_hashtags : 5 time to prepare the origin masks : 7.637448787689209 time for calcul the mask position with numpy : 0.3463594913482666 nb_pixel_total : 6405775 time to create 1 rle with new method : 0.3319864273071289 time for calcul the mask position with numpy : 0.021665334701538086 nb_pixel_total : 26027 time to create 1 rle with old method : 0.028947114944458008 time for calcul the mask position with numpy : 0.021279335021972656 nb_pixel_total : 11771 time to create 1 rle with old method : 0.013117313385009766 time for calcul the mask position with numpy : 0.022663116455078125 nb_pixel_total : 35822 time to create 1 rle with old method : 0.03985261917114258 time for calcul the mask position with numpy : 0.02208733558654785 nb_pixel_total : 16906 time to create 1 rle with old method : 0.01880025863647461 time for calcul the mask position with numpy : 0.022107362747192383 nb_pixel_total : 16077 time to create 1 rle with old method : 0.01902008056640625 time for calcul the mask position with numpy : 0.024152040481567383 nb_pixel_total : 7830 time to create 1 rle with old method : 0.008837223052978516 time for calcul the mask position with numpy : 0.021620750427246094 nb_pixel_total : 47529 time to create 1 rle with old method : 0.05383157730102539 time for calcul the mask position with numpy : 0.02295064926147461 nb_pixel_total : 48472 time to create 1 rle with old method : 0.05398440361022949 time for calcul the mask position with numpy : 0.022439956665039062 nb_pixel_total : 17298 time to create 1 rle with old method : 0.0191650390625 time for calcul the mask position with numpy : 0.023075103759765625 nb_pixel_total : 57128 time to create 1 rle with old method : 0.06316471099853516 time for calcul the mask position with numpy : 0.022803544998168945 nb_pixel_total : 24681 time to create 1 rle with old method : 0.03070235252380371 time for calcul the mask position with numpy : 0.021979570388793945 nb_pixel_total : 53070 time to create 1 rle with old method : 0.05883145332336426 time for calcul the mask position with numpy : 0.02167677879333496 nb_pixel_total : 45519 time to create 1 rle with old method : 0.05039072036743164 time for calcul the mask position with numpy : 0.022761106491088867 nb_pixel_total : 15609 time to create 1 rle with old method : 0.01715826988220215 time for calcul the mask position with numpy : 0.02160954475402832 nb_pixel_total : 8649 time to create 1 rle with old method : 0.009489774703979492 time for calcul the mask position with numpy : 0.02112269401550293 nb_pixel_total : 31135 time to create 1 rle with old method : 0.03789377212524414 time for calcul the mask position with numpy : 0.03168034553527832 nb_pixel_total : 180942 time to create 1 rle with new method : 0.388622522354126 create new chi : 2.041351556777954 time to delete rle : 0.001977682113647461 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 9193 TO DO : save crop sub photo not yet done ! save time : 0.7352621555328369 map_output_result : {1358160700: (0.0, 'Should be the crop_list due to order', 0), 1358160696: (0.0, 'Should be the crop_list due to order', 0), 1358160693: (0.0, 'Should be the crop_list due to order', 0), 1358160629: (0.0, 'Should be the crop_list due to order', 0), 1358160626: (0.0, 'Should be the crop_list due to order', 0), 1358160624: (0.0, 'Should be the crop_list due to order', 0), 1358160500: (0.0, 'Should be the crop_list due to order', 0), 1358160497: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358160700, 1358160696, 1358160693, 1358160629, 1358160626, 1358160624, 1358160500, 1358160497] Looping around the photos to save general results len do output : 8 /1358160700.Didn't retrieve data . /1358160696.Didn't retrieve data . /1358160693.Didn't retrieve data . /1358160629.Didn't retrieve data . /1358160626.Didn't retrieve data . /1358160624.Didn't retrieve data . /1358160500.Didn't retrieve data . /1358160497.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160700', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160696', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160693', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160629', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160626', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160624', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160500', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160497', None, None, None, None, None, '2856024') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.014114141464233398 save_final save missing photos in datou_result : time spend for datou_step_exec : 66.87633490562439 time spend to save output : 0.014628410339355469 total time spend for step 3 : 66.89096331596375 step4:ventilate_hashtags_in_portfolio Thu May 15 03:23:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22988989 get user id for portfolio 22988989 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22988989 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_fonce','mal_croppe','background','pet_clair','pehd','metal','autre','environnement','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22988989 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_fonce','mal_croppe','background','pet_clair','pehd','metal','autre','environnement','flou')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22988989 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_fonce','mal_croppe','background','pet_clair','pehd','metal','autre','environnement','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22991765,22991766,22991767,22991768,22991769,22991770,22991771,22991772,22991773,22991774,22991775?tags=papier,carton,pet_fonce,mal_croppe,background,pet_clair,pehd,metal,autre,environnement,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358160700, 1358160696, 1358160693, 1358160629, 1358160626, 1358160624, 1358160500, 1358160497] Looping around the photos to save general results len do output : 1 /22988989. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160700', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160696', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160693', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160629', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160626', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160624', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160500', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160497', None, None, None, None, None, '2856024') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.017341136932373047 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8460729122161865 time spend to save output : 0.017680644989013672 total time spend for step 4 : 0.8637535572052002 step5:final Thu May 15 03:23:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358160700: ('0.1057589174269245',), 1358160696: ('0.1057589174269245',), 1358160693: ('0.1057589174269245',), 1358160629: ('0.1057589174269245',), 1358160626: ('0.1057589174269245',), 1358160624: ('0.1057589174269245',), 1358160500: ('0.1057589174269245',), 1358160497: ('0.1057589174269245',)} new output for save of step final : {1358160700: ('0.1057589174269245',), 1358160696: ('0.1057589174269245',), 1358160693: ('0.1057589174269245',), 1358160629: ('0.1057589174269245',), 1358160626: ('0.1057589174269245',), 1358160624: ('0.1057589174269245',), 1358160500: ('0.1057589174269245',), 1358160497: ('0.1057589174269245',)} [1358160700, 1358160696, 1358160693, 1358160629, 1358160626, 1358160624, 1358160500, 1358160497] Looping around the photos to save general results len do output : 8 /1358160700.Didn't retrieve data . /1358160696.Didn't retrieve data . /1358160693.Didn't retrieve data . /1358160629.Didn't retrieve data . /1358160626.Didn't retrieve data . /1358160624.Didn't retrieve data . /1358160500.Didn't retrieve data . /1358160497.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160700', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160696', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160693', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160629', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160626', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160624', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160500', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160497', None, None, None, None, None, '2856024') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.016503572463989258 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11844253540039062 time spend to save output : 0.016860246658325195 total time spend for step 5 : 0.13530278205871582 step6:blur_detection Thu May 15 03:23:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040.jpg resize: (2160, 3264) 1358160700 -3.1715401788932156 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51.jpg resize: (2160, 3264) 1358160696 -2.9791826404174344 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a.jpg resize: (2160, 3264) 1358160693 -2.2004305833883526 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9.jpg resize: (2160, 3264) 1358160629 -2.59273408298867 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108.jpg resize: (2160, 3264) 1358160626 -5.930355016140237 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679.jpg resize: (2160, 3264) 1358160624 -1.6431586471558104 treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188.jpg resize: (2160, 3264) 1358160500 -0.7554272380951504 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70.jpg resize: (2160, 3264) 1358160497 -2.223169776993246 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512166_0.png resize: (175, 84) 1358411969 -1.1509856019548288 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512167_0.png resize: (162, 151) 1358411970 0.630036021824226 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512168_0.png resize: (78, 151) 1358411971 -2.4375619812841074 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512170_0.png resize: (70, 54) 1358411972 4.410220551547192 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512172_0.png resize: (217, 289) 1358411973 -2.0911302841201445 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512173_0.png resize: (195, 166) 1358411974 -1.7628817760459672 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512174_0.png resize: (519, 579) 1358411975 -3.200198722356826 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512175_0.png resize: (326, 186) 1358411976 -1.1266386299926756 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512176_0.png resize: (155, 66) 1358411977 -1.0780099446721156 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512177_0.png resize: (494, 271) 1358411978 -2.3110226784390133 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512178_0.png resize: (225, 260) 1358411979 -1.9280801480328822 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512180_0.png resize: (321, 215) 1358411980 -1.3170666954088717 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512181_0.png resize: (226, 193) 1358411981 -1.7548131586915228 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512183_0.png resize: (222, 591) 1358411982 -2.18148458243658 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512184_0.png resize: (533, 665) 1358411983 -2.5929389934867872 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512185_0.png resize: (343, 251) 1358411984 -1.7528947262877383 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512186_0.png resize: (227, 374) 1358411985 -2.367603381658636 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512187_0.png resize: (181, 274) 1358411986 -1.7702508782495798 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512191_0.png resize: (414, 376) 1358411987 -1.3411671106131573 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512192_0.png resize: (202, 300) 1358411988 -0.49283079672012226 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512194_0.png resize: (269, 239) 1358411989 -0.8420791287629715 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512195_0.png resize: (160, 240) 1358411990 -1.2784284899353442 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512196_0.png resize: (229, 180) 1358411991 -0.9957640405004071 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512198_0.png resize: (281, 132) 1358411992 -1.5643635766917146 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512200_0.png resize: (143, 317) 1358411993 -1.7112274227618096 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512201_0.png resize: (316, 199) 1358411994 -2.25638348670363 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512202_0.png resize: (95, 230) 1358411995 -2.278828244189966 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512203_0.png resize: (333, 220) 1358411996 -1.3686530193529267 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512204_0.png resize: (250, 290) 1358411997 -1.678912147586657 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512205_0.png resize: (262, 238) 1358411998 -2.4086848645722627 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512206_0.png resize: (186, 163) 1358411999 -2.1873685739793043 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512207_0.png resize: (340, 125) 1358412000 -0.5026447544725345 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512209_0.png resize: (295, 175) 1358412001 -0.7946395828964913 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512211_0.png resize: (480, 130) 1358412002 -1.4130312537775216 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512215_0.png resize: (73, 181) 1358412003 -2.5715452692988094 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512216_0.png resize: (117, 216) 1358412004 -2.2759395037581736 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512220_0.png resize: (138, 214) 1358412005 -3.021788950106173 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512221_0.png resize: (142, 139) 1358412006 -3.9349560193345177 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512222_0.png resize: (152, 129) 1358412007 -2.3255407552337686 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512223_0.png resize: (281, 354) 1358412008 -3.6294340756385277 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512224_0.png resize: (177, 219) 1358412009 -1.6706887426663801 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512225_0.png resize: (160, 233) 1358412010 -4.615482100034202 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512226_0.png resize: (216, 199) 1358412011 -2.8371214677860044 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512227_0.png resize: (94, 78) 1358412012 -2.5098680966975095 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512228_0.png resize: (142, 196) 1358412013 -4.638408238066458 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512229_0.png resize: (312, 379) 1358412014 -1.1620821530063312 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512230_0.png resize: (395, 204) 1358412015 -1.4141232247446722 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512231_0.png resize: (210, 220) 1358412016 -1.7213698040137364 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512232_0.png resize: (134, 136) 1358412017 -0.421028706498049 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512233_0.png resize: (428, 574) 1358412018 -0.9254513808351734 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512234_0.png resize: (263, 259) 1358412019 -0.6236573631049411 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512237_0.png resize: (263, 415) 1358412020 -0.7152565445788615 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512238_0.png resize: (132, 110) 1358412021 0.14350315494424842 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512239_0.png resize: (527, 509) 1358412022 -0.9380160932525368 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512244_0.png resize: (143, 171) 1358412023 -1.0225209434590432 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512247_0.png resize: (401, 575) 1358412024 -0.17493814150713555 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512248_0.png resize: (120, 150) 1358412025 -1.3276655425935862 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512249_0.png resize: (133, 144) 1358412026 -0.9990449928956343 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512250_0.png resize: (689, 171) 1358412027 -2.1659947048552906 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512251_0.png resize: (405, 437) 1358412028 -0.8936087057682265 treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188_rle_crop_3798512252_0.png resize: (271, 333) 1358412029 -0.7868587567098614 treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188_rle_crop_3798512255_0.png resize: (153, 267) 1358412030 -2.4106731201659377 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512258_0.png resize: (145, 124) 1358412031 -1.9477865774973888 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512260_0.png resize: (251, 328) 1358412032 -1.3683891960916585 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512267_0.png resize: (138, 130) 1358412033 -1.7756822571186601 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512163_0.png resize: (142, 158) 1358412038 0.3393299367007571 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512169_0.png resize: (162, 106) 1358412039 -1.5123772497911205 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512193_0.png resize: (202, 75) 1358412040 0.6120067467946977 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512208_0.png resize: (175, 250) 1358412041 -1.494050722854813 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512210_0.png resize: (93, 116) 1358412042 -0.42048579445679973 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512213_0.png resize: (219, 269) 1358412044 -1.6689276787414304 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512214_0.png resize: (598, 515) 1358412045 -1.790103845696211 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512217_0.png resize: (148, 119) 1358412046 -2.0176824816338486 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512219_0.png resize: (865, 878) 1358412047 0.0004623380131185432 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512235_0.png resize: (231, 185) 1358412048 -1.481565270761507 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512236_0.png resize: (129, 219) 1358412049 -0.5814369450501469 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512240_0.png resize: (228, 345) 1358412050 -0.7229502589174214 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512241_0.png resize: (196, 265) 1358412051 -1.7752011058589072 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512243_0.png resize: (577, 294) 1358412052 -1.195168870749798 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512246_0.png resize: (247, 260) 1358412053 -0.6835939606399714 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512257_0.png resize: (213, 180) 1358412054 -0.781822224013933 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512259_0.png resize: (126, 159) 1358412055 -0.671532100548763 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512261_0.png resize: (248, 420) 1358412056 -2.33654338506575 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512268_0.png resize: (167, 213) 1358412057 -0.9014882922546169 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512164_0.png resize: (285, 495) 1358412062 -3.0655844879924956 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512165_0.png resize: (285, 731) 1358412063 -1.0410298352543166 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512179_0.png resize: (433, 480) 1358412064 -1.0428775219487372 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512182_0.png resize: (474, 236) 1358412065 -2.7098852634622483 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512188_0.png resize: (197, 274) 1358412066 -1.6668523444883188 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512189_0.png resize: (256, 445) 1358412067 -1.9850222118365786 treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512190_0.png resize: (318, 277) 1358412068 -2.1755398779737196 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512197_0.png resize: (159, 345) 1358412069 -2.13607146245022 treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512199_0.png resize: (119, 161) 1358412070 -4.260990328576257 treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512212_0.png resize: (256, 404) 1358412071 -3.6423451680728 treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512218_0.png resize: (258, 268) 1358412072 -3.7714564296256547 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512242_0.png resize: (264, 964) 1358412073 -0.7036030991664959 treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512245_0.png resize: (309, 398) 1358412074 -2.872208864276657 treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188_rle_crop_3798512253_0.png resize: (227, 444) 1358412075 -0.6580293916432601 treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188_rle_crop_3798512254_0.png resize: (513, 850) 1358412076 -0.21447710753151447 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512256_0.png resize: (299, 764) 1358412077 -0.9975129714388793 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512262_0.png resize: (140, 220) 1358412078 -0.6906424061185527 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512263_0.png resize: (171, 409) 1358412079 -2.0690571178912087 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512264_0.png resize: (139, 158) 1358412080 0.02655078756750117 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512265_0.png resize: (354, 246) 1358412081 -1.469261094837778 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512269_0.png resize: (269, 170) 1358412082 -1.7398270943366478 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512270_0.png resize: (204, 316) 1358412083 -0.605047373093109 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512272_0.png resize: (239, 200) 1358412084 -1.4456850948438325 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512271_0.png resize: (84, 175) 1358412087 -1.2577711601600292 treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512171_0.png resize: (106, 90) 1358412089 0.12582418693165745 treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512266_0.png resize: (153, 400) 1358412092 0.2715938281312881 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 118 time used for this insertion : 0.0184175968170166 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 118 time used for this insertion : 0.03219413757324219 save missing photos in datou_result : time spend for datou_step_exec : 32.002517223358154 time spend to save output : 0.05648994445800781 total time spend for step 6 : 32.05900716781616 step7:brightness Thu May 15 03:24:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040.jpg treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51.jpg treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a.jpg treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9.jpg treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108.jpg treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679.jpg treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188.jpg treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70.jpg treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512166_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512167_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512168_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512170_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512172_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512173_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512174_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512175_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512176_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512177_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512178_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512180_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512181_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512183_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512184_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512185_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512186_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512187_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512191_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512192_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512194_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512195_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512196_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512198_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512200_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512201_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512202_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512203_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512204_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512205_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512206_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512207_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512209_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512211_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512215_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512216_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512220_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512221_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512222_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512223_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512224_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512225_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512226_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512227_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512228_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512229_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512230_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512231_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512232_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512233_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512234_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512237_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512238_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512239_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512244_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512247_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512248_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512249_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512250_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512251_0.png treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188_rle_crop_3798512252_0.png treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188_rle_crop_3798512255_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512258_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512260_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512267_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512163_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512169_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512193_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512208_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512210_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512213_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512214_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512217_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512219_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512235_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512236_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512240_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512241_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512243_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512246_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512257_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512259_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512261_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512268_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512164_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512165_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512179_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512182_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512188_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512189_0.png treat image : temp/1747272030_1385354_1358160696_3d891edf582861707538b3c6b0745d51_rle_crop_3798512190_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512197_0.png treat image : temp/1747272030_1385354_1358160693_74877816543b8d84bdf28ffa8dbdd27a_rle_crop_3798512199_0.png treat image : temp/1747272030_1385354_1358160629_4a6c9a191edf9f65089dbafc48b3d1e9_rle_crop_3798512212_0.png treat image : temp/1747272030_1385354_1358160626_20e86f25fd8ab971ce3efa4a01ab3108_rle_crop_3798512218_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512242_0.png treat image : temp/1747272030_1385354_1358160624_767a3726c1eb93625504478cff62d679_rle_crop_3798512245_0.png treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188_rle_crop_3798512253_0.png treat image : temp/1747272030_1385354_1358160500_4a30cd9ab1381b550cabdc4d6bcda188_rle_crop_3798512254_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512256_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512262_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512263_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512264_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512265_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512269_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512270_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512272_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512271_0.png treat image : temp/1747272030_1385354_1358160700_84d734ceca8793eacdb0a022a0bac040_rle_crop_3798512171_0.png treat image : temp/1747272030_1385354_1358160497_90de3fc8b85f81e261a05bd46d059f70_rle_crop_3798512266_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 118 time used for this insertion : 0.0167236328125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 118 time used for this insertion : 0.03199648857116699 save missing photos in datou_result : time spend for datou_step_exec : 9.29283857345581 time spend to save output : 0.0547182559967041 total time spend for step 7 : 9.347556829452515 step8:velours_tree Thu May 15 03:24:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.23114633560180664 time spend to save output : 5.14984130859375e-05 total time spend for step 8 : 0.23119783401489258 step9:send_mail_cod Thu May 15 03:24:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22988989_15-05-2025_03_24_34.pdf 22991765 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229917651747272274 22991766 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229917661747272276 22991767 change filename to text .imagette229917671747272277 22991768 imagette229917681747272277 22991769 imagette229917691747272277 22991770 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229917701747272277 22991771 change filename to text .imagette229917711747272278 22991772 imagette229917721747272278 22991773 change filename to text .imagette229917731747272278 22991775 imagette229917751747272278 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22988989 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22991765,22991766,22991767,22991768,22991769,22991770,22991771,22991772,22991773,22991774,22991775?tags=papier,carton,pet_fonce,mal_croppe,background,pet_clair,pehd,metal,autre,environnement,flou args[1358160700] : ((1358160700, -3.1715401788932156, 492609224), (1358160700, -0.03569617962701928, 2107752395), '0.1057589174269245') We are sending mail with results at report@fotonower.com args[1358160696] : ((1358160696, -2.9791826404174344, 492609224), (1358160696, 0.1300109079201692, 2107752395), '0.1057589174269245') We are sending mail with results at report@fotonower.com args[1358160693] : ((1358160693, -2.2004305833883526, 492609224), (1358160693, 0.05402096676730088, 2107752395), '0.1057589174269245') We are sending mail with results at report@fotonower.com args[1358160629] : ((1358160629, -2.59273408298867, 492609224), (1358160629, 0.07706493497166468, 2107752395), '0.1057589174269245') We are sending mail with results at report@fotonower.com args[1358160626] : ((1358160626, -5.930355016140237, 492609224), (1358160626, 0.22627080678291525, 2107752395), '0.1057589174269245') We are sending mail with results at report@fotonower.com args[1358160624] : ((1358160624, -1.6431586471558104, 492688767), (1358160624, 0.26533885203556645, 2107752395), '0.1057589174269245') We are sending mail with results at report@fotonower.com args[1358160500] : ((1358160500, -0.7554272380951504, 492688767), (1358160500, 0.5048236820464812, 2107752395), '0.1057589174269245') We are sending mail with results at report@fotonower.com args[1358160497] : ((1358160497, -2.223169776993246, 492609224), (1358160497, 0.17995012741752608, 2107752395), '0.1057589174269245') We are sending mail with results at report@fotonower.com refus_total : 0.1057589174269245 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22988989 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22988989_15-05-2025_03_24_34.pdf results_Auto_P22988989_15-05-2025_03_24_34.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22988989_15-05-2025_03_24_34.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22988989','results_Auto_P22988989_15-05-2025_03_24_34.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22988989_15-05-2025_03_24_34.pdf','pdf','','0.64','0.1057589174269245') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22988989

https://www.fotonower.com/image?json=false&list_photos_id=1358160700
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358160696
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358160693
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358160629
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358160626
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358160624
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358160500
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358160497
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.58%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/22991765?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22991766?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22991767?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22991770?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22991771?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22991773?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22988989_15-05-2025_03_24_34.pdf.

Lien vers velours :https://www.fotonower.com/velours/22991765,22991766,22991767,22991768,22991769,22991770,22991771,22991772,22991773,22991774,22991775?tags=papier,carton,pet_fonce,mal_croppe,background,pet_clair,pehd,metal,autre,environnement,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 15 May 2025 01:24:41 GMT Content-Length: 0 Connection: close X-Message-Id: f-ovyvRxQIma6JlzU876xw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358160700, 1358160696, 1358160693, 1358160629, 1358160626, 1358160624, 1358160500, 1358160497] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160700', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160696', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160693', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160629', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160626', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160624', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160500', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160497', None, None, None, None, None, '2856024') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014131546020507812 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.741088628768921 time spend to save output : 0.014459371566772461 total time spend for step 9 : 6.755548000335693 step10:split_time_score Thu May 15 03:24:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14052025 22988989 Nombre de photos uploadées : 8 / 23040 (0%) 14052025 22988989 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 14052025 22988989 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 4.76837158203125e-06 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0005004405975341797 elapsed_time : insert_dashboard_record_day_entry 0.02564072608947754 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988944 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988945 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988947 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988950 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988966 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988983 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988984 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988986 order by id desc limit 1 Qualite : 0.1057589174269245 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22988989_15-05-2025_03_24_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988989 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22988989 AND mptpi.`type`=3594 To do Qualite : 0.09757787914548534 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22988991_15-05-2025_03_18_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22988991 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22988991 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989000 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989002 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989004 order by id desc limit 1 Qualite : 0.08968606742465507 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989010_15-05-2025_03_16_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989010 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989010 AND mptpi.`type`=3594 To do Qualite : 0.14220519443309731 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989012_15-05-2025_02_56_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989012 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989012 AND mptpi.`type`=3594 To do Qualite : 0.10356962788973614 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989015_15-05-2025_02_48_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989015 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989015 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989016 order by id desc limit 1 Qualite : 0.13511119243221992 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989027_15-05-2025_02_44_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989027 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989027 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989033 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989035 order by id desc limit 1 Qualite : 0.10039380001466397 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22989039_15-05-2025_02_27_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22989039 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22989039 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358160700, 1358160696, 1358160693, 1358160629, 1358160626, 1358160624, 1358160500, 1358160497] Looping around the photos to save general results len do output : 1 /22988989Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160700', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160696', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160693', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160629', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160626', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160624', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160500', None, None, None, None, None, '2856024') ('3318', None, None, None, None, None, None, None, '2856024') ('3318', '22988989', '1358160497', None, None, None, None, None, '2856024') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016498565673828125 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.389134407043457 time spend to save output : 0.01672816276550293 total time spend for step 10 : 13.40586256980896 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 110.10user 100.91system 4:28.64elapsed 78%CPU (0avgtext+0avgdata 4819376maxresident)k 569864inputs+72648outputs (1814major+10234340minor)pagefaults 0swaps