python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4174146 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2914167'] with mtr_portfolio_ids : ['23181869'] and first list_photo_ids : [] new path : /proc/4174146/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 2.0049397945404053 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 20 22:10:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-20 22:10:35.019534: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-20 22:10:35.047120: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-20 22:10:35.048733: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4e10000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-20 22:10:35.048798: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-20 22:10:35.052095: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-20 22:10:35.340809: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x33a4fe80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-20 22:10:35.340867: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-20 22:10:35.342161: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 22:10:35.342619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 22:10:35.345919: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 22:10:35.349055: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 22:10:35.349492: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 22:10:35.352472: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 22:10:35.353948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 22:10:35.359284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 22:10:35.360832: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 22:10:35.360913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 22:10:35.361856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 22:10:35.361872: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 22:10:35.361882: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 22:10:35.363633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-20 22:10:35.710361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 22:10:35.710483: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 22:10:35.710503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 22:10:35.710520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 22:10:35.710536: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 22:10:35.710552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 22:10:35.710567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 22:10:35.710584: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 22:10:35.711803: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 22:10:35.712908: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 22:10:35.712938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 22:10:35.712955: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 22:10:35.712969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 22:10:35.712984: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 22:10:35.712998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 22:10:35.713013: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 22:10:35.713027: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 22:10:35.714211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 22:10:35.714243: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 22:10:35.714251: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 22:10:35.714258: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 22:10:35.715494: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-20 22:10:46.659187: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 22:10:46.892969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 Detection mask done ! Trying to reset tf kernel 4174601 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 236 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0021195411682128906 nb_pixel_total : 56968 time to create 1 rle with old method : 0.06291699409484863 length of segment : 362 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 22638 time to create 1 rle with old method : 0.02567601203918457 length of segment : 165 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 10650 time to create 1 rle with old method : 0.012344837188720703 length of segment : 139 time for calcul the mask position with numpy : 0.0007534027099609375 nb_pixel_total : 39407 time to create 1 rle with old method : 0.04517340660095215 length of segment : 199 time for calcul the mask position with numpy : 0.0059375762939453125 nb_pixel_total : 227111 time to create 1 rle with new method : 0.0163877010345459 length of segment : 577 time for calcul the mask position with numpy : 0.0017418861389160156 nb_pixel_total : 76947 time to create 1 rle with old method : 0.1009969711303711 length of segment : 268 time for calcul the mask position with numpy : 0.003414630889892578 nb_pixel_total : 176367 time to create 1 rle with new method : 0.011237621307373047 length of segment : 567 time for calcul the mask position with numpy : 0.0013575553894042969 nb_pixel_total : 54139 time to create 1 rle with old method : 0.07017755508422852 length of segment : 291 time for calcul the mask position with numpy : 0.0009403228759765625 nb_pixel_total : 22535 time to create 1 rle with old method : 0.030026674270629883 length of segment : 334 time for calcul the mask position with numpy : 0.0003726482391357422 nb_pixel_total : 16633 time to create 1 rle with old method : 0.02791452407836914 length of segment : 130 time for calcul the mask position with numpy : 0.001188039779663086 nb_pixel_total : 47456 time to create 1 rle with old method : 0.061280250549316406 length of segment : 291 time for calcul the mask position with numpy : 0.001522064208984375 nb_pixel_total : 58763 time to create 1 rle with old method : 0.07603740692138672 length of segment : 245 time for calcul the mask position with numpy : 0.000385284423828125 nb_pixel_total : 10036 time to create 1 rle with old method : 0.013385295867919922 length of segment : 169 time for calcul the mask position with numpy : 0.0002772808074951172 nb_pixel_total : 10261 time to create 1 rle with old method : 0.013242959976196289 length of segment : 149 time for calcul the mask position with numpy : 0.006037712097167969 nb_pixel_total : 232417 time to create 1 rle with new method : 0.01484227180480957 length of segment : 464 time for calcul the mask position with numpy : 0.0035965442657470703 nb_pixel_total : 139439 time to create 1 rle with old method : 0.1710658073425293 length of segment : 545 time for calcul the mask position with numpy : 0.012624025344848633 nb_pixel_total : 289164 time to create 1 rle with new method : 0.029932022094726562 length of segment : 723 time for calcul the mask position with numpy : 0.0004506111145019531 nb_pixel_total : 13309 time to create 1 rle with old method : 0.015671730041503906 length of segment : 226 time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 18580 time to create 1 rle with old method : 0.02240443229675293 length of segment : 144 time for calcul the mask position with numpy : 0.004603385925292969 nb_pixel_total : 231660 time to create 1 rle with new method : 0.017183542251586914 length of segment : 562 time for calcul the mask position with numpy : 0.00035452842712402344 nb_pixel_total : 13673 time to create 1 rle with old method : 0.016673564910888672 length of segment : 257 time for calcul the mask position with numpy : 0.0006976127624511719 nb_pixel_total : 33810 time to create 1 rle with old method : 0.041440486907958984 length of segment : 199 time for calcul the mask position with numpy : 0.0008497238159179688 nb_pixel_total : 44106 time to create 1 rle with old method : 0.06470656394958496 length of segment : 209 time for calcul the mask position with numpy : 0.0010781288146972656 nb_pixel_total : 43833 time to create 1 rle with old method : 0.06083202362060547 length of segment : 339 time for calcul the mask position with numpy : 0.0007772445678710938 nb_pixel_total : 30345 time to create 1 rle with old method : 0.035269975662231445 length of segment : 253 time for calcul the mask position with numpy : 0.0015821456909179688 nb_pixel_total : 34302 time to create 1 rle with old method : 0.04010462760925293 length of segment : 200 time for calcul the mask position with numpy : 0.00045680999755859375 nb_pixel_total : 24353 time to create 1 rle with old method : 0.029048442840576172 length of segment : 184 time for calcul the mask position with numpy : 0.0004620552062988281 nb_pixel_total : 23623 time to create 1 rle with old method : 0.03156590461730957 length of segment : 182 time for calcul the mask position with numpy : 0.0006058216094970703 nb_pixel_total : 13906 time to create 1 rle with old method : 0.016335725784301758 length of segment : 158 time for calcul the mask position with numpy : 0.000568389892578125 nb_pixel_total : 13644 time to create 1 rle with old method : 0.015984535217285156 length of segment : 146 time for calcul the mask position with numpy : 0.0006937980651855469 nb_pixel_total : 10113 time to create 1 rle with old method : 0.01223897933959961 length of segment : 104 time for calcul the mask position with numpy : 0.0018486976623535156 nb_pixel_total : 35656 time to create 1 rle with old method : 0.04599356651306152 length of segment : 303 time for calcul the mask position with numpy : 0.0009663105010986328 nb_pixel_total : 26594 time to create 1 rle with old method : 0.034970998764038086 length of segment : 216 time for calcul the mask position with numpy : 0.00176239013671875 nb_pixel_total : 31844 time to create 1 rle with old method : 0.03731346130371094 length of segment : 333 time for calcul the mask position with numpy : 0.003792285919189453 nb_pixel_total : 95876 time to create 1 rle with old method : 0.10741376876831055 length of segment : 366 time for calcul the mask position with numpy : 0.0005652904510498047 nb_pixel_total : 9406 time to create 1 rle with old method : 0.011327743530273438 length of segment : 106 time for calcul the mask position with numpy : 0.00033473968505859375 nb_pixel_total : 6044 time to create 1 rle with old method : 0.007065773010253906 length of segment : 100 time for calcul the mask position with numpy : 0.0008027553558349609 nb_pixel_total : 18445 time to create 1 rle with old method : 0.022954225540161133 length of segment : 148 time for calcul the mask position with numpy : 0.003651857376098633 nb_pixel_total : 96162 time to create 1 rle with old method : 0.10954880714416504 length of segment : 353 time for calcul the mask position with numpy : 0.0015146732330322266 nb_pixel_total : 34839 time to create 1 rle with old method : 0.03976011276245117 length of segment : 270 time for calcul the mask position with numpy : 0.00041556358337402344 nb_pixel_total : 13290 time to create 1 rle with old method : 0.01604008674621582 length of segment : 119 time for calcul the mask position with numpy : 0.0010306835174560547 nb_pixel_total : 28068 time to create 1 rle with old method : 0.03266549110412598 length of segment : 185 time for calcul the mask position with numpy : 0.0020339488983154297 nb_pixel_total : 45450 time to create 1 rle with old method : 0.05256080627441406 length of segment : 442 time for calcul the mask position with numpy : 0.00015807151794433594 nb_pixel_total : 7360 time to create 1 rle with old method : 0.008508682250976562 length of segment : 97 time for calcul the mask position with numpy : 0.0010204315185546875 nb_pixel_total : 26949 time to create 1 rle with old method : 0.03189992904663086 length of segment : 206 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 6269 time to create 1 rle with old method : 0.00750279426574707 length of segment : 94 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 15307 time to create 1 rle with old method : 0.018112659454345703 length of segment : 122 time for calcul the mask position with numpy : 0.0009856224060058594 nb_pixel_total : 26081 time to create 1 rle with old method : 0.03090214729309082 length of segment : 182 time for calcul the mask position with numpy : 0.00090789794921875 nb_pixel_total : 15086 time to create 1 rle with old method : 0.01753067970275879 length of segment : 243 time for calcul the mask position with numpy : 0.004419803619384766 nb_pixel_total : 65768 time to create 1 rle with old method : 0.07664203643798828 length of segment : 239 time for calcul the mask position with numpy : 0.0011818408966064453 nb_pixel_total : 15803 time to create 1 rle with old method : 0.0216825008392334 length of segment : 163 time for calcul the mask position with numpy : 0.0029082298278808594 nb_pixel_total : 80484 time to create 1 rle with old method : 0.09313797950744629 length of segment : 284 time for calcul the mask position with numpy : 0.0028769969940185547 nb_pixel_total : 51721 time to create 1 rle with old method : 0.05906105041503906 length of segment : 379 time for calcul the mask position with numpy : 0.0007371902465820312 nb_pixel_total : 11449 time to create 1 rle with old method : 0.01377725601196289 length of segment : 172 time for calcul the mask position with numpy : 0.0031604766845703125 nb_pixel_total : 97822 time to create 1 rle with old method : 0.11217808723449707 length of segment : 372 time for calcul the mask position with numpy : 0.0010120868682861328 nb_pixel_total : 22247 time to create 1 rle with old method : 0.026000022888183594 length of segment : 188 time for calcul the mask position with numpy : 0.0015561580657958984 nb_pixel_total : 51107 time to create 1 rle with old method : 0.05981278419494629 length of segment : 202 time for calcul the mask position with numpy : 0.0004899501800537109 nb_pixel_total : 9693 time to create 1 rle with old method : 0.011498451232910156 length of segment : 151 time for calcul the mask position with numpy : 0.0005855560302734375 nb_pixel_total : 7119 time to create 1 rle with old method : 0.008668899536132812 length of segment : 145 time for calcul the mask position with numpy : 0.0013332366943359375 nb_pixel_total : 33655 time to create 1 rle with old method : 0.03884243965148926 length of segment : 238 time for calcul the mask position with numpy : 0.0013773441314697266 nb_pixel_total : 15560 time to create 1 rle with old method : 0.019758224487304688 length of segment : 84 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 6562 time to create 1 rle with old method : 0.007960796356201172 length of segment : 72 time for calcul the mask position with numpy : 0.0023088455200195312 nb_pixel_total : 71527 time to create 1 rle with old method : 0.08190798759460449 length of segment : 431 time for calcul the mask position with numpy : 0.0006320476531982422 nb_pixel_total : 20288 time to create 1 rle with old method : 0.023728609085083008 length of segment : 187 time for calcul the mask position with numpy : 0.002787351608276367 nb_pixel_total : 123508 time to create 1 rle with old method : 0.14117884635925293 length of segment : 650 time for calcul the mask position with numpy : 0.0010311603546142578 nb_pixel_total : 32038 time to create 1 rle with old method : 0.04409170150756836 length of segment : 403 time for calcul the mask position with numpy : 0.002630472183227539 nb_pixel_total : 76210 time to create 1 rle with old method : 0.08771276473999023 length of segment : 308 time for calcul the mask position with numpy : 0.0021810531616210938 nb_pixel_total : 68572 time to create 1 rle with old method : 0.07888054847717285 length of segment : 351 time for calcul the mask position with numpy : 0.004317045211791992 nb_pixel_total : 175128 time to create 1 rle with new method : 0.01022958755493164 length of segment : 816 time for calcul the mask position with numpy : 0.0007472038269042969 nb_pixel_total : 20973 time to create 1 rle with old method : 0.024604320526123047 length of segment : 173 time for calcul the mask position with numpy : 0.0010342597961425781 nb_pixel_total : 34577 time to create 1 rle with old method : 0.040036678314208984 length of segment : 330 time for calcul the mask position with numpy : 0.002168416976928711 nb_pixel_total : 79382 time to create 1 rle with old method : 0.09224081039428711 length of segment : 431 time for calcul the mask position with numpy : 0.0048084259033203125 nb_pixel_total : 112053 time to create 1 rle with old method : 0.12827038764953613 length of segment : 587 time for calcul the mask position with numpy : 0.0028493404388427734 nb_pixel_total : 75696 time to create 1 rle with old method : 0.08644890785217285 length of segment : 411 time for calcul the mask position with numpy : 0.0021390914916992188 nb_pixel_total : 42004 time to create 1 rle with old method : 0.0511016845703125 length of segment : 227 time for calcul the mask position with numpy : 0.0011057853698730469 nb_pixel_total : 18928 time to create 1 rle with old method : 0.021945953369140625 length of segment : 210 time for calcul the mask position with numpy : 0.0019040107727050781 nb_pixel_total : 23144 time to create 1 rle with old method : 0.02685546875 length of segment : 386 time for calcul the mask position with numpy : 0.0017075538635253906 nb_pixel_total : 35503 time to create 1 rle with old method : 0.04117560386657715 length of segment : 216 time for calcul the mask position with numpy : 0.0018582344055175781 nb_pixel_total : 35727 time to create 1 rle with old method : 0.04114413261413574 length of segment : 339 time for calcul the mask position with numpy : 0.0060536861419677734 nb_pixel_total : 126692 time to create 1 rle with old method : 0.16868901252746582 length of segment : 502 time for calcul the mask position with numpy : 0.0009274482727050781 nb_pixel_total : 18981 time to create 1 rle with old method : 0.022008419036865234 length of segment : 221 time for calcul the mask position with numpy : 0.0005507469177246094 nb_pixel_total : 16231 time to create 1 rle with old method : 0.019005537033081055 length of segment : 211 time for calcul the mask position with numpy : 0.0014815330505371094 nb_pixel_total : 38154 time to create 1 rle with old method : 0.043836355209350586 length of segment : 297 time for calcul the mask position with numpy : 0.00037932395935058594 nb_pixel_total : 3704 time to create 1 rle with old method : 0.004772663116455078 length of segment : 97 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 6981 time to create 1 rle with old method : 0.008259057998657227 length of segment : 96 time for calcul the mask position with numpy : 0.1662156581878662 nb_pixel_total : 422797 time to create 1 rle with new method : 0.036362648010253906 length of segment : 1311 time for calcul the mask position with numpy : 0.0008747577667236328 nb_pixel_total : 13274 time to create 1 rle with old method : 0.015653610229492188 length of segment : 146 time for calcul the mask position with numpy : 0.003744363784790039 nb_pixel_total : 100039 time to create 1 rle with old method : 0.11502218246459961 length of segment : 329 time for calcul the mask position with numpy : 0.019661664962768555 nb_pixel_total : 320571 time to create 1 rle with new method : 0.12222576141357422 length of segment : 1005 time for calcul the mask position with numpy : 0.0004734992980957031 nb_pixel_total : 6359 time to create 1 rle with old method : 0.007668972015380859 length of segment : 137 time for calcul the mask position with numpy : 0.009467124938964844 nb_pixel_total : 159258 time to create 1 rle with new method : 0.01910543441772461 length of segment : 889 time for calcul the mask position with numpy : 0.0006468296051025391 nb_pixel_total : 10088 time to create 1 rle with old method : 0.01238250732421875 length of segment : 133 time for calcul the mask position with numpy : 0.0009572505950927734 nb_pixel_total : 17312 time to create 1 rle with old method : 0.02049732208251953 length of segment : 182 time for calcul the mask position with numpy : 0.0010540485382080078 nb_pixel_total : 14967 time to create 1 rle with old method : 0.018278121948242188 length of segment : 261 time for calcul the mask position with numpy : 0.000812530517578125 nb_pixel_total : 14802 time to create 1 rle with old method : 0.017668962478637695 length of segment : 125 time for calcul the mask position with numpy : 0.0031523704528808594 nb_pixel_total : 58604 time to create 1 rle with old method : 0.0675959587097168 length of segment : 285 time for calcul the mask position with numpy : 0.0009241104125976562 nb_pixel_total : 13635 time to create 1 rle with old method : 0.01598381996154785 length of segment : 143 time for calcul the mask position with numpy : 0.0009438991546630859 nb_pixel_total : 22932 time to create 1 rle with old method : 0.028332948684692383 length of segment : 194 time for calcul the mask position with numpy : 0.002189159393310547 nb_pixel_total : 77700 time to create 1 rle with old method : 0.08832740783691406 length of segment : 335 time for calcul the mask position with numpy : 0.002144336700439453 nb_pixel_total : 41086 time to create 1 rle with old method : 0.04765462875366211 length of segment : 338 time for calcul the mask position with numpy : 0.001737833023071289 nb_pixel_total : 28511 time to create 1 rle with old method : 0.03296160697937012 length of segment : 236 time for calcul the mask position with numpy : 0.0018253326416015625 nb_pixel_total : 37031 time to create 1 rle with old method : 0.04297447204589844 length of segment : 381 time for calcul the mask position with numpy : 0.0015857219696044922 nb_pixel_total : 28058 time to create 1 rle with old method : 0.035863399505615234 length of segment : 211 time for calcul the mask position with numpy : 0.0003120899200439453 nb_pixel_total : 5799 time to create 1 rle with old method : 0.006814718246459961 length of segment : 111 time for calcul the mask position with numpy : 0.0004432201385498047 nb_pixel_total : 9312 time to create 1 rle with old method : 0.01101231575012207 length of segment : 114 time for calcul the mask position with numpy : 0.0019528865814208984 nb_pixel_total : 39481 time to create 1 rle with old method : 0.04519176483154297 length of segment : 261 time for calcul the mask position with numpy : 0.0003185272216796875 nb_pixel_total : 4815 time to create 1 rle with old method : 0.005826234817504883 length of segment : 78 time for calcul the mask position with numpy : 0.0015208721160888672 nb_pixel_total : 25896 time to create 1 rle with old method : 0.02984786033630371 length of segment : 187 time for calcul the mask position with numpy : 0.00028705596923828125 nb_pixel_total : 4317 time to create 1 rle with old method : 0.005197286605834961 length of segment : 79 time for calcul the mask position with numpy : 0.0008223056793212891 nb_pixel_total : 10380 time to create 1 rle with old method : 0.012321710586547852 length of segment : 145 time for calcul the mask position with numpy : 0.0020072460174560547 nb_pixel_total : 43598 time to create 1 rle with old method : 0.050909996032714844 length of segment : 330 time for calcul the mask position with numpy : 0.0018208026885986328 nb_pixel_total : 47865 time to create 1 rle with old method : 0.06428885459899902 length of segment : 353 time for calcul the mask position with numpy : 0.00014257431030273438 nb_pixel_total : 2945 time to create 1 rle with old method : 0.003548860549926758 length of segment : 66 time for calcul the mask position with numpy : 0.005757570266723633 nb_pixel_total : 58500 time to create 1 rle with old method : 0.06705760955810547 length of segment : 457 time for calcul the mask position with numpy : 0.002338409423828125 nb_pixel_total : 51182 time to create 1 rle with old method : 0.06136965751647949 length of segment : 245 time for calcul the mask position with numpy : 0.00037980079650878906 nb_pixel_total : 5794 time to create 1 rle with old method : 0.006882667541503906 length of segment : 99 time for calcul the mask position with numpy : 0.0011916160583496094 nb_pixel_total : 18596 time to create 1 rle with old method : 0.022068023681640625 length of segment : 220 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 12583 time to create 1 rle with old method : 0.014774799346923828 length of segment : 150 time for calcul the mask position with numpy : 0.0018603801727294922 nb_pixel_total : 36005 time to create 1 rle with old method : 0.04125857353210449 length of segment : 268 time for calcul the mask position with numpy : 0.0014238357543945312 nb_pixel_total : 22332 time to create 1 rle with old method : 0.026246070861816406 length of segment : 186 time for calcul the mask position with numpy : 0.0005245208740234375 nb_pixel_total : 12241 time to create 1 rle with old method : 0.014386892318725586 length of segment : 107 time for calcul the mask position with numpy : 0.0018987655639648438 nb_pixel_total : 46536 time to create 1 rle with old method : 0.05309653282165527 length of segment : 350 time for calcul the mask position with numpy : 0.004228830337524414 nb_pixel_total : 96677 time to create 1 rle with old method : 0.1101694107055664 length of segment : 367 time for calcul the mask position with numpy : 0.0007722377777099609 nb_pixel_total : 12735 time to create 1 rle with old method : 0.014821052551269531 length of segment : 153 time for calcul the mask position with numpy : 0.0008902549743652344 nb_pixel_total : 25406 time to create 1 rle with old method : 0.029346227645874023 length of segment : 165 time for calcul the mask position with numpy : 0.0004961490631103516 nb_pixel_total : 13548 time to create 1 rle with old method : 0.016047000885009766 length of segment : 154 time for calcul the mask position with numpy : 0.0007929801940917969 nb_pixel_total : 23110 time to create 1 rle with old method : 0.02704453468322754 length of segment : 168 time for calcul the mask position with numpy : 0.0029408931732177734 nb_pixel_total : 55718 time to create 1 rle with old method : 0.06305646896362305 length of segment : 266 time for calcul the mask position with numpy : 0.0007236003875732422 nb_pixel_total : 19615 time to create 1 rle with old method : 0.023150205612182617 length of segment : 113 time for calcul the mask position with numpy : 0.0007410049438476562 nb_pixel_total : 15016 time to create 1 rle with old method : 0.017311573028564453 length of segment : 149 time for calcul the mask position with numpy : 0.0015032291412353516 nb_pixel_total : 40555 time to create 1 rle with old method : 0.04672384262084961 length of segment : 252 time for calcul the mask position with numpy : 0.0033485889434814453 nb_pixel_total : 80163 time to create 1 rle with old method : 0.09072041511535645 length of segment : 358 time for calcul the mask position with numpy : 0.0009033679962158203 nb_pixel_total : 19349 time to create 1 rle with old method : 0.0226438045501709 length of segment : 137 time for calcul the mask position with numpy : 0.0014843940734863281 nb_pixel_total : 16426 time to create 1 rle with old method : 0.019260406494140625 length of segment : 294 time for calcul the mask position with numpy : 0.0023419857025146484 nb_pixel_total : 81733 time to create 1 rle with old method : 0.09398388862609863 length of segment : 387 time for calcul the mask position with numpy : 0.00016379356384277344 nb_pixel_total : 5033 time to create 1 rle with old method : 0.005903720855712891 length of segment : 93 time for calcul the mask position with numpy : 0.006926298141479492 nb_pixel_total : 106303 time to create 1 rle with old method : 0.12119650840759277 length of segment : 1035 time for calcul the mask position with numpy : 0.0033812522888183594 nb_pixel_total : 88042 time to create 1 rle with old method : 0.10006403923034668 length of segment : 396 time for calcul the mask position with numpy : 0.0006411075592041016 nb_pixel_total : 16138 time to create 1 rle with old method : 0.0189359188079834 length of segment : 126 time for calcul the mask position with numpy : 0.0019588470458984375 nb_pixel_total : 23359 time to create 1 rle with old method : 0.027591943740844727 length of segment : 289 time for calcul the mask position with numpy : 0.0005478858947753906 nb_pixel_total : 8085 time to create 1 rle with old method : 0.009578704833984375 length of segment : 131 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 7424 time to create 1 rle with old method : 0.009440898895263672 length of segment : 70 time for calcul the mask position with numpy : 0.0016427040100097656 nb_pixel_total : 26404 time to create 1 rle with old method : 0.03082871437072754 length of segment : 295 time for calcul the mask position with numpy : 0.0007810592651367188 nb_pixel_total : 18903 time to create 1 rle with old method : 0.022310733795166016 length of segment : 184 time for calcul the mask position with numpy : 0.0017156600952148438 nb_pixel_total : 43928 time to create 1 rle with old method : 0.050839900970458984 length of segment : 193 time for calcul the mask position with numpy : 0.002287149429321289 nb_pixel_total : 55422 time to create 1 rle with old method : 0.06474041938781738 length of segment : 321 time for calcul the mask position with numpy : 0.0008509159088134766 nb_pixel_total : 16913 time to create 1 rle with old method : 0.02006840705871582 length of segment : 144 time for calcul the mask position with numpy : 0.0015475749969482422 nb_pixel_total : 18633 time to create 1 rle with old method : 0.021593332290649414 length of segment : 337 time for calcul the mask position with numpy : 0.00603032112121582 nb_pixel_total : 92983 time to create 1 rle with old method : 0.10679936408996582 length of segment : 674 time for calcul the mask position with numpy : 0.009407758712768555 nb_pixel_total : 228652 time to create 1 rle with new method : 0.016991615295410156 length of segment : 578 time for calcul the mask position with numpy : 0.004290103912353516 nb_pixel_total : 152535 time to create 1 rle with new method : 0.008476495742797852 length of segment : 584 time for calcul the mask position with numpy : 0.0022640228271484375 nb_pixel_total : 71530 time to create 1 rle with old method : 0.0822300910949707 length of segment : 303 time for calcul the mask position with numpy : 0.0004076957702636719 nb_pixel_total : 11603 time to create 1 rle with old method : 0.013764142990112305 length of segment : 133 time for calcul the mask position with numpy : 0.0064544677734375 nb_pixel_total : 213039 time to create 1 rle with new method : 0.012280464172363281 length of segment : 653 time for calcul the mask position with numpy : 0.0012466907501220703 nb_pixel_total : 32313 time to create 1 rle with old method : 0.0390172004699707 length of segment : 206 time for calcul the mask position with numpy : 0.006562471389770508 nb_pixel_total : 234509 time to create 1 rle with new method : 0.012135505676269531 length of segment : 469 time for calcul the mask position with numpy : 0.0005536079406738281 nb_pixel_total : 10220 time to create 1 rle with old method : 0.011909008026123047 length of segment : 145 time for calcul the mask position with numpy : 0.0014557838439941406 nb_pixel_total : 38417 time to create 1 rle with old method : 0.04509735107421875 length of segment : 208 time for calcul the mask position with numpy : 0.0004737377166748047 nb_pixel_total : 8421 time to create 1 rle with old method : 0.010080814361572266 length of segment : 171 time for calcul the mask position with numpy : 0.0012180805206298828 nb_pixel_total : 40842 time to create 1 rle with old method : 0.04691815376281738 length of segment : 385 time for calcul the mask position with numpy : 0.0031270980834960938 nb_pixel_total : 63861 time to create 1 rle with old method : 0.07236218452453613 length of segment : 519 time for calcul the mask position with numpy : 0.0011897087097167969 nb_pixel_total : 22942 time to create 1 rle with old method : 0.0264284610748291 length of segment : 191 time for calcul the mask position with numpy : 0.00101470947265625 nb_pixel_total : 16454 time to create 1 rle with old method : 0.019368648529052734 length of segment : 348 time for calcul the mask position with numpy : 0.0006701946258544922 nb_pixel_total : 17511 time to create 1 rle with old method : 0.020822763442993164 length of segment : 138 time spent for convertir_results : 14.334147214889526 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 338 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 2028 save missing photos in datou_result : time spend for datou_step_exec : 83.73145341873169 time spend to save output : 0.6969118118286133 total time spend for step 1 : 84.4283652305603 step2:crop_condition Tue May 20 22:11:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 338 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 250 About to insert : list_path_to_insert length 250 new photo from crops ! About to upload 250 photos upload in portfolio : 3736932 init cache_photo without model_param we have 250 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747771975_4174146 we have uploaded 250 photos in the portfolio 3736932 time of upload the photos Elapsed time : 72.32856750488281 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3736932 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747772057_4174146 we have uploaded 42 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.806874990463257 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747772070_4174146 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1716663837432861 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747772082_4174146 we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.003421783447266 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747772093_4174146 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7624661922454834 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747772097_4174146 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9281258583068848 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359821359, 1359820574, 1359820532, 1359820529, 1359820524, 1359820514, 1359820481, 1359820477] Looping around the photos to save general results len do output : 330 /1359865928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359865999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359866292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359821359', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820574', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820532', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820529', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820524', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820514', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820481', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820477', None, None, None, None, None, '2914167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 998 time used for this insertion : 0.04774355888366699 save_final save missing photos in datou_result : time spend for datou_step_exec : 181.21068596839905 time spend to save output : 0.1667039394378662 total time spend for step 2 : 181.3773899078369 step3:rle_unique_nms_with_priority Tue May 20 22:14:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 338 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 25 nb_hashtags : 5 time to prepare the origin masks : 7.776369333267212 time for calcul the mask position with numpy : 0.26651763916015625 nb_pixel_total : 5204782 time to create 1 rle with new method : 0.8340644836425781 time for calcul the mask position with numpy : 0.032445430755615234 nb_pixel_total : 288975 time to create 1 rle with new method : 0.639479398727417 time for calcul the mask position with numpy : 0.029283523559570312 nb_pixel_total : 18578 time to create 1 rle with old method : 0.020796537399291992 time for calcul the mask position with numpy : 0.03105306625366211 nb_pixel_total : 232451 time to create 1 rle with new method : 0.5480246543884277 time for calcul the mask position with numpy : 0.028975248336791992 nb_pixel_total : 10651 time to create 1 rle with old method : 0.011571407318115234 time for calcul the mask position with numpy : 0.029420137405395508 nb_pixel_total : 54131 time to create 1 rle with old method : 0.06076335906982422 time for calcul the mask position with numpy : 0.029523611068725586 nb_pixel_total : 13667 time to create 1 rle with old method : 0.015390634536743164 time for calcul the mask position with numpy : 0.029006481170654297 nb_pixel_total : 10260 time to create 1 rle with old method : 0.011260032653808594 time for calcul the mask position with numpy : 0.029101848602294922 nb_pixel_total : 22631 time to create 1 rle with old method : 0.025271177291870117 time for calcul the mask position with numpy : 0.02955937385559082 nb_pixel_total : 44091 time to create 1 rle with old method : 0.05016613006591797 time for calcul the mask position with numpy : 0.02892899513244629 nb_pixel_total : 16626 time to create 1 rle with old method : 0.018537044525146484 time for calcul the mask position with numpy : 0.031017780303955078 nb_pixel_total : 76787 time to create 1 rle with old method : 0.0863189697265625 time for calcul the mask position with numpy : 0.028708696365356445 nb_pixel_total : 249 time to create 1 rle with old method : 0.0006604194641113281 time for calcul the mask position with numpy : 0.03024888038635254 nb_pixel_total : 176388 time to create 1 rle with new method : 0.7685854434967041 time for calcul the mask position with numpy : 0.029076814651489258 nb_pixel_total : 58729 time to create 1 rle with old method : 0.06880331039428711 time for calcul the mask position with numpy : 0.028976917266845703 nb_pixel_total : 22535 time to create 1 rle with old method : 0.025906801223754883 time for calcul the mask position with numpy : 0.029743671417236328 nb_pixel_total : 231670 time to create 1 rle with new method : 0.5746071338653564 time for calcul the mask position with numpy : 0.029985666275024414 nb_pixel_total : 227112 time to create 1 rle with new method : 0.4509544372558594 time for calcul the mask position with numpy : 0.02931380271911621 nb_pixel_total : 12806 time to create 1 rle with old method : 0.015547752380371094 time for calcul the mask position with numpy : 0.03294706344604492 nb_pixel_total : 139439 time to create 1 rle with old method : 0.15484905242919922 time for calcul the mask position with numpy : 0.029017210006713867 nb_pixel_total : 39410 time to create 1 rle with old method : 0.04426002502441406 time for calcul the mask position with numpy : 0.0290529727935791 nb_pixel_total : 47460 time to create 1 rle with old method : 0.055082082748413086 time for calcul the mask position with numpy : 0.0291900634765625 nb_pixel_total : 56972 time to create 1 rle with old method : 0.06392335891723633 time for calcul the mask position with numpy : 0.029089927673339844 nb_pixel_total : 33807 time to create 1 rle with old method : 0.038162946701049805 time for calcul the mask position with numpy : 0.0289461612701416 nb_pixel_total : 10033 time to create 1 rle with old method : 0.011349201202392578 create new chi : 5.757461309432983 time to delete rle : 0.022709369659423828 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 191 TO DO : save crop sub photo not yet done ! save time : 0.1628131866455078 nb_obj : 24 nb_hashtags : 5 time to prepare the origin masks : 7.765002012252808 time for calcul the mask position with numpy : 0.6248648166656494 nb_pixel_total : 6470255 time to create 1 rle with new method : 0.661186695098877 time for calcul the mask position with numpy : 0.029111623764038086 nb_pixel_total : 6044 time to create 1 rle with old method : 0.006822824478149414 time for calcul the mask position with numpy : 0.02927684783935547 nb_pixel_total : 34310 time to create 1 rle with old method : 0.039057254791259766 time for calcul the mask position with numpy : 0.029305219650268555 nb_pixel_total : 43833 time to create 1 rle with old method : 0.049134016036987305 time for calcul the mask position with numpy : 0.029064178466796875 nb_pixel_total : 35657 time to create 1 rle with old method : 0.04040050506591797 time for calcul the mask position with numpy : 0.029353857040405273 nb_pixel_total : 18441 time to create 1 rle with old method : 0.021228313446044922 time for calcul the mask position with numpy : 0.030762672424316406 nb_pixel_total : 95905 time to create 1 rle with old method : 0.10737895965576172 time for calcul the mask position with numpy : 0.02888941764831543 nb_pixel_total : 26594 time to create 1 rle with old method : 0.029897689819335938 time for calcul the mask position with numpy : 0.03109431266784668 nb_pixel_total : 13905 time to create 1 rle with old method : 0.015671253204345703 time for calcul the mask position with numpy : 0.02881026268005371 nb_pixel_total : 8245 time to create 1 rle with old method : 0.009329080581665039 time for calcul the mask position with numpy : 0.028754234313964844 nb_pixel_total : 11990 time to create 1 rle with old method : 0.013744115829467773 time for calcul the mask position with numpy : 0.029254674911499023 nb_pixel_total : 419 time to create 1 rle with old method : 0.0005028247833251953 time for calcul the mask position with numpy : 0.0290374755859375 nb_pixel_total : 28068 time to create 1 rle with old method : 0.03128457069396973 time for calcul the mask position with numpy : 0.031146764755249023 nb_pixel_total : 45450 time to create 1 rle with old method : 0.05249214172363281 time for calcul the mask position with numpy : 0.029022216796875 nb_pixel_total : 13644 time to create 1 rle with old method : 0.015267610549926758 time for calcul the mask position with numpy : 0.028748273849487305 nb_pixel_total : 23631 time to create 1 rle with old method : 0.026582717895507812 time for calcul the mask position with numpy : 0.029341697692871094 nb_pixel_total : 24353 time to create 1 rle with old method : 0.03922724723815918 time for calcul the mask position with numpy : 0.03289961814880371 nb_pixel_total : 31831 time to create 1 rle with old method : 0.03716707229614258 time for calcul the mask position with numpy : 0.02916240692138672 nb_pixel_total : 30320 time to create 1 rle with old method : 0.03406214714050293 time for calcul the mask position with numpy : 0.028848886489868164 nb_pixel_total : 6269 time to create 1 rle with old method : 0.007115602493286133 time for calcul the mask position with numpy : 0.028985261917114258 nb_pixel_total : 34841 time to create 1 rle with old method : 0.04097342491149902 time for calcul the mask position with numpy : 0.029115676879882812 nb_pixel_total : 10113 time to create 1 rle with old method : 0.011442184448242188 time for calcul the mask position with numpy : 0.02891707420349121 nb_pixel_total : 26717 time to create 1 rle with old method : 0.03027200698852539 time for calcul the mask position with numpy : 0.029071807861328125 nb_pixel_total : 9405 time to create 1 rle with old method : 0.010731220245361328 create new chi : 2.6983485221862793 time to delete rle : 0.0016179084777832031 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 298 TO DO : save crop sub photo not yet done ! save time : 0.13343095779418945 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 7.929637908935547 time for calcul the mask position with numpy : 0.690744161605835 nb_pixel_total : 6460721 time to create 1 rle with new method : 0.608180046081543 time for calcul the mask position with numpy : 0.028352975845336914 nb_pixel_total : 22246 time to create 1 rle with old method : 0.02464437484741211 time for calcul the mask position with numpy : 0.02805948257446289 nb_pixel_total : 15799 time to create 1 rle with old method : 0.0171964168548584 time for calcul the mask position with numpy : 0.02733445167541504 nb_pixel_total : 2282 time to create 1 rle with old method : 0.0024712085723876953 time for calcul the mask position with numpy : 0.02850651741027832 nb_pixel_total : 97814 time to create 1 rle with old method : 0.11326909065246582 time for calcul the mask position with numpy : 0.027779340744018555 nb_pixel_total : 15086 time to create 1 rle with old method : 0.017055034637451172 time for calcul the mask position with numpy : 0.028530120849609375 nb_pixel_total : 26080 time to create 1 rle with old method : 0.029436826705932617 time for calcul the mask position with numpy : 0.02872443199157715 nb_pixel_total : 7117 time to create 1 rle with old method : 0.008108854293823242 time for calcul the mask position with numpy : 0.03143739700317383 nb_pixel_total : 15548 time to create 1 rle with old method : 0.02030348777770996 time for calcul the mask position with numpy : 0.0299072265625 nb_pixel_total : 15308 time to create 1 rle with old method : 0.01724696159362793 time for calcul the mask position with numpy : 0.02831578254699707 nb_pixel_total : 80470 time to create 1 rle with old method : 0.08899068832397461 time for calcul the mask position with numpy : 0.028937339782714844 nb_pixel_total : 11450 time to create 1 rle with old method : 0.013162612915039062 time for calcul the mask position with numpy : 0.0283663272857666 nb_pixel_total : 71537 time to create 1 rle with old method : 0.07752871513366699 time for calcul the mask position with numpy : 0.027637958526611328 nb_pixel_total : 65745 time to create 1 rle with old method : 0.07189798355102539 time for calcul the mask position with numpy : 0.028343677520751953 nb_pixel_total : 33655 time to create 1 rle with old method : 0.037853240966796875 time for calcul the mask position with numpy : 0.027982234954833984 nb_pixel_total : 51108 time to create 1 rle with old method : 0.05571293830871582 time for calcul the mask position with numpy : 0.028055191040039062 nb_pixel_total : 51713 time to create 1 rle with old method : 0.05564689636230469 time for calcul the mask position with numpy : 0.02747178077697754 nb_pixel_total : 6561 time to create 1 rle with old method : 0.007279872894287109 create new chi : 2.5024611949920654 time to delete rle : 0.0013823509216308594 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.0984032154083252 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 6.746291399002075 time for calcul the mask position with numpy : 0.022534847259521484 nb_pixel_total : 79371 time to create 1 rle with old method : 0.08949565887451172 time for calcul the mask position with numpy : 0.02220940589904785 nb_pixel_total : 34578 time to create 1 rle with old method : 0.03818821907043457 time for calcul the mask position with numpy : 0.021944046020507812 nb_pixel_total : 20977 time to create 1 rle with old method : 0.02370309829711914 time for calcul the mask position with numpy : 0.02234649658203125 nb_pixel_total : 175152 time to create 1 rle with new method : 0.41076231002807617 time for calcul the mask position with numpy : 0.022015810012817383 nb_pixel_total : 68580 time to create 1 rle with old method : 0.0763547420501709 time for calcul the mask position with numpy : 0.021873950958251953 nb_pixel_total : 76210 time to create 1 rle with old method : 0.08490872383117676 time for calcul the mask position with numpy : 0.023449182510375977 nb_pixel_total : 32038 time to create 1 rle with old method : 0.05185246467590332 time for calcul the mask position with numpy : 0.024383544921875 nb_pixel_total : 123496 time to create 1 rle with old method : 0.13742303848266602 time for calcul the mask position with numpy : 0.021971464157104492 nb_pixel_total : 20288 time to create 1 rle with old method : 0.02261972427368164 time for calcul the mask position with numpy : 0.6317474842071533 nb_pixel_total : 6419550 time to create 1 rle with new method : 0.7597522735595703 create new chi : 2.6232874393463135 time to delete rle : 0.0010569095611572266 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.09746456146240234 nb_obj : 29 nb_hashtags : 4 time to prepare the origin masks : 7.805463790893555 time for calcul the mask position with numpy : 1.5043580532073975 nb_pixel_total : 5258555 time to create 1 rle with new method : 1.3483848571777344 time for calcul the mask position with numpy : 0.028075456619262695 nb_pixel_total : 6360 time to create 1 rle with old method : 0.006888866424560547 time for calcul the mask position with numpy : 0.028563737869262695 nb_pixel_total : 3705 time to create 1 rle with old method : 0.0042383670806884766 time for calcul the mask position with numpy : 0.0274503231048584 nb_pixel_total : 14909 time to create 1 rle with old method : 0.016015291213989258 time for calcul the mask position with numpy : 0.027487993240356445 nb_pixel_total : 22934 time to create 1 rle with old method : 0.024381399154663086 time for calcul the mask position with numpy : 0.027876615524291992 nb_pixel_total : 35502 time to create 1 rle with old method : 0.037734270095825195 time for calcul the mask position with numpy : 0.027079105377197266 nb_pixel_total : 13635 time to create 1 rle with old method : 0.014943599700927734 time for calcul the mask position with numpy : 0.02852177619934082 nb_pixel_total : 75697 time to create 1 rle with old method : 0.08021807670593262 time for calcul the mask position with numpy : 0.02883148193359375 nb_pixel_total : 320272 time to create 1 rle with new method : 0.8229718208312988 time for calcul the mask position with numpy : 0.029536724090576172 nb_pixel_total : 18978 time to create 1 rle with old method : 0.02168130874633789 time for calcul the mask position with numpy : 0.030550718307495117 nb_pixel_total : 159330 time to create 1 rle with new method : 0.8342585563659668 time for calcul the mask position with numpy : 0.029375314712524414 nb_pixel_total : 42008 time to create 1 rle with old method : 0.04729747772216797 time for calcul the mask position with numpy : 0.029039382934570312 nb_pixel_total : 17313 time to create 1 rle with old method : 0.01969766616821289 time for calcul the mask position with numpy : 0.0289461612701416 nb_pixel_total : 23144 time to create 1 rle with old method : 0.026105880737304688 time for calcul the mask position with numpy : 0.029021501541137695 nb_pixel_total : 18935 time to create 1 rle with old method : 0.02143239974975586 time for calcul the mask position with numpy : 0.032997846603393555 nb_pixel_total : 417543 time to create 1 rle with new method : 1.010608434677124 time for calcul the mask position with numpy : 0.027802705764770508 nb_pixel_total : 38155 time to create 1 rle with old method : 0.04152274131774902 time for calcul the mask position with numpy : 0.02846527099609375 nb_pixel_total : 77693 time to create 1 rle with old method : 0.08483171463012695 time for calcul the mask position with numpy : 0.028673648834228516 nb_pixel_total : 112065 time to create 1 rle with old method : 0.12805700302124023 time for calcul the mask position with numpy : 0.02916264533996582 nb_pixel_total : 16197 time to create 1 rle with old method : 0.018878936767578125 time for calcul the mask position with numpy : 0.029447555541992188 nb_pixel_total : 14804 time to create 1 rle with old method : 0.016943931579589844 time for calcul the mask position with numpy : 0.030157804489135742 nb_pixel_total : 126689 time to create 1 rle with old method : 0.1470024585723877 time for calcul the mask position with numpy : 0.03057122230529785 nb_pixel_total : 58599 time to create 1 rle with old method : 0.08905816078186035 time for calcul the mask position with numpy : 0.0297696590423584 nb_pixel_total : 10088 time to create 1 rle with old method : 0.011485815048217773 time for calcul the mask position with numpy : 0.02926492691040039 nb_pixel_total : 35706 time to create 1 rle with old method : 0.03975057601928711 time for calcul the mask position with numpy : 0.029511690139770508 nb_pixel_total : 100043 time to create 1 rle with old method : 0.11153817176818848 time for calcul the mask position with numpy : 0.02878713607788086 nb_pixel_total : 4141 time to create 1 rle with old method : 0.004666328430175781 time for calcul the mask position with numpy : 0.028649330139160156 nb_pixel_total : 6917 time to create 1 rle with old method : 0.00788426399230957 time for calcul the mask position with numpy : 0.028215408325195312 nb_pixel_total : 323 time to create 1 rle with old method : 0.00042247772216796875 create new chi : 7.48750376701355 time to delete rle : 0.004565000534057617 batch 1 Loaded 59 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 140 TO DO : save crop sub photo not yet done ! save time : 0.17181015014648438 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 7.788548707962036 time for calcul the mask position with numpy : 0.48131346702575684 nb_pixel_total : 6517605 time to create 1 rle with new method : 1.2417595386505127 time for calcul the mask position with numpy : 0.028772592544555664 nb_pixel_total : 5794 time to create 1 rle with old method : 0.006563663482666016 time for calcul the mask position with numpy : 0.029120445251464844 nb_pixel_total : 41084 time to create 1 rle with old method : 0.04579949378967285 time for calcul the mask position with numpy : 0.029103994369506836 nb_pixel_total : 22332 time to create 1 rle with old method : 0.0250704288482666 time for calcul the mask position with numpy : 0.029221296310424805 nb_pixel_total : 36007 time to create 1 rle with old method : 0.039963483810424805 time for calcul the mask position with numpy : 0.02931523323059082 nb_pixel_total : 58391 time to create 1 rle with old method : 0.06741666793823242 time for calcul the mask position with numpy : 0.030197620391845703 nb_pixel_total : 37027 time to create 1 rle with old method : 0.04139900207519531 time for calcul the mask position with numpy : 0.028271913528442383 nb_pixel_total : 25895 time to create 1 rle with old method : 0.02881622314453125 time for calcul the mask position with numpy : 0.027898788452148438 nb_pixel_total : 18597 time to create 1 rle with old method : 0.020571470260620117 time for calcul the mask position with numpy : 0.028458833694458008 nb_pixel_total : 2945 time to create 1 rle with old method : 0.0033311843872070312 time for calcul the mask position with numpy : 0.028095722198486328 nb_pixel_total : 4815 time to create 1 rle with old method : 0.00526881217956543 time for calcul the mask position with numpy : 0.027788639068603516 nb_pixel_total : 43596 time to create 1 rle with old method : 0.048804521560668945 time for calcul the mask position with numpy : 0.028106689453125 nb_pixel_total : 11225 time to create 1 rle with old method : 0.012400388717651367 time for calcul the mask position with numpy : 0.027550935745239258 nb_pixel_total : 5799 time to create 1 rle with old method : 0.006258249282836914 time for calcul the mask position with numpy : 0.027733325958251953 nb_pixel_total : 9312 time to create 1 rle with old method : 0.01008462905883789 time for calcul the mask position with numpy : 0.027965545654296875 nb_pixel_total : 51190 time to create 1 rle with old method : 0.05595135688781738 time for calcul the mask position with numpy : 0.028083324432373047 nb_pixel_total : 28062 time to create 1 rle with old method : 0.0335233211517334 time for calcul the mask position with numpy : 0.033014774322509766 nb_pixel_total : 47869 time to create 1 rle with old method : 0.06454896926879883 time for calcul the mask position with numpy : 0.028993606567382812 nb_pixel_total : 28509 time to create 1 rle with old method : 0.031882286071777344 time for calcul the mask position with numpy : 0.028773784637451172 nb_pixel_total : 4317 time to create 1 rle with old method : 0.004881381988525391 time for calcul the mask position with numpy : 0.028934717178344727 nb_pixel_total : 39488 time to create 1 rle with old method : 0.04425859451293945 time for calcul the mask position with numpy : 0.0279693603515625 nb_pixel_total : 10381 time to create 1 rle with old method : 0.011471986770629883 create new chi : 3.019974946975708 time to delete rle : 0.0017921924591064453 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.10089111328125 nb_obj : 24 nb_hashtags : 6 time to prepare the origin masks : 7.943987846374512 time for calcul the mask position with numpy : 0.8018200397491455 nb_pixel_total : 6222602 time to create 1 rle with new method : 0.9082820415496826 time for calcul the mask position with numpy : 0.02976822853088379 nb_pixel_total : 19615 time to create 1 rle with old method : 0.02206897735595703 time for calcul the mask position with numpy : 0.030916452407836914 nb_pixel_total : 19346 time to create 1 rle with old method : 0.021860599517822266 time for calcul the mask position with numpy : 0.0376286506652832 nb_pixel_total : 77308 time to create 1 rle with old method : 0.09217119216918945 time for calcul the mask position with numpy : 0.028823137283325195 nb_pixel_total : 106333 time to create 1 rle with old method : 0.14331626892089844 time for calcul the mask position with numpy : 0.029708385467529297 nb_pixel_total : 7424 time to create 1 rle with old method : 0.008524894714355469 time for calcul the mask position with numpy : 0.029605388641357422 nb_pixel_total : 12737 time to create 1 rle with old method : 0.01436305046081543 time for calcul the mask position with numpy : 0.030548572540283203 nb_pixel_total : 13550 time to create 1 rle with old method : 0.015330076217651367 time for calcul the mask position with numpy : 0.029174327850341797 nb_pixel_total : 12239 time to create 1 rle with old method : 0.014308452606201172 time for calcul the mask position with numpy : 0.03417372703552246 nb_pixel_total : 16427 time to create 1 rle with old method : 0.018515348434448242 time for calcul the mask position with numpy : 0.029517650604248047 nb_pixel_total : 46536 time to create 1 rle with old method : 0.05271315574645996 time for calcul the mask position with numpy : 0.029170513153076172 nb_pixel_total : 23351 time to create 1 rle with old method : 0.026637792587280273 time for calcul the mask position with numpy : 0.02919602394104004 nb_pixel_total : 25406 time to create 1 rle with old method : 0.028954267501831055 time for calcul the mask position with numpy : 0.029409408569335938 nb_pixel_total : 55701 time to create 1 rle with old method : 0.06283164024353027 time for calcul the mask position with numpy : 0.029618263244628906 nb_pixel_total : 81734 time to create 1 rle with old method : 0.09464883804321289 time for calcul the mask position with numpy : 0.0386502742767334 nb_pixel_total : 16133 time to create 1 rle with old method : 0.018158912658691406 time for calcul the mask position with numpy : 0.029396772384643555 nb_pixel_total : 26397 time to create 1 rle with old method : 0.02979755401611328 time for calcul the mask position with numpy : 0.02956700325012207 nb_pixel_total : 40548 time to create 1 rle with old method : 0.04516482353210449 time for calcul the mask position with numpy : 0.029310226440429688 nb_pixel_total : 80158 time to create 1 rle with old method : 0.09428262710571289 time for calcul the mask position with numpy : 0.029491662979125977 nb_pixel_total : 23109 time to create 1 rle with old method : 0.02604985237121582 time for calcul the mask position with numpy : 0.02933049201965332 nb_pixel_total : 3810 time to create 1 rle with old method : 0.0043375492095947266 time for calcul the mask position with numpy : 0.029883146286010742 nb_pixel_total : 96674 time to create 1 rle with old method : 0.10835051536560059 time for calcul the mask position with numpy : 0.02976846694946289 nb_pixel_total : 15016 time to create 1 rle with old method : 0.01792144775390625 time for calcul the mask position with numpy : 0.029494762420654297 nb_pixel_total : 8086 time to create 1 rle with old method : 0.009169578552246094 create new chi : 3.4494760036468506 time to delete rle : 0.0022840499877929688 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.1556549072265625 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 8.426137447357178 time for calcul the mask position with numpy : 0.6813080310821533 nb_pixel_total : 5645978 time to create 1 rle with new method : 0.8238155841827393 time for calcul the mask position with numpy : 0.027543067932128906 nb_pixel_total : 17509 time to create 1 rle with old method : 0.01959061622619629 time for calcul the mask position with numpy : 0.02954268455505371 nb_pixel_total : 234538 time to create 1 rle with new method : 0.5384800434112549 time for calcul the mask position with numpy : 0.028023958206176758 nb_pixel_total : 22942 time to create 1 rle with old method : 0.02488255500793457 time for calcul the mask position with numpy : 0.027737855911254883 nb_pixel_total : 10219 time to create 1 rle with old method : 0.011327266693115234 time for calcul the mask position with numpy : 0.02867412567138672 nb_pixel_total : 55419 time to create 1 rle with old method : 0.06352519989013672 time for calcul the mask position with numpy : 0.028110742568969727 nb_pixel_total : 32309 time to create 1 rle with old method : 0.03620433807373047 time for calcul the mask position with numpy : 0.02912449836730957 nb_pixel_total : 18904 time to create 1 rle with old method : 0.02078413963317871 time for calcul the mask position with numpy : 0.028726816177368164 nb_pixel_total : 16467 time to create 1 rle with old method : 0.018533706665039062 time for calcul the mask position with numpy : 0.028505325317382812 nb_pixel_total : 6389 time to create 1 rle with old method : 0.007088184356689453 time for calcul the mask position with numpy : 0.028836488723754883 nb_pixel_total : 16911 time to create 1 rle with old method : 0.01889944076538086 time for calcul the mask position with numpy : 0.02878403663635254 nb_pixel_total : 93000 time to create 1 rle with old method : 0.10286211967468262 time for calcul the mask position with numpy : 0.028735876083374023 nb_pixel_total : 152534 time to create 1 rle with new method : 0.5173299312591553 time for calcul the mask position with numpy : 0.02920985221862793 nb_pixel_total : 71500 time to create 1 rle with old method : 0.0783529281616211 time for calcul the mask position with numpy : 0.02990579605102539 nb_pixel_total : 228652 time to create 1 rle with new method : 0.568340539932251 time for calcul the mask position with numpy : 0.030440568923950195 nb_pixel_total : 18633 time to create 1 rle with old method : 0.0223844051361084 time for calcul the mask position with numpy : 0.031752824783325195 nb_pixel_total : 212850 time to create 1 rle with new method : 0.572195291519165 time for calcul the mask position with numpy : 0.02827000617980957 nb_pixel_total : 63866 time to create 1 rle with old method : 0.07219314575195312 time for calcul the mask position with numpy : 0.02834177017211914 nb_pixel_total : 43928 time to create 1 rle with old method : 0.04759502410888672 time for calcul the mask position with numpy : 0.028461456298828125 nb_pixel_total : 40859 time to create 1 rle with old method : 0.045584917068481445 time for calcul the mask position with numpy : 0.028470277786254883 nb_pixel_total : 38414 time to create 1 rle with old method : 0.042600393295288086 time for calcul the mask position with numpy : 0.028389930725097656 nb_pixel_total : 8419 time to create 1 rle with old method : 0.009730339050292969 create new chi : 5.120147943496704 time to delete rle : 0.0025000572204589844 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.12077569961547852 map_output_result : {1359821359: (0.0, 'Should be the crop_list due to order', 0), 1359820574: (0.0, 'Should be the crop_list due to order', 0), 1359820532: (0.0, 'Should be the crop_list due to order', 0), 1359820529: (0.0, 'Should be the crop_list due to order', 0), 1359820524: (0.0, 'Should be the crop_list due to order', 0), 1359820514: (0.0, 'Should be the crop_list due to order', 0), 1359820481: (0.0, 'Should be the crop_list due to order', 0), 1359820477: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359821359, 1359820574, 1359820532, 1359820529, 1359820524, 1359820514, 1359820481, 1359820477] Looping around the photos to save general results len do output : 8 /1359821359.Didn't retrieve data . /1359820574.Didn't retrieve data . /1359820532.Didn't retrieve data . /1359820529.Didn't retrieve data . /1359820524.Didn't retrieve data . /1359820514.Didn't retrieve data . /1359820481.Didn't retrieve data . /1359820477.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359821359', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820574', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820532', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820529', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820524', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820514', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820481', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820477', None, None, None, None, None, '2914167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.013507366180419922 save_final save missing photos in datou_result : time spend for datou_step_exec : 97.2317590713501 time spend to save output : 0.014047861099243164 total time spend for step 3 : 97.24580693244934 step4:ventilate_hashtags_in_portfolio Tue May 20 22:16:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23181869 get user id for portfolio 23181869 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181869 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','autre','mal_croppe','carton','flou','pet_fonce','papier','pet_clair','pehd','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181869 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','autre','mal_croppe','carton','flou','pet_fonce','papier','pet_clair','pehd','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181869 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','metal','autre','mal_croppe','carton','flou','pet_fonce','papier','pet_clair','pehd','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23182558,23182559,23182560,23182561,23182562,23182563,23182564,23182565,23182566,23182567,23182568?tags=environnement,metal,autre,mal_croppe,carton,flou,pet_fonce,papier,pet_clair,pehd,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359821359, 1359820574, 1359820532, 1359820529, 1359820524, 1359820514, 1359820481, 1359820477] Looping around the photos to save general results len do output : 1 /23181869. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359821359', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820574', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820532', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820529', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820524', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820514', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820481', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820477', None, None, None, None, None, '2914167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014259099960327148 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6125221252441406 time spend to save output : 0.014627933502197266 total time spend for step 4 : 1.627150058746338 step5:final Tue May 20 22:16:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359821359: ('0.14541831200072622',), 1359820574: ('0.14541831200072622',), 1359820532: ('0.14541831200072622',), 1359820529: ('0.14541831200072622',), 1359820524: ('0.14541831200072622',), 1359820514: ('0.14541831200072622',), 1359820481: ('0.14541831200072622',), 1359820477: ('0.14541831200072622',)} new output for save of step final : {1359821359: ('0.14541831200072622',), 1359820574: ('0.14541831200072622',), 1359820532: ('0.14541831200072622',), 1359820529: ('0.14541831200072622',), 1359820524: ('0.14541831200072622',), 1359820514: ('0.14541831200072622',), 1359820481: ('0.14541831200072622',), 1359820477: ('0.14541831200072622',)} [1359821359, 1359820574, 1359820532, 1359820529, 1359820524, 1359820514, 1359820481, 1359820477] Looping around the photos to save general results len do output : 8 /1359821359.Didn't retrieve data . /1359820574.Didn't retrieve data . /1359820532.Didn't retrieve data . /1359820529.Didn't retrieve data . /1359820524.Didn't retrieve data . /1359820514.Didn't retrieve data . /1359820481.Didn't retrieve data . /1359820477.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359821359', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820574', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820532', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820529', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820524', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820514', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820481', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820477', None, None, None, None, None, '2914167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012952566146850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11457300186157227 time spend to save output : 0.013578414916992188 total time spend for step 5 : 0.12815141677856445 step6:blur_detection Tue May 20 22:16:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 8 time used for this insertion : 0.01065373420715332 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 8 time used for this insertion : 0.010241031646728516 save missing photos in datou_result : time spend for datou_step_exec : 0.023540019989013672 time spend to save output : 0.025917530059814453 total time spend for step 6 : 0.049457550048828125 step7:brightness Tue May 20 22:16:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 8 time used for this insertion : 0.009006738662719727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 8 time used for this insertion : 0.010080814361572266 save missing photos in datou_result : time spend for datou_step_exec : 0.027896881103515625 time spend to save output : 0.023846149444580078 total time spend for step 7 : 0.0517430305480957 step8:velours_tree Tue May 20 22:16:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.1403980255126953 time spend to save output : 9.322166442871094e-05 total time spend for step 8 : 1.140491247177124 step9:send_mail_cod Tue May 20 22:16:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23181869_20-05-2025_22_16_38.pdf 23182559 change filename to text .change filename to text .change filename to text .change filename to text .imagette231825591747772198 23182560 change filename to text .change filename to text .imagette231825601747772198 23182561 imagette231825611747772198 23182562 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231825621747772198 23182563 imagette231825631747772201 23182564 change filename to text .change filename to text .imagette231825641747772201 23182565 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231825651747772201 23182566 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231825661747772202 23182567 imagette231825671747772204 23182568 imagette231825681747772204 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23181869 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23182558,23182559,23182560,23182561,23182562,23182563,23182564,23182565,23182566,23182567,23182568?tags=environnement,metal,autre,mal_croppe,carton,flou,pet_fonce,papier,pet_clair,pehd,background args[1359821359] : ((1359821359, -4.784770419143451, 492609224), (1359821359, 0.1487766105249965, 2107752395), '0.14541831200072622') We are sending mail with results at report@fotonower.com args[1359820574] : ((1359820574, -3.218094795015273, 492609224), (1359820574, -0.18774242878359984, 496442774), '0.14541831200072622') We are sending mail with results at report@fotonower.com args[1359820532] : ((1359820532, -1.53088825715255, 492688767), (1359820532, 0.2149414063363992, 2107752395), '0.14541831200072622') We are sending mail with results at report@fotonower.com args[1359820529] : ((1359820529, 1.8123458889082924, 492688767), (1359820529, 0.32572675525659983, 2107752395), '0.14541831200072622') We are sending mail with results at report@fotonower.com args[1359820524] : ((1359820524, -4.771645788303433, 492609224), (1359820524, -0.010110216961287766, 2107752395), '0.14541831200072622') We are sending mail with results at report@fotonower.com args[1359820514] : ((1359820514, -4.397783988241514, 492609224), (1359820514, -0.1966787985396987, 496442774), '0.14541831200072622') We are sending mail with results at report@fotonower.com args[1359820481] : ((1359820481, -5.299532939243697, 492609224), (1359820481, 0.07705269129857363, 2107752395), '0.14541831200072622') We are sending mail with results at report@fotonower.com args[1359820477] : ((1359820477, -4.5537915122086625, 492609224), (1359820477, 0.14414439803719928, 2107752395), '0.14541831200072622') We are sending mail with results at report@fotonower.com refus_total : 0.14541831200072622 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23181869 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181869_20-05-2025_22_16_38.pdf results_Auto_P23181869_20-05-2025_22_16_38.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181869_20-05-2025_22_16_38.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23181869','results_Auto_P23181869_20-05-2025_22_16_38.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181869_20-05-2025_22_16_38.pdf','pdf','','0.51','0.14541831200072622') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23181869

https://www.fotonower.com/image?json=false&list_photos_id=1359821359
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359820574
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359820532
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359820529
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.8123458889082924)
https://www.fotonower.com/image?json=false&list_photos_id=1359820524
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359820514
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359820481
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359820477
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.54%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/23182559?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23182560?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23182562?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23182564?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23182565?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23182566?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181869_20-05-2025_22_16_38.pdf.

Lien vers velours :https://www.fotonower.com/velours/23182558,23182559,23182560,23182561,23182562,23182563,23182564,23182565,23182566,23182567,23182568?tags=environnement,metal,autre,mal_croppe,carton,flou,pet_fonce,papier,pet_clair,pehd,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 20 May 2025 20:16:53 GMT Content-Length: 0 Connection: close X-Message-Id: H_pP1dteTI6xBaB3iqUaxg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359821359, 1359820574, 1359820532, 1359820529, 1359820524, 1359820514, 1359820481, 1359820477] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359821359', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820574', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820532', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820529', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820524', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820514', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820481', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820477', None, None, None, None, None, '2914167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01394510269165039 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.14031171798706 time spend to save output : 0.014351129531860352 total time spend for step 9 : 15.154662847518921 step10:split_time_score Tue May 20 22:16:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20052025 23181869 Nombre de photos uploadées : 8 / 23040 (0%) 20052025 23181869 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 20052025 23181869 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.0967254638671875e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0007560253143310547 elapsed_time : insert_dashboard_record_day_entry 0.023271799087524414 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.0462500658941438 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23159907_20-05-2025_09_13_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23159907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23159907 AND mptpi.`type`=3726 To do Qualite : 0.12732645980846047 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23167061_20-05-2025_13_36_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23167061 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23167061 AND mptpi.`type`=3594 To do Qualite : 0.11592767054738566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172605_20-05-2025_16_44_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172605 AND mptpi.`type`=3594 To do Qualite : 0.09250688901807158 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181868_20-05-2025_22_15_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23181868 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181868 AND mptpi.`type`=3594 To do Qualite : 0.14541831200072622 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181869_20-05-2025_22_16_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23181869 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181869 AND mptpi.`type`=3594 To do Qualite : 0.14202566153776322 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23175554_20-05-2025_18_16_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23175554 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175556 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177157 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177158 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177162 order by id desc limit 1 Qualite : 0.10680072987271037 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177165_20-05-2025_19_25_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177165 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177165 AND mptpi.`type`=3594 To do Qualite : 0.10174944399055919 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177171_20-05-2025_19_15_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177171 AND mptpi.`type`=3594 To do Qualite : 0.1128588707618464 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181897_20-05-2025_21_55_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23181897 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181897 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359821359, 1359820574, 1359820532, 1359820529, 1359820524, 1359820514, 1359820481, 1359820477] Looping around the photos to save general results len do output : 1 /23181869Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359821359', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820574', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820532', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820529', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820524', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820514', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820481', None, None, None, None, None, '2914167') ('3318', None, None, None, None, None, None, None, '2914167') ('3318', '23181869', '1359820477', None, None, None, None, None, '2914167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01370382308959961 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.279979705810547 time spend to save output : 0.014098405838012695 total time spend for step 10 : 4.29407811164856 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 195.51user 85.18system 6:32.78elapsed 71%CPU (0avgtext+0avgdata 5397492maxresident)k 870704inputs+168344outputs (17096major+14993125minor)pagefaults 0swaps