python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1877074 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2542525'] with mtr_portfolio_ids : ['20193381'] and first list_photo_ids : [] new path : /proc/1877074/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.7109863758087158 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Feb 3 22:40:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-03 22:40:34.849927: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-03 22:40:34.879051: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-03 22:40:34.880497: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe3c8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-03 22:40:34.880518: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-03 22:40:34.883730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-03 22:40:35.137607: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x381edba0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-03 22:40:35.137652: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-03 22:40:35.139143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 22:40:35.139901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 22:40:35.144612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 22:40:35.147850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 22:40:35.149427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 22:40:35.153538: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 22:40:35.155651: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 22:40:35.162985: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 22:40:35.164801: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 22:40:35.164890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 22:40:35.165826: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-03 22:40:35.165845: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-03 22:40:35.165856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-03 22:40:35.167584: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-03 22:40:35.452149: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 22:40:35.452256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 22:40:35.452295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 22:40:35.452325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 22:40:35.452353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 22:40:35.452381: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 22:40:35.452408: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 22:40:35.452436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 22:40:35.454589: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 22:40:35.456095: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-03 22:40:35.456136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-03 22:40:35.456152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 22:40:35.456166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-03 22:40:35.456180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-03 22:40:35.456194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-03 22:40:35.456208: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-03 22:40:35.456222: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-03 22:40:35.457507: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-03 22:40:35.457536: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-03 22:40:35.457547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-03 22:40:35.457557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-03 22:40:35.458938: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-03 22:40:43.070510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-03 22:40:43.237344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 81 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 84 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 58 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 1877684 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10774 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0018930435180664062 nb_pixel_total : 82419 time to create 1 rle with old method : 0.08690428733825684 length of segment : 338 time for calcul the mask position with numpy : 0.0007193088531494141 nb_pixel_total : 45584 time to create 1 rle with old method : 0.04950547218322754 length of segment : 271 time for calcul the mask position with numpy : 0.002396821975708008 nb_pixel_total : 106344 time to create 1 rle with old method : 0.11262798309326172 length of segment : 496 time for calcul the mask position with numpy : 0.0014340877532958984 nb_pixel_total : 89734 time to create 1 rle with old method : 0.09727191925048828 length of segment : 365 time for calcul the mask position with numpy : 0.0011188983917236328 nb_pixel_total : 62021 time to create 1 rle with old method : 0.06716060638427734 length of segment : 356 time for calcul the mask position with numpy : 0.00044536590576171875 nb_pixel_total : 30608 time to create 1 rle with old method : 0.032610177993774414 length of segment : 176 time for calcul the mask position with numpy : 0.005321502685546875 nb_pixel_total : 141578 time to create 1 rle with old method : 0.17972779273986816 length of segment : 1009 time for calcul the mask position with numpy : 0.005998134613037109 nb_pixel_total : 307995 time to create 1 rle with new method : 0.01752614974975586 length of segment : 456 time for calcul the mask position with numpy : 0.005235433578491211 nb_pixel_total : 184307 time to create 1 rle with new method : 0.010501623153686523 length of segment : 327 time for calcul the mask position with numpy : 0.0010313987731933594 nb_pixel_total : 18761 time to create 1 rle with old method : 0.02562856674194336 length of segment : 116 time for calcul the mask position with numpy : 0.0007276535034179688 nb_pixel_total : 26147 time to create 1 rle with old method : 0.03051900863647461 length of segment : 249 time for calcul the mask position with numpy : 0.0026564598083496094 nb_pixel_total : 82183 time to create 1 rle with old method : 0.0895226001739502 length of segment : 389 time for calcul the mask position with numpy : 0.0004885196685791016 nb_pixel_total : 9709 time to create 1 rle with old method : 0.01223897933959961 length of segment : 103 time for calcul the mask position with numpy : 0.002395153045654297 nb_pixel_total : 75432 time to create 1 rle with old method : 0.08695673942565918 length of segment : 370 time for calcul the mask position with numpy : 0.002691507339477539 nb_pixel_total : 64648 time to create 1 rle with old method : 0.06881356239318848 length of segment : 449 time for calcul the mask position with numpy : 0.00081634521484375 nb_pixel_total : 23688 time to create 1 rle with old method : 0.02555060386657715 length of segment : 357 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 6018 time to create 1 rle with old method : 0.007108211517333984 length of segment : 106 time for calcul the mask position with numpy : 0.0009102821350097656 nb_pixel_total : 36795 time to create 1 rle with old method : 0.04191255569458008 length of segment : 154 time for calcul the mask position with numpy : 0.0004730224609375 nb_pixel_total : 22291 time to create 1 rle with old method : 0.022965192794799805 length of segment : 161 time for calcul the mask position with numpy : 0.0007774829864501953 nb_pixel_total : 23070 time to create 1 rle with old method : 0.027590036392211914 length of segment : 179 time for calcul the mask position with numpy : 0.00045013427734375 nb_pixel_total : 10932 time to create 1 rle with old method : 0.012119770050048828 length of segment : 217 time for calcul the mask position with numpy : 0.0006616115570068359 nb_pixel_total : 20369 time to create 1 rle with old method : 0.02370929718017578 length of segment : 311 time for calcul the mask position with numpy : 0.0009512901306152344 nb_pixel_total : 14225 time to create 1 rle with old method : 0.016424179077148438 length of segment : 143 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 20045 time to create 1 rle with old method : 0.026938676834106445 length of segment : 158 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 11715 time to create 1 rle with old method : 0.013253450393676758 length of segment : 97 time for calcul the mask position with numpy : 0.00032973289489746094 nb_pixel_total : 4266 time to create 1 rle with old method : 0.00488734245300293 length of segment : 78 time for calcul the mask position with numpy : 0.009377717971801758 nb_pixel_total : 239708 time to create 1 rle with new method : 0.01882028579711914 length of segment : 740 time for calcul the mask position with numpy : 0.0014417171478271484 nb_pixel_total : 21834 time to create 1 rle with old method : 0.024976730346679688 length of segment : 253 time for calcul the mask position with numpy : 0.004899740219116211 nb_pixel_total : 218732 time to create 1 rle with new method : 0.019060850143432617 length of segment : 609 time for calcul the mask position with numpy : 0.0014240741729736328 nb_pixel_total : 18845 time to create 1 rle with old method : 0.020907878875732422 length of segment : 205 time for calcul the mask position with numpy : 0.0011758804321289062 nb_pixel_total : 16512 time to create 1 rle with old method : 0.018620967864990234 length of segment : 158 time for calcul the mask position with numpy : 0.0008561611175537109 nb_pixel_total : 33844 time to create 1 rle with old method : 0.04104185104370117 length of segment : 307 time for calcul the mask position with numpy : 0.001073598861694336 nb_pixel_total : 53223 time to create 1 rle with old method : 0.05574226379394531 length of segment : 242 time for calcul the mask position with numpy : 0.0004966259002685547 nb_pixel_total : 19865 time to create 1 rle with old method : 0.021044492721557617 length of segment : 296 time for calcul the mask position with numpy : 0.0025451183319091797 nb_pixel_total : 104198 time to create 1 rle with old method : 0.11318659782409668 length of segment : 475 time for calcul the mask position with numpy : 0.00039076805114746094 nb_pixel_total : 5285 time to create 1 rle with old method : 0.0063686370849609375 length of segment : 92 time for calcul the mask position with numpy : 0.00821065902709961 nb_pixel_total : 195477 time to create 1 rle with new method : 0.015215158462524414 length of segment : 582 time for calcul the mask position with numpy : 0.0017116069793701172 nb_pixel_total : 56510 time to create 1 rle with old method : 0.06368350982666016 length of segment : 516 time for calcul the mask position with numpy : 0.0010399818420410156 nb_pixel_total : 44187 time to create 1 rle with old method : 0.04966115951538086 length of segment : 271 time for calcul the mask position with numpy : 0.0010766983032226562 nb_pixel_total : 33625 time to create 1 rle with old method : 0.03667640686035156 length of segment : 231 time for calcul the mask position with numpy : 0.0003879070281982422 nb_pixel_total : 12173 time to create 1 rle with old method : 0.014527320861816406 length of segment : 141 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 1974 time to create 1 rle with old method : 0.0030961036682128906 length of segment : 51 time for calcul the mask position with numpy : 0.0013217926025390625 nb_pixel_total : 13153 time to create 1 rle with old method : 0.014625310897827148 length of segment : 266 time for calcul the mask position with numpy : 0.0009438991546630859 nb_pixel_total : 11619 time to create 1 rle with old method : 0.015596151351928711 length of segment : 236 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 4368 time to create 1 rle with old method : 0.0046329498291015625 length of segment : 89 time for calcul the mask position with numpy : 0.0014224052429199219 nb_pixel_total : 20380 time to create 1 rle with old method : 0.0236818790435791 length of segment : 146 time for calcul the mask position with numpy : 0.00037670135498046875 nb_pixel_total : 5731 time to create 1 rle with old method : 0.007089376449584961 length of segment : 88 time for calcul the mask position with numpy : 0.026100873947143555 nb_pixel_total : 148061 time to create 1 rle with old method : 0.15565800666809082 length of segment : 558 time for calcul the mask position with numpy : 0.0004506111145019531 nb_pixel_total : 4504 time to create 1 rle with old method : 0.007639646530151367 length of segment : 85 time for calcul the mask position with numpy : 0.0015239715576171875 nb_pixel_total : 18383 time to create 1 rle with old method : 0.030848026275634766 length of segment : 129 time for calcul the mask position with numpy : 0.00785517692565918 nb_pixel_total : 111079 time to create 1 rle with old method : 0.12361550331115723 length of segment : 652 time for calcul the mask position with numpy : 0.0008873939514160156 nb_pixel_total : 11536 time to create 1 rle with old method : 0.013536930084228516 length of segment : 141 time for calcul the mask position with numpy : 0.001478433609008789 nb_pixel_total : 27113 time to create 1 rle with old method : 0.03243660926818848 length of segment : 159 time for calcul the mask position with numpy : 0.0036346912384033203 nb_pixel_total : 54068 time to create 1 rle with old method : 0.06655049324035645 length of segment : 229 time for calcul the mask position with numpy : 0.0022530555725097656 nb_pixel_total : 65801 time to create 1 rle with old method : 0.06888699531555176 length of segment : 392 time for calcul the mask position with numpy : 0.00035572052001953125 nb_pixel_total : 4647 time to create 1 rle with old method : 0.005631446838378906 length of segment : 72 time for calcul the mask position with numpy : 0.0014951229095458984 nb_pixel_total : 30990 time to create 1 rle with old method : 0.033922433853149414 length of segment : 169 time for calcul the mask position with numpy : 0.0008838176727294922 nb_pixel_total : 7805 time to create 1 rle with old method : 0.008703231811523438 length of segment : 146 time for calcul the mask position with numpy : 0.001604318618774414 nb_pixel_total : 30056 time to create 1 rle with old method : 0.03266572952270508 length of segment : 194 time for calcul the mask position with numpy : 0.0010268688201904297 nb_pixel_total : 9440 time to create 1 rle with old method : 0.010542631149291992 length of segment : 251 time for calcul the mask position with numpy : 0.0023229122161865234 nb_pixel_total : 23646 time to create 1 rle with old method : 0.025524377822875977 length of segment : 198 time for calcul the mask position with numpy : 0.0009140968322753906 nb_pixel_total : 15455 time to create 1 rle with old method : 0.019966602325439453 length of segment : 198 time for calcul the mask position with numpy : 0.0007252693176269531 nb_pixel_total : 9062 time to create 1 rle with old method : 0.015093564987182617 length of segment : 123 time for calcul the mask position with numpy : 0.006688594818115234 nb_pixel_total : 111700 time to create 1 rle with old method : 0.1338334083557129 length of segment : 410 time for calcul the mask position with numpy : 0.0032753944396972656 nb_pixel_total : 9600 time to create 1 rle with old method : 0.015510797500610352 length of segment : 254 time for calcul the mask position with numpy : 0.0013391971588134766 nb_pixel_total : 15704 time to create 1 rle with old method : 0.020863056182861328 length of segment : 158 time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 4326 time to create 1 rle with old method : 0.005221128463745117 length of segment : 102 time for calcul the mask position with numpy : 0.007831335067749023 nb_pixel_total : 116258 time to create 1 rle with old method : 0.1266639232635498 length of segment : 486 time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 10455 time to create 1 rle with old method : 0.01242685317993164 length of segment : 137 time for calcul the mask position with numpy : 0.0007567405700683594 nb_pixel_total : 12052 time to create 1 rle with old method : 0.01385188102722168 length of segment : 80 time for calcul the mask position with numpy : 0.0045506954193115234 nb_pixel_total : 90946 time to create 1 rle with old method : 0.10437130928039551 length of segment : 306 time for calcul the mask position with numpy : 0.0026581287384033203 nb_pixel_total : 36735 time to create 1 rle with old method : 0.04024243354797363 length of segment : 266 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 8975 time to create 1 rle with old method : 0.010342597961425781 length of segment : 94 time for calcul the mask position with numpy : 0.0001533031463623047 nb_pixel_total : 2615 time to create 1 rle with old method : 0.003419160842895508 length of segment : 55 time for calcul the mask position with numpy : 0.0004723072052001953 nb_pixel_total : 9215 time to create 1 rle with old method : 0.01094818115234375 length of segment : 101 time for calcul the mask position with numpy : 0.0018694400787353516 nb_pixel_total : 24096 time to create 1 rle with old method : 0.026537418365478516 length of segment : 247 time for calcul the mask position with numpy : 0.001667022705078125 nb_pixel_total : 23959 time to create 1 rle with old method : 0.02773737907409668 length of segment : 194 time for calcul the mask position with numpy : 0.004544496536254883 nb_pixel_total : 57396 time to create 1 rle with old method : 0.06300997734069824 length of segment : 454 time for calcul the mask position with numpy : 0.0024750232696533203 nb_pixel_total : 16502 time to create 1 rle with old method : 0.018357276916503906 length of segment : 384 time for calcul the mask position with numpy : 0.0011286735534667969 nb_pixel_total : 19975 time to create 1 rle with old method : 0.022037506103515625 length of segment : 183 time for calcul the mask position with numpy : 0.02067852020263672 nb_pixel_total : 323484 time to create 1 rle with new method : 0.026263952255249023 length of segment : 492 time for calcul the mask position with numpy : 0.003621816635131836 nb_pixel_total : 47065 time to create 1 rle with old method : 0.051548004150390625 length of segment : 329 time for calcul the mask position with numpy : 0.0076940059661865234 nb_pixel_total : 104392 time to create 1 rle with old method : 0.11587071418762207 length of segment : 557 time for calcul the mask position with numpy : 0.005118846893310547 nb_pixel_total : 101119 time to create 1 rle with old method : 0.10350298881530762 length of segment : 613 time for calcul the mask position with numpy : 0.0006246566772460938 nb_pixel_total : 5039 time to create 1 rle with old method : 0.005636692047119141 length of segment : 94 time for calcul the mask position with numpy : 0.0004830360412597656 nb_pixel_total : 5975 time to create 1 rle with old method : 0.006569385528564453 length of segment : 89 time for calcul the mask position with numpy : 0.0007376670837402344 nb_pixel_total : 38331 time to create 1 rle with old method : 0.04305744171142578 length of segment : 178 time for calcul the mask position with numpy : 0.0018606185913085938 nb_pixel_total : 36991 time to create 1 rle with old method : 0.03865790367126465 length of segment : 327 time for calcul the mask position with numpy : 0.00037860870361328125 nb_pixel_total : 10093 time to create 1 rle with old method : 0.011540651321411133 length of segment : 132 time for calcul the mask position with numpy : 0.0029621124267578125 nb_pixel_total : 56819 time to create 1 rle with old method : 0.06055712699890137 length of segment : 329 time for calcul the mask position with numpy : 0.0037207603454589844 nb_pixel_total : 23578 time to create 1 rle with old method : 0.02734541893005371 length of segment : 235 time for calcul the mask position with numpy : 0.0052525997161865234 nb_pixel_total : 101979 time to create 1 rle with old method : 0.10679149627685547 length of segment : 366 time for calcul the mask position with numpy : 0.005999326705932617 nb_pixel_total : 117064 time to create 1 rle with old method : 0.12180829048156738 length of segment : 461 time for calcul the mask position with numpy : 0.003693103790283203 nb_pixel_total : 43146 time to create 1 rle with old method : 0.04739737510681152 length of segment : 357 time for calcul the mask position with numpy : 0.0008471012115478516 nb_pixel_total : 7579 time to create 1 rle with old method : 0.009057760238647461 length of segment : 128 time for calcul the mask position with numpy : 0.0012617111206054688 nb_pixel_total : 35882 time to create 1 rle with old method : 0.03883481025695801 length of segment : 288 time for calcul the mask position with numpy : 0.0002694129943847656 nb_pixel_total : 6404 time to create 1 rle with old method : 0.00791311264038086 length of segment : 106 time for calcul the mask position with numpy : 0.0005459785461425781 nb_pixel_total : 8016 time to create 1 rle with old method : 0.009553670883178711 length of segment : 124 time for calcul the mask position with numpy : 0.00038504600524902344 nb_pixel_total : 5136 time to create 1 rle with old method : 0.0062634944915771484 length of segment : 84 time for calcul the mask position with numpy : 0.0014047622680664062 nb_pixel_total : 18666 time to create 1 rle with old method : 0.02134871482849121 length of segment : 167 time for calcul the mask position with numpy : 0.0037615299224853516 nb_pixel_total : 77706 time to create 1 rle with old method : 0.08347415924072266 length of segment : 205 time for calcul the mask position with numpy : 0.0007965564727783203 nb_pixel_total : 10870 time to create 1 rle with old method : 0.01288747787475586 length of segment : 101 time for calcul the mask position with numpy : 0.0010988712310791016 nb_pixel_total : 20304 time to create 1 rle with old method : 0.022507190704345703 length of segment : 154 time for calcul the mask position with numpy : 0.0013568401336669922 nb_pixel_total : 13450 time to create 1 rle with old method : 0.0160062313079834 length of segment : 216 time for calcul the mask position with numpy : 0.0021867752075195312 nb_pixel_total : 36140 time to create 1 rle with old method : 0.04088640213012695 length of segment : 237 time for calcul the mask position with numpy : 0.002617359161376953 nb_pixel_total : 27366 time to create 1 rle with old method : 0.03570151329040527 length of segment : 125 time for calcul the mask position with numpy : 0.006639242172241211 nb_pixel_total : 97714 time to create 1 rle with old method : 0.13115715980529785 length of segment : 391 time for calcul the mask position with numpy : 0.003567218780517578 nb_pixel_total : 61050 time to create 1 rle with old method : 0.06528282165527344 length of segment : 383 time for calcul the mask position with numpy : 0.0018205642700195312 nb_pixel_total : 29728 time to create 1 rle with old method : 0.031332969665527344 length of segment : 185 time for calcul the mask position with numpy : 0.0004718303680419922 nb_pixel_total : 6090 time to create 1 rle with old method : 0.007400035858154297 length of segment : 85 time for calcul the mask position with numpy : 0.0005700588226318359 nb_pixel_total : 5117 time to create 1 rle with old method : 0.006075143814086914 length of segment : 103 time for calcul the mask position with numpy : 0.0012404918670654297 nb_pixel_total : 21549 time to create 1 rle with old method : 0.02350759506225586 length of segment : 215 time for calcul the mask position with numpy : 0.00047087669372558594 nb_pixel_total : 9964 time to create 1 rle with old method : 0.011274099349975586 length of segment : 127 time for calcul the mask position with numpy : 0.0009267330169677734 nb_pixel_total : 21292 time to create 1 rle with old method : 0.024512767791748047 length of segment : 204 time for calcul the mask position with numpy : 0.011583805084228516 nb_pixel_total : 225545 time to create 1 rle with new method : 0.019913911819458008 length of segment : 1064 time for calcul the mask position with numpy : 0.0009436607360839844 nb_pixel_total : 15252 time to create 1 rle with old method : 0.01661968231201172 length of segment : 199 time for calcul the mask position with numpy : 0.003705263137817383 nb_pixel_total : 19590 time to create 1 rle with old method : 0.021897077560424805 length of segment : 188 time for calcul the mask position with numpy : 0.0035402774810791016 nb_pixel_total : 50953 time to create 1 rle with old method : 0.05626678466796875 length of segment : 641 time for calcul the mask position with numpy : 0.000885009765625 nb_pixel_total : 18107 time to create 1 rle with old method : 0.022988080978393555 length of segment : 190 time for calcul the mask position with numpy : 0.0007066726684570312 nb_pixel_total : 13107 time to create 1 rle with old method : 0.015538215637207031 length of segment : 136 time for calcul the mask position with numpy : 0.00037598609924316406 nb_pixel_total : 10334 time to create 1 rle with old method : 0.011572122573852539 length of segment : 127 time for calcul the mask position with numpy : 0.0018186569213867188 nb_pixel_total : 35345 time to create 1 rle with old method : 0.03778076171875 length of segment : 199 time for calcul the mask position with numpy : 0.001986980438232422 nb_pixel_total : 42238 time to create 1 rle with old method : 0.04733014106750488 length of segment : 234 time for calcul the mask position with numpy : 0.002469301223754883 nb_pixel_total : 36302 time to create 1 rle with old method : 0.038880348205566406 length of segment : 259 time for calcul the mask position with numpy : 0.0006797313690185547 nb_pixel_total : 9063 time to create 1 rle with old method : 0.010818958282470703 length of segment : 86 time for calcul the mask position with numpy : 0.06616520881652832 nb_pixel_total : 1576242 time to create 1 rle with new method : 0.08873200416564941 length of segment : 1830 time for calcul the mask position with numpy : 0.0016748905181884766 nb_pixel_total : 22094 time to create 1 rle with old method : 0.024387598037719727 length of segment : 291 time for calcul the mask position with numpy : 0.012050151824951172 nb_pixel_total : 260439 time to create 1 rle with new method : 0.013096332550048828 length of segment : 410 time for calcul the mask position with numpy : 0.0008177757263183594 nb_pixel_total : 11416 time to create 1 rle with old method : 0.012790918350219727 length of segment : 149 time for calcul the mask position with numpy : 0.0042765140533447266 nb_pixel_total : 124700 time to create 1 rle with old method : 0.13063883781433105 length of segment : 341 time for calcul the mask position with numpy : 0.0024907588958740234 nb_pixel_total : 47741 time to create 1 rle with old method : 0.050256967544555664 length of segment : 284 time for calcul the mask position with numpy : 0.003735065460205078 nb_pixel_total : 61360 time to create 1 rle with old method : 0.06984400749206543 length of segment : 329 time for calcul the mask position with numpy : 0.002476215362548828 nb_pixel_total : 13875 time to create 1 rle with old method : 0.015977144241333008 length of segment : 246 time for calcul the mask position with numpy : 0.0014421939849853516 nb_pixel_total : 28650 time to create 1 rle with old method : 0.031190872192382812 length of segment : 201 time for calcul the mask position with numpy : 0.0027315616607666016 nb_pixel_total : 75953 time to create 1 rle with old method : 0.08350896835327148 length of segment : 261 time for calcul the mask position with numpy : 0.003786802291870117 nb_pixel_total : 43528 time to create 1 rle with old method : 0.054135799407958984 length of segment : 349 time for calcul the mask position with numpy : 0.0032029151916503906 nb_pixel_total : 71727 time to create 1 rle with old method : 0.07658195495605469 length of segment : 315 time for calcul the mask position with numpy : 0.002254486083984375 nb_pixel_total : 49718 time to create 1 rle with old method : 0.05475926399230957 length of segment : 390 time for calcul the mask position with numpy : 0.00486302375793457 nb_pixel_total : 103253 time to create 1 rle with old method : 0.11074495315551758 length of segment : 459 time for calcul the mask position with numpy : 0.005436420440673828 nb_pixel_total : 106836 time to create 1 rle with old method : 0.11232399940490723 length of segment : 491 time for calcul the mask position with numpy : 0.017293930053710938 nb_pixel_total : 312048 time to create 1 rle with new method : 0.01949620246887207 length of segment : 465 time for calcul the mask position with numpy : 0.0025048255920410156 nb_pixel_total : 54580 time to create 1 rle with old method : 0.06119561195373535 length of segment : 325 time for calcul the mask position with numpy : 0.005598306655883789 nb_pixel_total : 125853 time to create 1 rle with old method : 0.14311909675598145 length of segment : 422 time for calcul the mask position with numpy : 0.003556489944458008 nb_pixel_total : 74735 time to create 1 rle with old method : 0.0806887149810791 length of segment : 399 time for calcul the mask position with numpy : 0.0012936592102050781 nb_pixel_total : 29207 time to create 1 rle with old method : 0.03308367729187012 length of segment : 159 time for calcul the mask position with numpy : 0.0019850730895996094 nb_pixel_total : 30724 time to create 1 rle with old method : 0.03459501266479492 length of segment : 304 time for calcul the mask position with numpy : 0.0009682178497314453 nb_pixel_total : 26032 time to create 1 rle with old method : 0.028624773025512695 length of segment : 172 time for calcul the mask position with numpy : 0.0071201324462890625 nb_pixel_total : 185192 time to create 1 rle with new method : 0.008414983749389648 length of segment : 427 time for calcul the mask position with numpy : 0.002713918685913086 nb_pixel_total : 46019 time to create 1 rle with old method : 0.058548927307128906 length of segment : 247 time for calcul the mask position with numpy : 0.0041272640228271484 nb_pixel_total : 81608 time to create 1 rle with old method : 0.0942678451538086 length of segment : 400 time for calcul the mask position with numpy : 0.0012574195861816406 nb_pixel_total : 19448 time to create 1 rle with old method : 0.024367570877075195 length of segment : 266 time for calcul the mask position with numpy : 0.0012400150299072266 nb_pixel_total : 19795 time to create 1 rle with old method : 0.033678531646728516 length of segment : 151 time for calcul the mask position with numpy : 0.0021719932556152344 nb_pixel_total : 82412 time to create 1 rle with old method : 0.09902238845825195 length of segment : 467 time for calcul the mask position with numpy : 0.0005717277526855469 nb_pixel_total : 10079 time to create 1 rle with old method : 0.011334896087646484 length of segment : 117 time for calcul the mask position with numpy : 0.0016140937805175781 nb_pixel_total : 15997 time to create 1 rle with old method : 0.01755380630493164 length of segment : 468 time for calcul the mask position with numpy : 0.0006632804870605469 nb_pixel_total : 28887 time to create 1 rle with old method : 0.03317975997924805 length of segment : 147 time for calcul the mask position with numpy : 0.00043463706970214844 nb_pixel_total : 7635 time to create 1 rle with old method : 0.008464574813842773 length of segment : 102 time for calcul the mask position with numpy : 0.0005133152008056641 nb_pixel_total : 3958 time to create 1 rle with old method : 0.004828929901123047 length of segment : 171 time for calcul the mask position with numpy : 0.009229183197021484 nb_pixel_total : 223767 time to create 1 rle with new method : 0.012674570083618164 length of segment : 616 time for calcul the mask position with numpy : 0.0037746429443359375 nb_pixel_total : 89683 time to create 1 rle with old method : 0.09853839874267578 length of segment : 488 time for calcul the mask position with numpy : 0.0010287761688232422 nb_pixel_total : 13348 time to create 1 rle with old method : 0.016215085983276367 length of segment : 166 time for calcul the mask position with numpy : 0.0007565021514892578 nb_pixel_total : 12970 time to create 1 rle with old method : 0.015911579132080078 length of segment : 125 time for calcul the mask position with numpy : 0.004782915115356445 nb_pixel_total : 95346 time to create 1 rle with old method : 0.11777853965759277 length of segment : 444 time for calcul the mask position with numpy : 0.0012488365173339844 nb_pixel_total : 18163 time to create 1 rle with old method : 0.02091836929321289 length of segment : 149 time for calcul the mask position with numpy : 0.0034589767456054688 nb_pixel_total : 52567 time to create 1 rle with old method : 0.0633547306060791 length of segment : 246 time for calcul the mask position with numpy : 0.0014352798461914062 nb_pixel_total : 26158 time to create 1 rle with old method : 0.03096771240234375 length of segment : 381 time for calcul the mask position with numpy : 0.0047931671142578125 nb_pixel_total : 98776 time to create 1 rle with old method : 0.11653876304626465 length of segment : 403 time for calcul the mask position with numpy : 0.001516103744506836 nb_pixel_total : 28940 time to create 1 rle with old method : 0.0328671932220459 length of segment : 147 time for calcul the mask position with numpy : 0.01755833625793457 nb_pixel_total : 434561 time to create 1 rle with new method : 0.028748273849487305 length of segment : 762 time for calcul the mask position with numpy : 0.0026679039001464844 nb_pixel_total : 57596 time to create 1 rle with old method : 0.06411933898925781 length of segment : 279 time for calcul the mask position with numpy : 0.002893209457397461 nb_pixel_total : 62427 time to create 1 rle with old method : 0.06510329246520996 length of segment : 304 time for calcul the mask position with numpy : 0.0030825138092041016 nb_pixel_total : 40903 time to create 1 rle with old method : 0.045446157455444336 length of segment : 249 time for calcul the mask position with numpy : 0.00223541259765625 nb_pixel_total : 40273 time to create 1 rle with old method : 0.04481244087219238 length of segment : 603 time for calcul the mask position with numpy : 0.011143207550048828 nb_pixel_total : 288994 time to create 1 rle with new method : 0.014571905136108398 length of segment : 451 time for calcul the mask position with numpy : 0.0009872913360595703 nb_pixel_total : 26136 time to create 1 rle with old method : 0.028967857360839844 length of segment : 162 time for calcul the mask position with numpy : 0.01633739471435547 nb_pixel_total : 479208 time to create 1 rle with new method : 0.020618915557861328 length of segment : 930 time for calcul the mask position with numpy : 0.0004830360412597656 nb_pixel_total : 8754 time to create 1 rle with old method : 0.010246992111206055 length of segment : 103 time for calcul the mask position with numpy : 0.007401227951049805 nb_pixel_total : 207871 time to create 1 rle with new method : 0.008229255676269531 length of segment : 386 time for calcul the mask position with numpy : 0.0008909702301025391 nb_pixel_total : 18857 time to create 1 rle with old method : 0.021048784255981445 length of segment : 208 time for calcul the mask position with numpy : 0.00018262863159179688 nb_pixel_total : 7273 time to create 1 rle with old method : 0.007911443710327148 length of segment : 95 time for calcul the mask position with numpy : 0.0022950172424316406 nb_pixel_total : 105170 time to create 1 rle with old method : 0.10924935340881348 length of segment : 450 time for calcul the mask position with numpy : 0.002007007598876953 nb_pixel_total : 49838 time to create 1 rle with old method : 0.05404543876647949 length of segment : 356 time for calcul the mask position with numpy : 0.0014085769653320312 nb_pixel_total : 36079 time to create 1 rle with old method : 0.03905153274536133 length of segment : 210 time for calcul the mask position with numpy : 0.0006961822509765625 nb_pixel_total : 13188 time to create 1 rle with old method : 0.014942646026611328 length of segment : 190 time for calcul the mask position with numpy : 0.0006313323974609375 nb_pixel_total : 14475 time to create 1 rle with old method : 0.016383886337280273 length of segment : 126 time for calcul the mask position with numpy : 0.000885009765625 nb_pixel_total : 20320 time to create 1 rle with old method : 0.02472829818725586 length of segment : 188 time for calcul the mask position with numpy : 0.001775979995727539 nb_pixel_total : 55296 time to create 1 rle with old method : 0.05789923667907715 length of segment : 372 time for calcul the mask position with numpy : 0.00047087669372558594 nb_pixel_total : 9002 time to create 1 rle with old method : 0.01072239875793457 length of segment : 144 time for calcul the mask position with numpy : 0.001018524169921875 nb_pixel_total : 18854 time to create 1 rle with old method : 0.020751237869262695 length of segment : 251 time for calcul the mask position with numpy : 0.0011544227600097656 nb_pixel_total : 47894 time to create 1 rle with old method : 0.05205583572387695 length of segment : 212 time for calcul the mask position with numpy : 0.0005092620849609375 nb_pixel_total : 10609 time to create 1 rle with old method : 0.012530088424682617 length of segment : 116 time for calcul the mask position with numpy : 0.0006973743438720703 nb_pixel_total : 14508 time to create 1 rle with old method : 0.017496109008789062 length of segment : 110 time for calcul the mask position with numpy : 0.0008144378662109375 nb_pixel_total : 38495 time to create 1 rle with old method : 0.04101967811584473 length of segment : 165 time for calcul the mask position with numpy : 0.0009167194366455078 nb_pixel_total : 29287 time to create 1 rle with old method : 0.032028913497924805 length of segment : 356 time for calcul the mask position with numpy : 0.0021545886993408203 nb_pixel_total : 80287 time to create 1 rle with old method : 0.08423519134521484 length of segment : 312 time for calcul the mask position with numpy : 0.0009584426879882812 nb_pixel_total : 23638 time to create 1 rle with old method : 0.024908781051635742 length of segment : 311 time for calcul the mask position with numpy : 0.0001709461212158203 nb_pixel_total : 4627 time to create 1 rle with old method : 0.0051572322845458984 length of segment : 76 time for calcul the mask position with numpy : 0.0004177093505859375 nb_pixel_total : 7513 time to create 1 rle with old method : 0.009167671203613281 length of segment : 196 time for calcul the mask position with numpy : 0.009516477584838867 nb_pixel_total : 252281 time to create 1 rle with new method : 0.010090827941894531 length of segment : 486 time for calcul the mask position with numpy : 0.007212638854980469 nb_pixel_total : 89896 time to create 1 rle with old method : 0.12023091316223145 length of segment : 352 time for calcul the mask position with numpy : 0.015151262283325195 nb_pixel_total : 331343 time to create 1 rle with new method : 0.01798701286315918 length of segment : 469 time for calcul the mask position with numpy : 0.0013654232025146484 nb_pixel_total : 15026 time to create 1 rle with old method : 0.016726255416870117 length of segment : 254 time for calcul the mask position with numpy : 0.0031354427337646484 nb_pixel_total : 63365 time to create 1 rle with old method : 0.06905984878540039 length of segment : 275 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 5276 time to create 1 rle with old method : 0.006182432174682617 length of segment : 82 time for calcul the mask position with numpy : 0.0012531280517578125 nb_pixel_total : 23265 time to create 1 rle with old method : 0.024540424346923828 length of segment : 257 time for calcul the mask position with numpy : 0.005269765853881836 nb_pixel_total : 101227 time to create 1 rle with old method : 0.10739684104919434 length of segment : 368 time for calcul the mask position with numpy : 0.0041713714599609375 nb_pixel_total : 85856 time to create 1 rle with old method : 0.09282112121582031 length of segment : 289 time for calcul the mask position with numpy : 0.010083198547363281 nb_pixel_total : 167938 time to create 1 rle with new method : 0.013457059860229492 length of segment : 875 time for calcul the mask position with numpy : 0.009952545166015625 nb_pixel_total : 268117 time to create 1 rle with new method : 0.010364532470703125 length of segment : 670 time for calcul the mask position with numpy : 0.0041675567626953125 nb_pixel_total : 63981 time to create 1 rle with old method : 0.0809326171875 length of segment : 454 time for calcul the mask position with numpy : 0.0010356903076171875 nb_pixel_total : 19109 time to create 1 rle with old method : 0.021467924118041992 length of segment : 202 time for calcul the mask position with numpy : 0.0024755001068115234 nb_pixel_total : 34011 time to create 1 rle with old method : 0.04002642631530762 length of segment : 283 time for calcul the mask position with numpy : 0.004480838775634766 nb_pixel_total : 140976 time to create 1 rle with old method : 0.14884185791015625 length of segment : 726 time for calcul the mask position with numpy : 0.0004165172576904297 nb_pixel_total : 8783 time to create 1 rle with old method : 0.010025978088378906 length of segment : 139 time for calcul the mask position with numpy : 0.004184722900390625 nb_pixel_total : 56064 time to create 1 rle with old method : 0.05708026885986328 length of segment : 506 time for calcul the mask position with numpy : 0.0007333755493164062 nb_pixel_total : 13793 time to create 1 rle with old method : 0.014535188674926758 length of segment : 145 time for calcul the mask position with numpy : 0.004167079925537109 nb_pixel_total : 82963 time to create 1 rle with old method : 0.08678531646728516 length of segment : 309 time for calcul the mask position with numpy : 0.001926422119140625 nb_pixel_total : 38809 time to create 1 rle with old method : 0.042150259017944336 length of segment : 225 time for calcul the mask position with numpy : 0.0033812522888183594 nb_pixel_total : 50418 time to create 1 rle with old method : 0.051767587661743164 length of segment : 505 time for calcul the mask position with numpy : 0.004544734954833984 nb_pixel_total : 79314 time to create 1 rle with old method : 0.08342957496643066 length of segment : 272 time for calcul the mask position with numpy : 0.005794048309326172 nb_pixel_total : 91937 time to create 1 rle with old method : 0.09703207015991211 length of segment : 419 time for calcul the mask position with numpy : 0.0077669620513916016 nb_pixel_total : 158587 time to create 1 rle with new method : 0.010612964630126953 length of segment : 650 time for calcul the mask position with numpy : 0.0004513263702392578 nb_pixel_total : 9821 time to create 1 rle with old method : 0.011286258697509766 length of segment : 155 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 12907 time to create 1 rle with old method : 0.013650894165039062 length of segment : 103 time for calcul the mask position with numpy : 0.0024144649505615234 nb_pixel_total : 118475 time to create 1 rle with old method : 0.1237485408782959 length of segment : 489 time for calcul the mask position with numpy : 0.002031087875366211 nb_pixel_total : 93662 time to create 1 rle with old method : 0.0954439640045166 length of segment : 363 time for calcul the mask position with numpy : 0.0010824203491210938 nb_pixel_total : 42144 time to create 1 rle with old method : 0.04654741287231445 length of segment : 387 time for calcul the mask position with numpy : 0.00067901611328125 nb_pixel_total : 28529 time to create 1 rle with old method : 0.028971433639526367 length of segment : 273 time for calcul the mask position with numpy : 0.007851362228393555 nb_pixel_total : 439601 time to create 1 rle with new method : 0.013519763946533203 length of segment : 1032 time spent for convertir_results : 20.42669939994812 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 482 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 4995 save missing photos in datou_result : time spend for datou_step_exec : 80.6131272315979 time spend to save output : 1.0750062465667725 total time spend for step 1 : 81.68813347816467 step2:crop_condition Mon Feb 3 22:41:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 482 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 262 About to insert : list_path_to_insert length 262 new photo from crops ! About to upload 262 photos upload in portfolio : 3736932 init cache_photo without model_param we have 262 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738618981_1877074 we have uploaded 262 photos in the portfolio 3736932 time of upload the photos Elapsed time : 59.718995332717896 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 117 About to insert : list_path_to_insert length 117 new photo from crops ! About to upload 117 photos upload in portfolio : 3736932 init cache_photo without model_param we have 117 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738619066_1877074 we have uploaded 117 photos in the portfolio 3736932 time of upload the photos Elapsed time : 28.3198299407959 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 84 About to insert : list_path_to_insert length 84 new photo from crops ! About to upload 84 photos upload in portfolio : 3736932 init cache_photo without model_param we have 84 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738619143_1877074 we have uploaded 84 photos in the portfolio 3736932 time of upload the photos Elapsed time : 20.211178064346313 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738619165_1877074 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.473552942276001 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738619170_1877074 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4630811214447021 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1334118873, 1334118774, 1334118130, 1334118129, 1334118127, 1334118124, 1334118120, 1334115608, 1334115605] Looping around the photos to save general results len do output : 473 /1334350575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334350907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334351777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118873', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118774', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118130', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118129', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118127', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118124', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118120', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115608', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115605', None, None, None, None, None, '2542525') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1428 time used for this insertion : 0.05703902244567871 save_final save missing photos in datou_result : time spend for datou_step_exec : 257.5333721637726 time spend to save output : 0.06771349906921387 total time spend for step 2 : 257.6010856628418 step3:rle_unique_nms_with_priority Mon Feb 3 22:46:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 482 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 6.494156837463379 time for calcul the mask position with numpy : 0.023113250732421875 nb_pixel_total : 141524 time to create 1 rle with old method : 0.15085172653198242 time for calcul the mask position with numpy : 0.022190570831298828 nb_pixel_total : 30640 time to create 1 rle with old method : 0.03551220893859863 time for calcul the mask position with numpy : 0.022886037826538086 nb_pixel_total : 62038 time to create 1 rle with old method : 0.07113146781921387 time for calcul the mask position with numpy : 0.022217273712158203 nb_pixel_total : 89740 time to create 1 rle with old method : 0.09684538841247559 time for calcul the mask position with numpy : 0.02139878273010254 nb_pixel_total : 106190 time to create 1 rle with old method : 0.10823225975036621 time for calcul the mask position with numpy : 0.021712303161621094 nb_pixel_total : 45581 time to create 1 rle with old method : 0.04868650436401367 time for calcul the mask position with numpy : 0.0218048095703125 nb_pixel_total : 82408 time to create 1 rle with old method : 0.09450721740722656 time for calcul the mask position with numpy : 0.7624895572662354 nb_pixel_total : 6492119 time to create 1 rle with new method : 0.2807018756866455 create new chi : 1.861785650253296 time to delete rle : 0.022189617156982422 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.09345531463623047 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 7.3266613483428955 time for calcul the mask position with numpy : 0.07960939407348633 nb_pixel_total : 6133600 time to create 1 rle with new method : 0.15510821342468262 time for calcul the mask position with numpy : 0.027837038040161133 nb_pixel_total : 36794 time to create 1 rle with old method : 0.0398411750793457 time for calcul the mask position with numpy : 0.028086185455322266 nb_pixel_total : 23066 time to create 1 rle with old method : 0.02402520179748535 time for calcul the mask position with numpy : 0.02850508689880371 nb_pixel_total : 184346 time to create 1 rle with new method : 0.12330198287963867 time for calcul the mask position with numpy : 0.029140233993530273 nb_pixel_total : 10930 time to create 1 rle with old method : 0.011976480484008789 time for calcul the mask position with numpy : 0.029702186584472656 nb_pixel_total : 82181 time to create 1 rle with old method : 0.08621931076049805 time for calcul the mask position with numpy : 0.027725696563720703 nb_pixel_total : 23665 time to create 1 rle with old method : 0.0255734920501709 time for calcul the mask position with numpy : 0.028171777725219727 nb_pixel_total : 25742 time to create 1 rle with old method : 0.027077198028564453 time for calcul the mask position with numpy : 0.028579235076904297 nb_pixel_total : 22293 time to create 1 rle with old method : 0.02367854118347168 time for calcul the mask position with numpy : 0.027513742446899414 nb_pixel_total : 6022 time to create 1 rle with old method : 0.007252931594848633 time for calcul the mask position with numpy : 0.02846980094909668 nb_pixel_total : 75426 time to create 1 rle with old method : 0.08075165748596191 time for calcul the mask position with numpy : 0.02860426902770996 nb_pixel_total : 64677 time to create 1 rle with old method : 0.06882309913635254 time for calcul the mask position with numpy : 0.029156208038330078 nb_pixel_total : 20016 time to create 1 rle with old method : 0.02211141586303711 time for calcul the mask position with numpy : 0.028522253036499023 nb_pixel_total : 18760 time to create 1 rle with old method : 0.019600629806518555 time for calcul the mask position with numpy : 0.028031110763549805 nb_pixel_total : 9706 time to create 1 rle with old method : 0.01092982292175293 time for calcul the mask position with numpy : 0.027777671813964844 nb_pixel_total : 6901 time to create 1 rle with old method : 0.008691549301147461 time for calcul the mask position with numpy : 0.02998638153076172 nb_pixel_total : 306115 time to create 1 rle with new method : 0.1292705535888672 create new chi : 1.469419002532959 time to delete rle : 0.002182483673095703 batch 1 Loaded 34 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 1102 TO DO : save crop sub photo not yet done ! save time : 0.18944573402404785 nb_obj : 46 nb_hashtags : 4 time to prepare the origin masks : 7.540269613265991 time for calcul the mask position with numpy : 0.0639641284942627 nb_pixel_total : 5208201 time to create 1 rle with new method : 0.14514923095703125 time for calcul the mask position with numpy : 0.02830958366394043 nb_pixel_total : 11717 time to create 1 rle with old method : 0.012716054916381836 time for calcul the mask position with numpy : 0.027974367141723633 nb_pixel_total : 33848 time to create 1 rle with old method : 0.037021636962890625 time for calcul the mask position with numpy : 0.029089927673339844 nb_pixel_total : 33635 time to create 1 rle with old method : 0.03731703758239746 time for calcul the mask position with numpy : 0.028764963150024414 nb_pixel_total : 56538 time to create 1 rle with old method : 0.060515403747558594 time for calcul the mask position with numpy : 0.029806852340698242 nb_pixel_total : 218725 time to create 1 rle with new method : 0.12836980819702148 time for calcul the mask position with numpy : 0.033814430236816406 nb_pixel_total : 108849 time to create 1 rle with old method : 0.1178739070892334 time for calcul the mask position with numpy : 0.028705596923828125 nb_pixel_total : 19875 time to create 1 rle with old method : 0.02245354652404785 time for calcul the mask position with numpy : 0.028860092163085938 nb_pixel_total : 44189 time to create 1 rle with old method : 0.04781198501586914 time for calcul the mask position with numpy : 0.028918743133544922 nb_pixel_total : 53210 time to create 1 rle with old method : 0.060730934143066406 time for calcul the mask position with numpy : 0.02920079231262207 nb_pixel_total : 104169 time to create 1 rle with old method : 0.11670565605163574 time for calcul the mask position with numpy : 0.028560876846313477 nb_pixel_total : 20044 time to create 1 rle with old method : 0.021394014358520508 time for calcul the mask position with numpy : 0.02978515625 nb_pixel_total : 239716 time to create 1 rle with new method : 0.12314963340759277 time for calcul the mask position with numpy : 0.02657341957092285 nb_pixel_total : 23648 time to create 1 rle with old method : 0.024363994598388672 time for calcul the mask position with numpy : 0.026410579681396484 nb_pixel_total : 12952 time to create 1 rle with old method : 0.013506412506103516 time for calcul the mask position with numpy : 0.02746891975402832 nb_pixel_total : 65869 time to create 1 rle with old method : 0.06669926643371582 time for calcul the mask position with numpy : 0.02769756317138672 nb_pixel_total : 195474 time to create 1 rle with new method : 0.12546777725219727 time for calcul the mask position with numpy : 0.028048992156982422 nb_pixel_total : 20385 time to create 1 rle with old method : 0.02248692512512207 time for calcul the mask position with numpy : 0.028601646423339844 nb_pixel_total : 111477 time to create 1 rle with old method : 0.11784243583679199 time for calcul the mask position with numpy : 0.028448104858398438 nb_pixel_total : 111721 time to create 1 rle with old method : 0.12463641166687012 time for calcul the mask position with numpy : 0.028008222579956055 nb_pixel_total : 15694 time to create 1 rle with old method : 0.018036603927612305 time for calcul the mask position with numpy : 0.027852773666381836 nb_pixel_total : 18384 time to create 1 rle with old method : 0.019460439682006836 time for calcul the mask position with numpy : 0.027747154235839844 nb_pixel_total : 30062 time to create 1 rle with old method : 0.03289628028869629 time for calcul the mask position with numpy : 0.02836775779724121 nb_pixel_total : 27109 time to create 1 rle with old method : 0.029427289962768555 time for calcul the mask position with numpy : 0.028120994567871094 nb_pixel_total : 9440 time to create 1 rle with old method : 0.010179996490478516 time for calcul the mask position with numpy : 0.028063297271728516 nb_pixel_total : 5773 time to create 1 rle with old method : 0.006531715393066406 time for calcul the mask position with numpy : 0.027997732162475586 nb_pixel_total : 4505 time to create 1 rle with old method : 0.005074977874755859 time for calcul the mask position with numpy : 0.02774190902709961 nb_pixel_total : 4369 time to create 1 rle with old method : 0.0048143863677978516 time for calcul the mask position with numpy : 0.02800893783569336 nb_pixel_total : 9499 time to create 1 rle with old method : 0.010849475860595703 time for calcul the mask position with numpy : 0.028376340866088867 nb_pixel_total : 18844 time to create 1 rle with old method : 0.02005791664123535 time for calcul the mask position with numpy : 0.02836322784423828 nb_pixel_total : 4267 time to create 1 rle with old method : 0.004854917526245117 time for calcul the mask position with numpy : 0.028067827224731445 nb_pixel_total : 1972 time to create 1 rle with old method : 0.002361774444580078 time for calcul the mask position with numpy : 0.028224945068359375 nb_pixel_total : 7754 time to create 1 rle with old method : 0.009302854537963867 time for calcul the mask position with numpy : 0.02837085723876953 nb_pixel_total : 11503 time to create 1 rle with old method : 0.012410402297973633 time for calcul the mask position with numpy : 0.027721166610717773 nb_pixel_total : 5284 time to create 1 rle with old method : 0.005766868591308594 time for calcul the mask position with numpy : 0.027537107467651367 nb_pixel_total : 21779 time to create 1 rle with old method : 0.02363896369934082 time for calcul the mask position with numpy : 0.028614521026611328 nb_pixel_total : 4326 time to create 1 rle with old method : 0.004946231842041016 time for calcul the mask position with numpy : 0.028027772903442383 nb_pixel_total : 11521 time to create 1 rle with old method : 0.012959480285644531 time for calcul the mask position with numpy : 0.028632402420043945 nb_pixel_total : 15465 time to create 1 rle with old method : 0.01767587661743164 time for calcul the mask position with numpy : 0.028412342071533203 nb_pixel_total : 16499 time to create 1 rle with old method : 0.018256664276123047 time for calcul the mask position with numpy : 0.028553009033203125 nb_pixel_total : 4619 time to create 1 rle with old method : 0.005312919616699219 time for calcul the mask position with numpy : 0.028281211853027344 nb_pixel_total : 2109 time to create 1 rle with old method : 0.002561807632446289 time for calcul the mask position with numpy : 0.02855086326599121 nb_pixel_total : 14204 time to create 1 rle with old method : 0.016383647918701172 time for calcul the mask position with numpy : 0.02847886085510254 nb_pixel_total : 54016 time to create 1 rle with old method : 0.06110715866088867 time for calcul the mask position with numpy : 0.028782129287719727 nb_pixel_total : 31272 time to create 1 rle with old method : 0.03490400314331055 time for calcul the mask position with numpy : 0.02804255485534668 nb_pixel_total : 5729 time to create 1 rle with old method : 0.0068547725677490234 create new chi : 3.2502782344818115 time to delete rle : 0.0037758350372314453 batch 1 Loaded 92 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.1925053596496582 nb_obj : 39 nb_hashtags : 5 time to prepare the origin masks : 7.4623026847839355 time for calcul the mask position with numpy : 0.0735931396484375 nb_pixel_total : 5404527 time to create 1 rle with new method : 0.14613652229309082 time for calcul the mask position with numpy : 0.028029203414916992 nb_pixel_total : 36142 time to create 1 rle with old method : 0.037700653076171875 time for calcul the mask position with numpy : 0.02835822105407715 nb_pixel_total : 16509 time to create 1 rle with old method : 0.017696857452392578 time for calcul the mask position with numpy : 0.028397321701049805 nb_pixel_total : 10455 time to create 1 rle with old method : 0.011458873748779297 time for calcul the mask position with numpy : 0.028996706008911133 nb_pixel_total : 101103 time to create 1 rle with old method : 0.10812091827392578 time for calcul the mask position with numpy : 0.02800273895263672 nb_pixel_total : 7570 time to create 1 rle with old method : 0.008309125900268555 time for calcul the mask position with numpy : 0.027761220932006836 nb_pixel_total : 5036 time to create 1 rle with old method : 0.005845308303833008 time for calcul the mask position with numpy : 0.027482271194458008 nb_pixel_total : 28652 time to create 1 rle with old method : 0.029508352279663086 time for calcul the mask position with numpy : 0.027117013931274414 nb_pixel_total : 24094 time to create 1 rle with old method : 0.026611328125 time for calcul the mask position with numpy : 0.028252840042114258 nb_pixel_total : 57358 time to create 1 rle with old method : 0.062154293060302734 time for calcul the mask position with numpy : 0.02890491485595703 nb_pixel_total : 12054 time to create 1 rle with old method : 0.01350855827331543 time for calcul the mask position with numpy : 0.028748273849487305 nb_pixel_total : 77614 time to create 1 rle with old method : 0.08343958854675293 time for calcul the mask position with numpy : 0.028709888458251953 nb_pixel_total : 101990 time to create 1 rle with old method : 0.10810613632202148 time for calcul the mask position with numpy : 0.029205322265625 nb_pixel_total : 56807 time to create 1 rle with old method : 0.06106376647949219 time for calcul the mask position with numpy : 0.027976512908935547 nb_pixel_total : 116252 time to create 1 rle with old method : 0.12291717529296875 time for calcul the mask position with numpy : 0.028403282165527344 nb_pixel_total : 10714 time to create 1 rle with old method : 0.01160287857055664 time for calcul the mask position with numpy : 0.027400493621826172 nb_pixel_total : 8397 time to create 1 rle with old method : 0.009682655334472656 time for calcul the mask position with numpy : 0.027899503707885742 nb_pixel_total : 104321 time to create 1 rle with old method : 0.10815834999084473 time for calcul the mask position with numpy : 0.026828527450561523 nb_pixel_total : 47047 time to create 1 rle with old method : 0.05525326728820801 time for calcul the mask position with numpy : 0.032753705978393555 nb_pixel_total : 36733 time to create 1 rle with old method : 0.04764533042907715 time for calcul the mask position with numpy : 0.02748847007751465 nb_pixel_total : 23961 time to create 1 rle with old method : 0.026869535446166992 time for calcul the mask position with numpy : 0.027933120727539062 nb_pixel_total : 5976 time to create 1 rle with old method : 0.006988048553466797 time for calcul the mask position with numpy : 0.02790212631225586 nb_pixel_total : 19976 time to create 1 rle with old method : 0.022185564041137695 time for calcul the mask position with numpy : 0.029004335403442383 nb_pixel_total : 10093 time to create 1 rle with old method : 0.010954856872558594 time for calcul the mask position with numpy : 0.02928471565246582 nb_pixel_total : 6404 time to create 1 rle with old method : 0.0076541900634765625 time for calcul the mask position with numpy : 0.02819228172302246 nb_pixel_total : 13444 time to create 1 rle with old method : 0.014840364456176758 time for calcul the mask position with numpy : 0.028460025787353516 nb_pixel_total : 117122 time to create 1 rle with old method : 0.12242269515991211 time for calcul the mask position with numpy : 0.027849912643432617 nb_pixel_total : 5136 time to create 1 rle with old method : 0.006103992462158203 time for calcul the mask position with numpy : 0.027754783630371094 nb_pixel_total : 9213 time to create 1 rle with old method : 0.010421037673950195 time for calcul the mask position with numpy : 0.027720928192138672 nb_pixel_total : 8016 time to create 1 rle with old method : 0.00936579704284668 time for calcul the mask position with numpy : 0.0275118350982666 nb_pixel_total : 23602 time to create 1 rle with old method : 0.024953126907348633 time for calcul the mask position with numpy : 0.02732253074645996 nb_pixel_total : 91080 time to create 1 rle with old method : 0.09098029136657715 time for calcul the mask position with numpy : 0.027540206909179688 nb_pixel_total : 35877 time to create 1 rle with old method : 0.03656482696533203 time for calcul the mask position with numpy : 0.027189016342163086 nb_pixel_total : 43147 time to create 1 rle with old method : 0.0469660758972168 time for calcul the mask position with numpy : 0.028226375579833984 nb_pixel_total : 8976 time to create 1 rle with old method : 0.009888172149658203 time for calcul the mask position with numpy : 0.028881549835205078 nb_pixel_total : 323255 time to create 1 rle with new method : 0.12516117095947266 time for calcul the mask position with numpy : 0.027430295944213867 nb_pixel_total : 2615 time to create 1 rle with old method : 0.0027196407318115234 time for calcul the mask position with numpy : 0.02737116813659668 nb_pixel_total : 18667 time to create 1 rle with old method : 0.019393205642700195 time for calcul the mask position with numpy : 0.027179479598999023 nb_pixel_total : 20305 time to create 1 rle with old method : 0.020918607711791992 create new chi : 2.892134666442871 time to delete rle : 0.0031914710998535156 batch 1 Loaded 78 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.16055512428283691 nb_obj : 37 nb_hashtags : 5 time to prepare the origin masks : 7.483015775680542 time for calcul the mask position with numpy : 0.05516958236694336 nb_pixel_total : 3837183 time to create 1 rle with new method : 0.14892125129699707 time for calcul the mask position with numpy : 0.0291440486907959 nb_pixel_total : 11416 time to create 1 rle with old method : 0.01299428939819336 time for calcul the mask position with numpy : 0.0288541316986084 nb_pixel_total : 5122 time to create 1 rle with old method : 0.00586700439453125 time for calcul the mask position with numpy : 0.028894901275634766 nb_pixel_total : 9069 time to create 1 rle with old method : 0.010133743286132812 time for calcul the mask position with numpy : 0.029134035110473633 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003993511199951172 time for calcul the mask position with numpy : 0.029241561889648438 nb_pixel_total : 46795 time to create 1 rle with old method : 0.0493009090423584 time for calcul the mask position with numpy : 0.027272939682006836 nb_pixel_total : 15258 time to create 1 rle with old method : 0.016041278839111328 time for calcul the mask position with numpy : 0.03540682792663574 nb_pixel_total : 1575376 time to create 1 rle with new method : 0.12872076034545898 time for calcul the mask position with numpy : 0.027195453643798828 nb_pixel_total : 46476 time to create 1 rle with old method : 0.0494074821472168 time for calcul the mask position with numpy : 0.029062271118164062 nb_pixel_total : 61052 time to create 1 rle with old method : 0.06549620628356934 time for calcul the mask position with numpy : 0.02749490737915039 nb_pixel_total : 36301 time to create 1 rle with old method : 0.03967761993408203 time for calcul the mask position with numpy : 0.027249574661254883 nb_pixel_total : 35344 time to create 1 rle with old method : 0.03870105743408203 time for calcul the mask position with numpy : 0.027008771896362305 nb_pixel_total : 13108 time to create 1 rle with old method : 0.013173580169677734 time for calcul the mask position with numpy : 0.027579545974731445 nb_pixel_total : 97714 time to create 1 rle with old method : 0.09833693504333496 time for calcul the mask position with numpy : 0.029326677322387695 nb_pixel_total : 13764 time to create 1 rle with old method : 0.01519775390625 time for calcul the mask position with numpy : 0.027282238006591797 nb_pixel_total : 10335 time to create 1 rle with old method : 0.010307788848876953 time for calcul the mask position with numpy : 0.02609562873840332 nb_pixel_total : 22089 time to create 1 rle with old method : 0.021845102310180664 time for calcul the mask position with numpy : 0.0261538028717041 nb_pixel_total : 9847 time to create 1 rle with old method : 0.010398626327514648 time for calcul the mask position with numpy : 0.028230905532836914 nb_pixel_total : 71713 time to create 1 rle with old method : 0.07503771781921387 time for calcul the mask position with numpy : 0.028230667114257812 nb_pixel_total : 225512 time to create 1 rle with new method : 0.12106919288635254 time for calcul the mask position with numpy : 0.0278472900390625 nb_pixel_total : 21293 time to create 1 rle with old method : 0.02161431312561035 time for calcul the mask position with numpy : 0.026752471923828125 nb_pixel_total : 43530 time to create 1 rle with old method : 0.04598879814147949 time for calcul the mask position with numpy : 0.02791595458984375 nb_pixel_total : 50930 time to create 1 rle with old method : 0.054369449615478516 time for calcul the mask position with numpy : 0.027653217315673828 nb_pixel_total : 61364 time to create 1 rle with old method : 0.06460213661193848 time for calcul the mask position with numpy : 0.02840900421142578 nb_pixel_total : 27364 time to create 1 rle with old method : 0.030447959899902344 time for calcul the mask position with numpy : 0.0266265869140625 nb_pixel_total : 103329 time to create 1 rle with old method : 0.10334968566894531 time for calcul the mask position with numpy : 0.02795243263244629 nb_pixel_total : 181 time to create 1 rle with old method : 0.00036644935607910156 time for calcul the mask position with numpy : 0.02870011329650879 nb_pixel_total : 30011 time to create 1 rle with old method : 0.033873558044433594 time for calcul the mask position with numpy : 0.029117822647094727 nb_pixel_total : 4 time to create 1 rle with old method : 0.00018596649169921875 time for calcul the mask position with numpy : 0.029707908630371094 nb_pixel_total : 124673 time to create 1 rle with old method : 0.12976908683776855 time for calcul the mask position with numpy : 0.028638362884521484 nb_pixel_total : 21544 time to create 1 rle with old method : 0.023586034774780273 time for calcul the mask position with numpy : 0.029166221618652344 nb_pixel_total : 260453 time to create 1 rle with new method : 0.12298846244812012 time for calcul the mask position with numpy : 0.028338909149169922 nb_pixel_total : 19586 time to create 1 rle with old method : 0.02118206024169922 time for calcul the mask position with numpy : 0.02713775634765625 nb_pixel_total : 75907 time to create 1 rle with old method : 0.07749700546264648 time for calcul the mask position with numpy : 0.027043581008911133 nb_pixel_total : 42211 time to create 1 rle with old method : 0.04314279556274414 time for calcul the mask position with numpy : 0.02649998664855957 nb_pixel_total : 18103 time to create 1 rle with old method : 0.02208256721496582 time for calcul the mask position with numpy : 0.02914881706237793 nb_pixel_total : 6093 time to create 1 rle with old method : 0.007503986358642578 create new chi : 2.8883957862854004 time to delete rle : 0.0037136077880859375 batch 1 Loaded 74 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 413 TO DO : save crop sub photo not yet done ! save time : 0.19162297248840332 nb_obj : 36 nb_hashtags : 4 time to prepare the origin masks : 7.4400084018707275 time for calcul the mask position with numpy : 0.057842254638671875 nb_pixel_total : 4575439 time to create 1 rle with new method : 0.14121270179748535 time for calcul the mask position with numpy : 0.028840065002441406 nb_pixel_total : 7630 time to create 1 rle with old method : 0.012627363204956055 time for calcul the mask position with numpy : 0.036824703216552734 nb_pixel_total : 3945 time to create 1 rle with old method : 0.006562709808349609 time for calcul the mask position with numpy : 0.029209375381469727 nb_pixel_total : 40866 time to create 1 rle with old method : 0.04565238952636719 time for calcul the mask position with numpy : 0.0280609130859375 nb_pixel_total : 30649 time to create 1 rle with old method : 0.03292489051818848 time for calcul the mask position with numpy : 0.028290271759033203 nb_pixel_total : 54603 time to create 1 rle with old method : 0.06005072593688965 time for calcul the mask position with numpy : 0.027666807174682617 nb_pixel_total : 13372 time to create 1 rle with old method : 0.014832496643066406 time for calcul the mask position with numpy : 0.027866840362548828 nb_pixel_total : 95356 time to create 1 rle with old method : 0.09797811508178711 time for calcul the mask position with numpy : 0.028171777725219727 nb_pixel_total : 89684 time to create 1 rle with old method : 0.09447622299194336 time for calcul the mask position with numpy : 0.028326988220214844 nb_pixel_total : 74738 time to create 1 rle with old method : 0.07687139511108398 time for calcul the mask position with numpy : 0.026692867279052734 nb_pixel_total : 19448 time to create 1 rle with old method : 0.020663976669311523 time for calcul the mask position with numpy : 0.02662205696105957 nb_pixel_total : 19795 time to create 1 rle with old method : 0.02114248275756836 time for calcul the mask position with numpy : 0.027063846588134766 nb_pixel_total : 62459 time to create 1 rle with old method : 0.06599855422973633 time for calcul the mask position with numpy : 0.02747511863708496 nb_pixel_total : 12971 time to create 1 rle with old method : 0.013756513595581055 time for calcul the mask position with numpy : 0.026896238327026367 nb_pixel_total : 40208 time to create 1 rle with old method : 0.0430140495300293 time for calcul the mask position with numpy : 0.02940082550048828 nb_pixel_total : 434520 time to create 1 rle with new method : 0.12262940406799316 time for calcul the mask position with numpy : 0.027152061462402344 nb_pixel_total : 25974 time to create 1 rle with old method : 0.029803037643432617 time for calcul the mask position with numpy : 0.02757120132446289 nb_pixel_total : 106839 time to create 1 rle with old method : 0.10608291625976562 time for calcul the mask position with numpy : 0.02723836898803711 nb_pixel_total : 118 time to create 1 rle with old method : 0.00027680397033691406 time for calcul the mask position with numpy : 0.02683544158935547 nb_pixel_total : 29210 time to create 1 rle with old method : 0.030618906021118164 time for calcul the mask position with numpy : 0.02792644500732422 nb_pixel_total : 223771 time to create 1 rle with new method : 0.1193840503692627 time for calcul the mask position with numpy : 0.027547597885131836 nb_pixel_total : 15996 time to create 1 rle with old method : 0.01828908920288086 time for calcul the mask position with numpy : 0.0274050235748291 nb_pixel_total : 26772 time to create 1 rle with old method : 0.027875661849975586 time for calcul the mask position with numpy : 0.027158260345458984 nb_pixel_total : 125854 time to create 1 rle with old method : 0.12489748001098633 time for calcul the mask position with numpy : 0.027167320251464844 nb_pixel_total : 2688 time to create 1 rle with old method : 0.0031757354736328125 time for calcul the mask position with numpy : 0.027095556259155273 nb_pixel_total : 81609 time to create 1 rle with old method : 0.08160853385925293 time for calcul the mask position with numpy : 0.027705907821655273 nb_pixel_total : 26421 time to create 1 rle with old method : 0.027801990509033203 time for calcul the mask position with numpy : 0.02822709083557129 nb_pixel_total : 98784 time to create 1 rle with old method : 0.10483312606811523 time for calcul the mask position with numpy : 0.027773618698120117 nb_pixel_total : 52584 time to create 1 rle with old method : 0.0548248291015625 time for calcul the mask position with numpy : 0.026758193969726562 nb_pixel_total : 46018 time to create 1 rle with old method : 0.046552419662475586 time for calcul the mask position with numpy : 0.02813553810119629 nb_pixel_total : 57591 time to create 1 rle with old method : 0.05861234664916992 time for calcul the mask position with numpy : 0.026487112045288086 nb_pixel_total : 10078 time to create 1 rle with old method : 0.011136054992675781 time for calcul the mask position with numpy : 0.026663541793823242 nb_pixel_total : 18160 time to create 1 rle with old method : 0.0203859806060791 time for calcul the mask position with numpy : 0.028668642044067383 nb_pixel_total : 311953 time to create 1 rle with new method : 0.12048578262329102 time for calcul the mask position with numpy : 0.02798771858215332 nb_pixel_total : 185195 time to create 1 rle with new method : 0.11896443367004395 time for calcul the mask position with numpy : 0.027139663696289062 nb_pixel_total : 28942 time to create 1 rle with old method : 0.030858993530273438 create new chi : 3.134983539581299 time to delete rle : 0.003534078598022461 batch 1 Loaded 72 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 76 TO DO : save crop sub photo not yet done ! save time : 0.9144473075866699 nb_obj : 26 nb_hashtags : 5 time to prepare the origin masks : 7.235746383666992 time for calcul the mask position with numpy : 0.06347060203552246 nb_pixel_total : 5441456 time to create 1 rle with new method : 0.13219928741455078 time for calcul the mask position with numpy : 0.026917457580566406 nb_pixel_total : 3755 time to create 1 rle with old method : 0.004067897796630859 time for calcul the mask position with numpy : 0.02674579620361328 nb_pixel_total : 55296 time to create 1 rle with old method : 0.055429935455322266 time for calcul the mask position with numpy : 0.027950525283813477 nb_pixel_total : 26137 time to create 1 rle with old method : 0.027370929718017578 time for calcul the mask position with numpy : 0.027208328247070312 nb_pixel_total : 8755 time to create 1 rle with old method : 0.008721590042114258 time for calcul the mask position with numpy : 0.02660083770751953 nb_pixel_total : 18862 time to create 1 rle with old method : 0.01945638656616211 time for calcul the mask position with numpy : 0.026753902435302734 nb_pixel_total : 80289 time to create 1 rle with old method : 0.07892012596130371 time for calcul the mask position with numpy : 0.02888178825378418 nb_pixel_total : 479060 time to create 1 rle with new method : 0.12037396430969238 time for calcul the mask position with numpy : 0.026964426040649414 nb_pixel_total : 7274 time to create 1 rle with old method : 0.007846355438232422 time for calcul the mask position with numpy : 0.026746034622192383 nb_pixel_total : 10612 time to create 1 rle with old method : 0.011098384857177734 time for calcul the mask position with numpy : 0.026834726333618164 nb_pixel_total : 29265 time to create 1 rle with old method : 0.030328989028930664 time for calcul the mask position with numpy : 0.026715517044067383 nb_pixel_total : 14507 time to create 1 rle with old method : 0.0153045654296875 time for calcul the mask position with numpy : 0.028285980224609375 nb_pixel_total : 105151 time to create 1 rle with old method : 0.10748052597045898 time for calcul the mask position with numpy : 0.027769804000854492 nb_pixel_total : 38496 time to create 1 rle with old method : 0.039257049560546875 time for calcul the mask position with numpy : 0.028702974319458008 nb_pixel_total : 207915 time to create 1 rle with new method : 0.1184382438659668 time for calcul the mask position with numpy : 0.027059316635131836 nb_pixel_total : 18853 time to create 1 rle with old method : 0.020247220993041992 time for calcul the mask position with numpy : 0.027101516723632812 nb_pixel_total : 23634 time to create 1 rle with old method : 0.02454400062561035 time for calcul the mask position with numpy : 0.026944875717163086 nb_pixel_total : 36083 time to create 1 rle with old method : 0.03616786003112793 time for calcul the mask position with numpy : 0.026825428009033203 nb_pixel_total : 1049 time to create 1 rle with old method : 0.0013399124145507812 time for calcul the mask position with numpy : 0.026396512985229492 nb_pixel_total : 13189 time to create 1 rle with old method : 0.014875173568725586 time for calcul the mask position with numpy : 0.02760171890258789 nb_pixel_total : 14474 time to create 1 rle with old method : 0.01586294174194336 time for calcul the mask position with numpy : 0.02727651596069336 nb_pixel_total : 20321 time to create 1 rle with old method : 0.020000934600830078 time for calcul the mask position with numpy : 0.026630163192749023 nb_pixel_total : 49839 time to create 1 rle with old method : 0.051076412200927734 time for calcul the mask position with numpy : 0.02889251708984375 nb_pixel_total : 289072 time to create 1 rle with new method : 0.1203773021697998 time for calcul the mask position with numpy : 0.02742147445678711 nb_pixel_total : 9003 time to create 1 rle with old method : 0.00992584228515625 time for calcul the mask position with numpy : 0.027588367462158203 nb_pixel_total : 47893 time to create 1 rle with old method : 0.05066680908203125 create new chi : 1.9649720191955566 time to delete rle : 0.002276182174682617 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.12531709671020508 nb_obj : 33 nb_hashtags : 5 time to prepare the origin masks : 7.304813385009766 time for calcul the mask position with numpy : 0.062441110610961914 nb_pixel_total : 4879289 time to create 1 rle with new method : 0.13950419425964355 time for calcul the mask position with numpy : 0.028039216995239258 nb_pixel_total : 12906 time to create 1 rle with old method : 0.014220952987670898 time for calcul the mask position with numpy : 0.02919483184814453 nb_pixel_total : 38809 time to create 1 rle with old method : 0.04352831840515137 time for calcul the mask position with numpy : 0.029014110565185547 nb_pixel_total : 85860 time to create 1 rle with old method : 0.0900886058807373 time for calcul the mask position with numpy : 0.027904272079467773 nb_pixel_total : 23263 time to create 1 rle with old method : 0.025687456130981445 time for calcul the mask position with numpy : 0.026836872100830078 nb_pixel_total : 8785 time to create 1 rle with old method : 0.009934425354003906 time for calcul the mask position with numpy : 0.02942967414855957 nb_pixel_total : 101229 time to create 1 rle with old method : 0.1110682487487793 time for calcul the mask position with numpy : 0.028940439224243164 nb_pixel_total : 9818 time to create 1 rle with old method : 0.011338233947753906 time for calcul the mask position with numpy : 0.029800891876220703 nb_pixel_total : 158576 time to create 1 rle with new method : 0.12673544883728027 time for calcul the mask position with numpy : 0.029230117797851562 nb_pixel_total : 5276 time to create 1 rle with old method : 0.006052494049072266 time for calcul the mask position with numpy : 0.029801368713378906 nb_pixel_total : 64002 time to create 1 rle with old method : 0.07017111778259277 time for calcul the mask position with numpy : 0.031048059463500977 nb_pixel_total : 252313 time to create 1 rle with new method : 0.1214148998260498 time for calcul the mask position with numpy : 0.026818037033081055 nb_pixel_total : 14905 time to create 1 rle with old method : 0.015548229217529297 time for calcul the mask position with numpy : 0.028751850128173828 nb_pixel_total : 140963 time to create 1 rle with old method : 0.14462065696716309 time for calcul the mask position with numpy : 0.02818775177001953 nb_pixel_total : 19112 time to create 1 rle with old method : 0.0209348201751709 time for calcul the mask position with numpy : 0.027512550354003906 nb_pixel_total : 5114 time to create 1 rle with old method : 0.005688667297363281 time for calcul the mask position with numpy : 0.026984214782714844 nb_pixel_total : 47386 time to create 1 rle with old method : 0.04943704605102539 time for calcul the mask position with numpy : 0.029271364212036133 nb_pixel_total : 167967 time to create 1 rle with new method : 0.11896395683288574 time for calcul the mask position with numpy : 0.029479265213012695 nb_pixel_total : 267514 time to create 1 rle with new method : 0.1199488639831543 time for calcul the mask position with numpy : 0.027106046676635742 nb_pixel_total : 489 time to create 1 rle with old method : 0.0009589195251464844 time for calcul the mask position with numpy : 0.026972293853759766 nb_pixel_total : 34015 time to create 1 rle with old method : 0.03615117073059082 time for calcul the mask position with numpy : 0.02750682830810547 nb_pixel_total : 56071 time to create 1 rle with old method : 0.05979752540588379 time for calcul the mask position with numpy : 0.026963233947753906 nb_pixel_total : 82669 time to create 1 rle with old method : 0.08894467353820801 time for calcul the mask position with numpy : 0.028000593185424805 nb_pixel_total : 13795 time to create 1 rle with old method : 0.014980077743530273 time for calcul the mask position with numpy : 0.027157068252563477 nb_pixel_total : 930 time to create 1 rle with old method : 0.001230001449584961 time for calcul the mask position with numpy : 0.027773141860961914 nb_pixel_total : 62265 time to create 1 rle with old method : 0.06487751007080078 time for calcul the mask position with numpy : 0.02701568603515625 nb_pixel_total : 2094 time to create 1 rle with old method : 0.002824068069458008 time for calcul the mask position with numpy : 0.028368711471557617 nb_pixel_total : 89760 time to create 1 rle with old method : 0.09726572036743164 time for calcul the mask position with numpy : 0.028008222579956055 nb_pixel_total : 80 time to create 1 rle with old method : 0.0005350112915039062 time for calcul the mask position with numpy : 0.028209924697875977 nb_pixel_total : 194 time to create 1 rle with old method : 0.0006706714630126953 time for calcul the mask position with numpy : 0.029740095138549805 nb_pixel_total : 327658 time to create 1 rle with new method : 0.12152433395385742 time for calcul the mask position with numpy : 0.026706218719482422 nb_pixel_total : 373 time to create 1 rle with old method : 0.0008952617645263672 time for calcul the mask position with numpy : 0.027887582778930664 nb_pixel_total : 76760 time to create 1 rle with old method : 0.08238673210144043 create new chi : 2.8884873390197754 time to delete rle : 0.0036668777465820312 batch 1 Loaded 70 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 2826 TO DO : save crop sub photo not yet done ! save time : 0.3358466625213623 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 0.4707307815551758 time for calcul the mask position with numpy : 0.023181438446044922 nb_pixel_total : 439624 time to create 1 rle with new method : 0.12720680236816406 time for calcul the mask position with numpy : 0.019989728927612305 nb_pixel_total : 28528 time to create 1 rle with old method : 0.03006911277770996 time for calcul the mask position with numpy : 0.020278215408325195 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006563663482666016 time for calcul the mask position with numpy : 0.020015716552734375 nb_pixel_total : 42064 time to create 1 rle with old method : 0.04530501365661621 time for calcul the mask position with numpy : 0.020642518997192383 nb_pixel_total : 93663 time to create 1 rle with old method : 0.09964609146118164 time for calcul the mask position with numpy : 0.02069687843322754 nb_pixel_total : 118475 time to create 1 rle with old method : 0.12388873100280762 time for calcul the mask position with numpy : 0.07134199142456055 nb_pixel_total : 6327459 time to create 1 rle with new method : 0.1315915584564209 create new chi : 0.8037223815917969 time to delete rle : 0.0008299350738525391 batch 1 Loaded 14 chid ids of type : 3594 +++++++Number RLEs to save : 632 TO DO : save crop sub photo not yet done ! save time : 0.16788578033447266 map_output_result : {1334118873: (0.0, 'Should be the crop_list due to order', 0.0), 1334118774: (0.0, 'Should be the crop_list due to order', 0.0), 1334118130: (0.0, 'Should be the crop_list due to order', 0.0), 1334118129: (0.0, 'Should be the crop_list due to order', 0.0), 1334118127: (0.0, 'Should be the crop_list due to order', 0.0), 1334118124: (0.0, 'Should be the crop_list due to order', 0.0), 1334118120: (0.0, 'Should be the crop_list due to order', 0.0), 1334115608: (0.0, 'Should be the crop_list due to order', 0.0), 1334115605: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1334118873, 1334118774, 1334118130, 1334118129, 1334118127, 1334118124, 1334118120, 1334115608, 1334115605] Looping around the photos to save general results len do output : 9 /1334118873.Didn't retrieve data . /1334118774.Didn't retrieve data . /1334118130.Didn't retrieve data . /1334118129.Didn't retrieve data . /1334118127.Didn't retrieve data . /1334118124.Didn't retrieve data . /1334118120.Didn't retrieve data . /1334115608.Didn't retrieve data . /1334115605.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118873', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118774', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118130', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118129', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118127', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118124', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118120', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115608', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115605', None, None, None, None, None, '2542525') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013669490814208984 save_final save missing photos in datou_result : time spend for datou_step_exec : 83.75359916687012 time spend to save output : 0.014168262481689453 total time spend for step 3 : 83.7677674293518 step4:ventilate_hashtags_in_portfolio Mon Feb 3 22:47:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20193381 get user id for portfolio 20193381 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20193381 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','carton','flou','pehd','papier','metal','mal_croppe','pet_fonce','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20193381 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','carton','flou','pehd','papier','metal','mal_croppe','pet_fonce','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20193381 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','carton','flou','pehd','papier','metal','mal_croppe','pet_fonce','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20193709,20193710,20193711,20193712,20193713,20193714,20193715,20193716,20193717,20193718,20193719?tags=autre,background,carton,flou,pehd,papier,metal,mal_croppe,pet_fonce,pet_clair,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1334118873, 1334118774, 1334118130, 1334118129, 1334118127, 1334118124, 1334118120, 1334115608, 1334115605] Looping around the photos to save general results len do output : 1 /20193381. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118873', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118774', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118130', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118129', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118127', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118124', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118120', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115608', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115605', None, None, None, None, None, '2542525') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014816522598266602 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.718742847442627 time spend to save output : 0.01506352424621582 total time spend for step 4 : 1.7338063716888428 step5:final Mon Feb 3 22:47:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1334118873: ('0.23880805633724686',), 1334118774: ('0.23880805633724686',), 1334118130: ('0.23880805633724686',), 1334118129: ('0.23880805633724686',), 1334118127: ('0.23880805633724686',), 1334118124: ('0.23880805633724686',), 1334118120: ('0.23880805633724686',), 1334115608: ('0.23880805633724686',), 1334115605: ('0.23880805633724686',)} new output for save of step final : {1334118873: ('0.23880805633724686',), 1334118774: ('0.23880805633724686',), 1334118130: ('0.23880805633724686',), 1334118129: ('0.23880805633724686',), 1334118127: ('0.23880805633724686',), 1334118124: ('0.23880805633724686',), 1334118120: ('0.23880805633724686',), 1334115608: ('0.23880805633724686',), 1334115605: ('0.23880805633724686',)} [1334118873, 1334118774, 1334118130, 1334118129, 1334118127, 1334118124, 1334118120, 1334115608, 1334115605] Looping around the photos to save general results len do output : 9 /1334118873.Didn't retrieve data . /1334118774.Didn't retrieve data . /1334118130.Didn't retrieve data . /1334118129.Didn't retrieve data . /1334118127.Didn't retrieve data . /1334118124.Didn't retrieve data . /1334118120.Didn't retrieve data . /1334115608.Didn't retrieve data . /1334115605.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118873', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118774', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118130', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118129', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118127', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118124', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118120', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115608', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115605', None, None, None, None, None, '2542525') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.012897491455078125 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10302591323852539 time spend to save output : 0.01335453987121582 total time spend for step 5 : 0.11638045310974121 step6:blur_detection Mon Feb 3 22:47:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 9 time used for this insertion : 0.009676218032836914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 9 time used for this insertion : 0.6537179946899414 save missing photos in datou_result : time spend for datou_step_exec : 0.02206707000732422 time spend to save output : 0.6683037281036377 total time spend for step 6 : 0.6903707981109619 step7:brightness Mon Feb 3 22:47:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 9 time used for this insertion : 0.01084589958190918 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 9 time used for this insertion : 0.00896906852722168 save missing photos in datou_result : time spend for datou_step_exec : 0.026125669479370117 time spend to save output : 0.024587631225585938 total time spend for step 7 : 0.050713300704956055 step8:velours_tree Mon Feb 3 22:47:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1410353183746338 time spend to save output : 3.0994415283203125e-05 total time spend for step 8 : 0.141066312789917 step9:send_mail_cod Mon Feb 3 22:47:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20193381_03-02-2025_22_47_37.pdf 20193709 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201937091738619257 20193710 imagette201937101738619258 20193711 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201937111738619258 20193712 imagette201937121738619259 20193713 imagette201937131738619259 20193714 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201937141738619259 20193715 imagette201937151738619261 20193716 imagette201937161738619261 20193717 change filename to text .change filename to text .change filename to text .change filename to text .imagette201937171738619261 20193718 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201937181738619261 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20193381 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20193709,20193710,20193711,20193712,20193713,20193714,20193715,20193716,20193717,20193718,20193719?tags=autre,background,carton,flou,pehd,papier,metal,mal_croppe,pet_fonce,pet_clair,environnement args[1334118873] : ((1334118873, -4.090823722695209, 492609224), (1334118873, 0.5099116703506491, 2107752395), '0.23880805633724686') We are sending mail with results at report@fotonower.com args[1334118774] : ((1334118774, -3.299246303850588, 492609224), (1334118774, -0.13558320934407433, 496442774), '0.23880805633724686') We are sending mail with results at report@fotonower.com args[1334118130] : ((1334118130, -6.306350582369899, 492609224), (1334118130, -0.16806438975932325, 496442774), '0.23880805633724686') We are sending mail with results at report@fotonower.com args[1334118129] : ((1334118129, -5.718270298704007, 492609224), (1334118129, -0.05541179823829048, 2107752395), '0.23880805633724686') We are sending mail with results at report@fotonower.com args[1334118127] : ((1334118127, -4.758254022801334, 492609224), (1334118127, 0.023641673202704674, 2107752395), '0.23880805633724686') We are sending mail with results at report@fotonower.com args[1334118124] : ((1334118124, -2.698819369015829, 492609224), (1334118124, -0.14682594005170682, 496442774), '0.23880805633724686') We are sending mail with results at report@fotonower.com args[1334118120] : ((1334118120, -3.7823534067881814, 492609224), (1334118120, -0.30907220918082495, 496442774), '0.23880805633724686') We are sending mail with results at report@fotonower.com args[1334115608] : ((1334115608, -4.594169718252035, 492609224), (1334115608, -0.24846400877256805, 496442774), '0.23880805633724686') We are sending mail with results at report@fotonower.com args[1334115605] : ((1334115605, -1.0394626064639565, 492688767), (1334115605, -0.15949268797342106, 496442774), '0.23880805633724686') We are sending mail with results at report@fotonower.com refus_total : 0.23880805633724686 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20193381 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1334118130,1334115608,1334118127,1334115605,1334118120,1334118124,1334118129,1334118774,1334118873) Found this number of photos: 9 begin to download photo : 1334118130 begin to download photo : 1334118127 begin to download photo : 1334118120 begin to download photo : 1334118129 begin to download photo : 1334118873 download finish for photo 1334118873 download finish for photo 1334118129 begin to download photo : 1334118774 download finish for photo 1334118130 begin to download photo : 1334115608 download finish for photo 1334118127 begin to download photo : 1334115605 download finish for photo 1334118120 begin to download photo : 1334118124 download finish for photo 1334115605 download finish for photo 1334115608 download finish for photo 1334118774 download finish for photo 1334118124 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20193381_03-02-2025_22_47_37.pdf results_Auto_P20193381_03-02-2025_22_47_37.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20193381_03-02-2025_22_47_37.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20193381','results_Auto_P20193381_03-02-2025_22_47_37.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20193381_03-02-2025_22_47_37.pdf','pdf','','0.58','0.23880805633724686') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20193381

https://www.fotonower.com/image?json=false&list_photos_id=1334118873
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334118774
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334118130
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334118129
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334118127
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334118124
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334118120
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334115608
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334115605
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 23.88%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/20193709?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20193711?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/20193714?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20193717?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20193718?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20193381_03-02-2025_22_47_37.pdf.

Lien vers velours :https://www.fotonower.com/velours/20193709,20193710,20193711,20193712,20193713,20193714,20193715,20193716,20193717,20193718,20193719?tags=autre,background,carton,flou,pehd,papier,metal,mal_croppe,pet_fonce,pet_clair,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 03 Feb 2025 21:47:45 GMT Content-Length: 0 Connection: close X-Message-Id: B_bf54_ER3GBhKT47aXf_A Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1334118873, 1334118774, 1334118130, 1334118129, 1334118127, 1334118124, 1334118120, 1334115608, 1334115605] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118873', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118774', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118130', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118129', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118127', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118124', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118120', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115608', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115605', None, None, None, None, None, '2542525') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01357412338256836 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.661459445953369 time spend to save output : 0.013823509216308594 total time spend for step 9 : 7.675282955169678 step10:split_time_score Mon Feb 3 22:47:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03022025 20193381 Nombre de photos uploadées : 9 / 23040 (0%) 03022025 20193381 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 03022025 20193381 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.00048542022705078125 elapsed_time : insert_dashboard_record_day_entry 0.02297234535217285 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.23880805633724686 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20193381_03-02-2025_22_47_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20193381 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20193381 AND mptpi.`type`=3594 To do Qualite : 0.220957984151152 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20187110_03-02-2025_18_29_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187110 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187110 AND mptpi.`type`=3594 To do Qualite : 0.21167360646910285 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20187111_03-02-2025_19_28_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187111 AND mptpi.`type`=3594 To do Qualite : 0.20702335610615327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20187118_03-02-2025_21_49_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187118 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187118 AND mptpi.`type`=3594 To do Qualite : 0.2109523753801288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20193383_03-02-2025_22_40_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20193383 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20193383 AND mptpi.`type`=3594 To do Qualite : 0.096394624967941 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20193384_03-02-2025_22_38_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20193384 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20193384 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03022025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1334118873, 1334118774, 1334118130, 1334118129, 1334118127, 1334118124, 1334118120, 1334115608, 1334115605] Looping around the photos to save general results len do output : 1 /20193381Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118873', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118774', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118130', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118129', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118127', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118124', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334118120', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115608', None, None, None, None, None, '2542525') ('3318', None, None, None, None, None, None, None, '2542525') ('3318', '20193381', '1334115605', None, None, None, None, None, '2542525') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.015911579132080078 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5403938293457031 time spend to save output : 0.016108274459838867 total time spend for step 10 : 0.556502103805542 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 266.21user 53.82system 7:21.55elapsed 72%CPU (0avgtext+0avgdata 6945972maxresident)k 555328inputs+310848outputs (593major+17947720minor)pagefaults 0swaps