python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3831438 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2953415'] with mtr_portfolio_ids : ['23334483'] and first list_photo_ids : [] new path : /proc/3831438/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.8597187995910645 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 13:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 13:40:33.287348: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 13:40:33.315141: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 13:40:33.317392: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f10bc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 13:40:33.317451: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 13:40:33.321625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 13:40:33.622482: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1decfff0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 13:40:33.622553: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 13:40:33.624206: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 13:40:33.624666: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 13:40:33.628476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 13:40:33.631716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 13:40:33.632277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 13:40:33.635993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 13:40:33.637062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 13:40:33.641809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 13:40:33.643373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 13:40:33.643458: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 13:40:33.644290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 13:40:33.644307: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 13:40:33.644317: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 13:40:33.645709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-26 13:40:33.948624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 13:40:33.948766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 13:40:33.948786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 13:40:33.948804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 13:40:33.948820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 13:40:33.948836: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 13:40:33.948851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 13:40:33.948867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 13:40:33.950098: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 13:40:33.951259: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 13:40:33.951294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 13:40:33.951309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 13:40:33.951323: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 13:40:33.951337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 13:40:33.951351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 13:40:33.951364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 13:40:33.951378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 13:40:33.952647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 13:40:33.952683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 13:40:33.952692: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 13:40:33.952700: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 13:40:33.954026: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-26 13:40:43.513892: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 13:40:43.760330: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 3832417 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002781391143798828 nb_pixel_total : 90406 time to create 1 rle with old method : 0.11838126182556152 length of segment : 412 time for calcul the mask position with numpy : 0.0004444122314453125 nb_pixel_total : 31079 time to create 1 rle with old method : 0.035520076751708984 length of segment : 197 time for calcul the mask position with numpy : 0.0013740062713623047 nb_pixel_total : 79071 time to create 1 rle with old method : 0.09187984466552734 length of segment : 268 time for calcul the mask position with numpy : 0.0009458065032958984 nb_pixel_total : 70381 time to create 1 rle with old method : 0.07999706268310547 length of segment : 361 time for calcul the mask position with numpy : 0.00018334388732910156 nb_pixel_total : 7335 time to create 1 rle with old method : 0.008611440658569336 length of segment : 88 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 4688 time to create 1 rle with old method : 0.005881786346435547 length of segment : 47 time for calcul the mask position with numpy : 0.0004489421844482422 nb_pixel_total : 21431 time to create 1 rle with old method : 0.02471470832824707 length of segment : 299 time for calcul the mask position with numpy : 0.0014486312866210938 nb_pixel_total : 69086 time to create 1 rle with old method : 0.08042359352111816 length of segment : 358 time for calcul the mask position with numpy : 0.0012183189392089844 nb_pixel_total : 70625 time to create 1 rle with old method : 0.08099842071533203 length of segment : 316 time for calcul the mask position with numpy : 0.001977205276489258 nb_pixel_total : 74328 time to create 1 rle with old method : 0.1001732349395752 length of segment : 225 time for calcul the mask position with numpy : 0.0026481151580810547 nb_pixel_total : 87361 time to create 1 rle with old method : 0.10382962226867676 length of segment : 530 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 27594 time to create 1 rle with old method : 0.03517794609069824 length of segment : 192 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 24345 time to create 1 rle with old method : 0.02966451644897461 length of segment : 159 time for calcul the mask position with numpy : 0.0010111331939697266 nb_pixel_total : 70851 time to create 1 rle with old method : 0.08304357528686523 length of segment : 290 time for calcul the mask position with numpy : 0.00045943260192871094 nb_pixel_total : 28690 time to create 1 rle with old method : 0.0333402156829834 length of segment : 296 time for calcul the mask position with numpy : 0.0023996829986572266 nb_pixel_total : 143575 time to create 1 rle with old method : 0.17093968391418457 length of segment : 683 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 21378 time to create 1 rle with old method : 0.027855634689331055 length of segment : 128 time for calcul the mask position with numpy : 0.00046944618225097656 nb_pixel_total : 32749 time to create 1 rle with old method : 0.038933515548706055 length of segment : 100 time for calcul the mask position with numpy : 0.0008788108825683594 nb_pixel_total : 30592 time to create 1 rle with old method : 0.03522539138793945 length of segment : 209 time for calcul the mask position with numpy : 0.0008978843688964844 nb_pixel_total : 55239 time to create 1 rle with old method : 0.06340432167053223 length of segment : 325 time for calcul the mask position with numpy : 0.000377655029296875 nb_pixel_total : 20945 time to create 1 rle with old method : 0.02374124526977539 length of segment : 232 time for calcul the mask position with numpy : 0.001750946044921875 nb_pixel_total : 55807 time to create 1 rle with old method : 0.06493782997131348 length of segment : 226 time for calcul the mask position with numpy : 0.001603841781616211 nb_pixel_total : 53340 time to create 1 rle with old method : 0.06313490867614746 length of segment : 215 time for calcul the mask position with numpy : 0.002402782440185547 nb_pixel_total : 79032 time to create 1 rle with old method : 0.09165287017822266 length of segment : 386 time for calcul the mask position with numpy : 0.0012278556823730469 nb_pixel_total : 45267 time to create 1 rle with old method : 0.0693976879119873 length of segment : 274 time for calcul the mask position with numpy : 0.0006437301635742188 nb_pixel_total : 16548 time to create 1 rle with old method : 0.019237041473388672 length of segment : 182 time for calcul the mask position with numpy : 0.0004711151123046875 nb_pixel_total : 14517 time to create 1 rle with old method : 0.017073869705200195 length of segment : 134 time for calcul the mask position with numpy : 0.0008950233459472656 nb_pixel_total : 23967 time to create 1 rle with old method : 0.028522729873657227 length of segment : 215 time for calcul the mask position with numpy : 0.0008962154388427734 nb_pixel_total : 18717 time to create 1 rle with old method : 0.021480798721313477 length of segment : 268 time for calcul the mask position with numpy : 0.001039743423461914 nb_pixel_total : 29590 time to create 1 rle with old method : 0.03366208076477051 length of segment : 254 time for calcul the mask position with numpy : 0.007226467132568359 nb_pixel_total : 206905 time to create 1 rle with new method : 0.01554727554321289 length of segment : 704 time for calcul the mask position with numpy : 0.0011162757873535156 nb_pixel_total : 45486 time to create 1 rle with old method : 0.052240848541259766 length of segment : 230 time for calcul the mask position with numpy : 0.003544330596923828 nb_pixel_total : 159351 time to create 1 rle with new method : 0.00667119026184082 length of segment : 601 time for calcul the mask position with numpy : 0.0024051666259765625 nb_pixel_total : 89830 time to create 1 rle with old method : 0.12481474876403809 length of segment : 280 time for calcul the mask position with numpy : 0.0021209716796875 nb_pixel_total : 51302 time to create 1 rle with old method : 0.058882713317871094 length of segment : 431 time for calcul the mask position with numpy : 0.0012798309326171875 nb_pixel_total : 44957 time to create 1 rle with old method : 0.06169533729553223 length of segment : 215 time for calcul the mask position with numpy : 0.006577968597412109 nb_pixel_total : 156621 time to create 1 rle with new method : 0.01869034767150879 length of segment : 1162 time for calcul the mask position with numpy : 0.0012118816375732422 nb_pixel_total : 42170 time to create 1 rle with old method : 0.04739212989807129 length of segment : 249 time for calcul the mask position with numpy : 0.0009179115295410156 nb_pixel_total : 21957 time to create 1 rle with old method : 0.026081562042236328 length of segment : 193 time for calcul the mask position with numpy : 0.0008842945098876953 nb_pixel_total : 16014 time to create 1 rle with old method : 0.026267290115356445 length of segment : 179 time for calcul the mask position with numpy : 0.0016307830810546875 nb_pixel_total : 36603 time to create 1 rle with old method : 0.04707598686218262 length of segment : 245 time for calcul the mask position with numpy : 0.0006346702575683594 nb_pixel_total : 20523 time to create 1 rle with old method : 0.026731491088867188 length of segment : 161 time for calcul the mask position with numpy : 0.0018727779388427734 nb_pixel_total : 69152 time to create 1 rle with old method : 0.07998418807983398 length of segment : 204 time for calcul the mask position with numpy : 0.0007157325744628906 nb_pixel_total : 23907 time to create 1 rle with old method : 0.02809619903564453 length of segment : 119 time for calcul the mask position with numpy : 0.0005044937133789062 nb_pixel_total : 13158 time to create 1 rle with old method : 0.015513181686401367 length of segment : 139 time for calcul the mask position with numpy : 0.006120204925537109 nb_pixel_total : 178997 time to create 1 rle with new method : 0.013241052627563477 length of segment : 554 time for calcul the mask position with numpy : 0.002735614776611328 nb_pixel_total : 82549 time to create 1 rle with old method : 0.09379768371582031 length of segment : 395 time for calcul the mask position with numpy : 0.0006580352783203125 nb_pixel_total : 15137 time to create 1 rle with old method : 0.02357792854309082 length of segment : 166 time for calcul the mask position with numpy : 0.0005168914794921875 nb_pixel_total : 9150 time to create 1 rle with old method : 0.012125492095947266 length of segment : 98 time for calcul the mask position with numpy : 0.001535177230834961 nb_pixel_total : 44114 time to create 1 rle with old method : 0.06266283988952637 length of segment : 281 time for calcul the mask position with numpy : 0.004113912582397461 nb_pixel_total : 177040 time to create 1 rle with new method : 0.00996541976928711 length of segment : 473 time for calcul the mask position with numpy : 0.0014300346374511719 nb_pixel_total : 32161 time to create 1 rle with old method : 0.036934614181518555 length of segment : 204 time for calcul the mask position with numpy : 0.00205230712890625 nb_pixel_total : 62643 time to create 1 rle with old method : 0.0715932846069336 length of segment : 256 time for calcul the mask position with numpy : 0.0007860660552978516 nb_pixel_total : 30531 time to create 1 rle with old method : 0.03497719764709473 length of segment : 206 time for calcul the mask position with numpy : 0.0038537979125976562 nb_pixel_total : 146437 time to create 1 rle with old method : 0.16426682472229004 length of segment : 435 time for calcul the mask position with numpy : 0.0009276866912841797 nb_pixel_total : 31052 time to create 1 rle with old method : 0.03560352325439453 length of segment : 197 time for calcul the mask position with numpy : 0.0006420612335205078 nb_pixel_total : 20821 time to create 1 rle with old method : 0.024207592010498047 length of segment : 145 time for calcul the mask position with numpy : 0.0007681846618652344 nb_pixel_total : 18393 time to create 1 rle with old method : 0.02213144302368164 length of segment : 155 time for calcul the mask position with numpy : 0.006544828414916992 nb_pixel_total : 235420 time to create 1 rle with new method : 0.0162813663482666 length of segment : 568 time for calcul the mask position with numpy : 0.006188154220581055 nb_pixel_total : 245965 time to create 1 rle with new method : 0.01712489128112793 length of segment : 932 time for calcul the mask position with numpy : 0.000827789306640625 nb_pixel_total : 17874 time to create 1 rle with old method : 0.02053666114807129 length of segment : 138 time for calcul the mask position with numpy : 0.0011527538299560547 nb_pixel_total : 24928 time to create 1 rle with old method : 0.02846360206604004 length of segment : 402 time for calcul the mask position with numpy : 0.0004699230194091797 nb_pixel_total : 8869 time to create 1 rle with old method : 0.010617733001708984 length of segment : 164 time for calcul the mask position with numpy : 0.0005326271057128906 nb_pixel_total : 11834 time to create 1 rle with old method : 0.014213085174560547 length of segment : 179 time for calcul the mask position with numpy : 0.00027823448181152344 nb_pixel_total : 6277 time to create 1 rle with old method : 0.0073697566986083984 length of segment : 74 time for calcul the mask position with numpy : 0.007401704788208008 nb_pixel_total : 241341 time to create 1 rle with new method : 0.0171663761138916 length of segment : 553 time for calcul the mask position with numpy : 0.0014696121215820312 nb_pixel_total : 47274 time to create 1 rle with old method : 0.054448843002319336 length of segment : 157 time for calcul the mask position with numpy : 0.0014674663543701172 nb_pixel_total : 48564 time to create 1 rle with old method : 0.07521700859069824 length of segment : 344 time for calcul the mask position with numpy : 0.005578517913818359 nb_pixel_total : 238816 time to create 1 rle with new method : 0.012610197067260742 length of segment : 391 time for calcul the mask position with numpy : 0.0015301704406738281 nb_pixel_total : 56817 time to create 1 rle with old method : 0.06485819816589355 length of segment : 239 time for calcul the mask position with numpy : 0.0028810501098632812 nb_pixel_total : 80077 time to create 1 rle with old method : 0.0912938117980957 length of segment : 437 time for calcul the mask position with numpy : 0.0015475749969482422 nb_pixel_total : 33623 time to create 1 rle with old method : 0.039365530014038086 length of segment : 321 time for calcul the mask position with numpy : 0.001621246337890625 nb_pixel_total : 74830 time to create 1 rle with old method : 0.08497905731201172 length of segment : 430 time for calcul the mask position with numpy : 0.0011920928955078125 nb_pixel_total : 22237 time to create 1 rle with old method : 0.025614500045776367 length of segment : 257 time for calcul the mask position with numpy : 0.005841255187988281 nb_pixel_total : 219797 time to create 1 rle with new method : 0.011611700057983398 length of segment : 589 time for calcul the mask position with numpy : 0.0015058517456054688 nb_pixel_total : 45031 time to create 1 rle with old method : 0.051108598709106445 length of segment : 283 time for calcul the mask position with numpy : 0.0037908554077148438 nb_pixel_total : 145582 time to create 1 rle with old method : 0.16693973541259766 length of segment : 457 time for calcul the mask position with numpy : 0.005219221115112305 nb_pixel_total : 150161 time to create 1 rle with new method : 0.014222383499145508 length of segment : 678 time for calcul the mask position with numpy : 0.00043320655822753906 nb_pixel_total : 10297 time to create 1 rle with old method : 0.012573719024658203 length of segment : 112 time for calcul the mask position with numpy : 0.0036368370056152344 nb_pixel_total : 118991 time to create 1 rle with old method : 0.17553353309631348 length of segment : 391 time for calcul the mask position with numpy : 0.001013040542602539 nb_pixel_total : 30229 time to create 1 rle with old method : 0.04206562042236328 length of segment : 181 time for calcul the mask position with numpy : 0.0014262199401855469 nb_pixel_total : 41195 time to create 1 rle with old method : 0.053900957107543945 length of segment : 284 time for calcul the mask position with numpy : 0.0020139217376708984 nb_pixel_total : 61023 time to create 1 rle with old method : 0.06978106498718262 length of segment : 349 time for calcul the mask position with numpy : 0.0011906623840332031 nb_pixel_total : 50230 time to create 1 rle with old method : 0.057820796966552734 length of segment : 227 time for calcul the mask position with numpy : 0.0009980201721191406 nb_pixel_total : 41918 time to create 1 rle with old method : 0.04783272743225098 length of segment : 356 time for calcul the mask position with numpy : 0.0007839202880859375 nb_pixel_total : 26455 time to create 1 rle with old method : 0.030774593353271484 length of segment : 217 time for calcul the mask position with numpy : 0.000637054443359375 nb_pixel_total : 18040 time to create 1 rle with old method : 0.021120786666870117 length of segment : 205 time for calcul the mask position with numpy : 0.002073049545288086 nb_pixel_total : 72559 time to create 1 rle with old method : 0.08226323127746582 length of segment : 509 time for calcul the mask position with numpy : 0.0016558170318603516 nb_pixel_total : 56931 time to create 1 rle with old method : 0.06519246101379395 length of segment : 333 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 22434 time to create 1 rle with old method : 0.036780595779418945 length of segment : 220 time for calcul the mask position with numpy : 0.001102447509765625 nb_pixel_total : 28498 time to create 1 rle with old method : 0.034574270248413086 length of segment : 202 time for calcul the mask position with numpy : 0.0007104873657226562 nb_pixel_total : 11767 time to create 1 rle with old method : 0.013753652572631836 length of segment : 169 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 14938 time to create 1 rle with old method : 0.01816415786743164 length of segment : 90 time for calcul the mask position with numpy : 0.002386808395385742 nb_pixel_total : 91336 time to create 1 rle with old method : 0.10355973243713379 length of segment : 340 time for calcul the mask position with numpy : 0.0021467208862304688 nb_pixel_total : 67432 time to create 1 rle with old method : 0.07696914672851562 length of segment : 234 time for calcul the mask position with numpy : 0.0013606548309326172 nb_pixel_total : 36382 time to create 1 rle with old method : 0.04168248176574707 length of segment : 286 time for calcul the mask position with numpy : 0.00033354759216308594 nb_pixel_total : 7326 time to create 1 rle with old method : 0.010037899017333984 length of segment : 63 time for calcul the mask position with numpy : 0.0014505386352539062 nb_pixel_total : 55018 time to create 1 rle with old method : 0.0635526180267334 length of segment : 233 time for calcul the mask position with numpy : 0.0030663013458251953 nb_pixel_total : 88085 time to create 1 rle with old method : 0.09951448440551758 length of segment : 271 time for calcul the mask position with numpy : 0.0010013580322265625 nb_pixel_total : 25122 time to create 1 rle with old method : 0.02917337417602539 length of segment : 266 time for calcul the mask position with numpy : 0.000514984130859375 nb_pixel_total : 20377 time to create 1 rle with old method : 0.023738622665405273 length of segment : 155 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 10949 time to create 1 rle with old method : 0.01312708854675293 length of segment : 118 time for calcul the mask position with numpy : 0.0018918514251708984 nb_pixel_total : 84564 time to create 1 rle with old method : 0.0980074405670166 length of segment : 314 time for calcul the mask position with numpy : 0.0004591941833496094 nb_pixel_total : 12254 time to create 1 rle with old method : 0.013960838317871094 length of segment : 154 time for calcul the mask position with numpy : 0.0011615753173828125 nb_pixel_total : 40074 time to create 1 rle with old method : 0.045821189880371094 length of segment : 244 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 11915 time to create 1 rle with old method : 0.013889074325561523 length of segment : 146 time for calcul the mask position with numpy : 0.0005218982696533203 nb_pixel_total : 14127 time to create 1 rle with old method : 0.016875267028808594 length of segment : 85 time for calcul the mask position with numpy : 0.0012149810791015625 nb_pixel_total : 36073 time to create 1 rle with old method : 0.04051637649536133 length of segment : 289 time for calcul the mask position with numpy : 0.003228902816772461 nb_pixel_total : 113406 time to create 1 rle with old method : 0.13300466537475586 length of segment : 289 time for calcul the mask position with numpy : 0.0005459785461425781 nb_pixel_total : 12633 time to create 1 rle with old method : 0.014688968658447266 length of segment : 113 time for calcul the mask position with numpy : 0.0031778812408447266 nb_pixel_total : 46253 time to create 1 rle with old method : 0.05378842353820801 length of segment : 593 time for calcul the mask position with numpy : 0.001046895980834961 nb_pixel_total : 25953 time to create 1 rle with old method : 0.029909372329711914 length of segment : 200 time for calcul the mask position with numpy : 0.0007412433624267578 nb_pixel_total : 16767 time to create 1 rle with old method : 0.01934337615966797 length of segment : 189 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 19167 time to create 1 rle with old method : 0.022495031356811523 length of segment : 135 time for calcul the mask position with numpy : 0.0019998550415039062 nb_pixel_total : 69972 time to create 1 rle with old method : 0.08048486709594727 length of segment : 370 time for calcul the mask position with numpy : 0.00038743019104003906 nb_pixel_total : 11165 time to create 1 rle with old method : 0.013361930847167969 length of segment : 89 time for calcul the mask position with numpy : 0.0007050037384033203 nb_pixel_total : 14884 time to create 1 rle with old method : 0.017329931259155273 length of segment : 195 time for calcul the mask position with numpy : 0.003480195999145508 nb_pixel_total : 112260 time to create 1 rle with old method : 0.1321427822113037 length of segment : 229 time for calcul the mask position with numpy : 0.0016222000122070312 nb_pixel_total : 45476 time to create 1 rle with old method : 0.05134844779968262 length of segment : 494 time for calcul the mask position with numpy : 0.002105712890625 nb_pixel_total : 66783 time to create 1 rle with old method : 0.09241414070129395 length of segment : 424 time for calcul the mask position with numpy : 0.0006060600280761719 nb_pixel_total : 25109 time to create 1 rle with old method : 0.02917337417602539 length of segment : 215 time spent for convertir_results : 11.715355396270752 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 121 chid ids of type : 3594 Number RLEs to save : 34717 save missing photos in datou_result : time spend for datou_step_exec : 72.17371010780334 time spend to save output : 2.044863224029541 total time spend for step 1 : 74.21857333183289 step2:crop_condition Mon May 26 13:41:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 121 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 60 About to insert : list_path_to_insert length 60 new photo from crops ! About to upload 60 photos upload in portfolio : 3736932 init cache_photo without model_param we have 60 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748259721_3831438 we have uploaded 60 photos in the portfolio 3736932 time of upload the photos Elapsed time : 15.617839574813843 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748259742_3831438 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.642805814743042 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3736932 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748259761_3831438 we have uploaded 42 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.052717447280884 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748259773_3831438 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3960483074188232 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361046470, 1361046468, 1361046425, 1361046392, 1361046389, 1361046386, 1361046384, 1361046364, 1361046361, 1361046356, 1361046351] Looping around the photos to save general results len do output : 121 /1361073953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361073999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361074229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046470', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046468', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046425', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046392', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046389', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046386', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046384', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046364', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046361', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046356', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046351', None, None, None, None, None, '2953415') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 374 time used for this insertion : 0.02535724639892578 save_final save missing photos in datou_result : time spend for datou_step_exec : 69.83526229858398 time spend to save output : 0.029698848724365234 total time spend for step 2 : 69.86496114730835 step3:rle_unique_nms_with_priority Mon May 26 13:42:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 121 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 3.141038417816162 time for calcul the mask position with numpy : 0.48197317123413086 nb_pixel_total : 6392510 time to create 1 rle with new method : 0.5462884902954102 time for calcul the mask position with numpy : 0.022266626358032227 nb_pixel_total : 24345 time to create 1 rle with old method : 0.03470635414123535 time for calcul the mask position with numpy : 0.029172420501708984 nb_pixel_total : 27594 time to create 1 rle with old method : 0.03708600997924805 time for calcul the mask position with numpy : 0.025528669357299805 nb_pixel_total : 87361 time to create 1 rle with old method : 0.10818767547607422 time for calcul the mask position with numpy : 0.023736953735351562 nb_pixel_total : 74328 time to create 1 rle with old method : 0.09589076042175293 time for calcul the mask position with numpy : 0.02390122413635254 nb_pixel_total : 70625 time to create 1 rle with old method : 0.0962684154510498 time for calcul the mask position with numpy : 0.0286405086517334 nb_pixel_total : 69086 time to create 1 rle with old method : 0.08374381065368652 time for calcul the mask position with numpy : 0.022832393646240234 nb_pixel_total : 21431 time to create 1 rle with old method : 0.02433466911315918 time for calcul the mask position with numpy : 0.021862506866455078 nb_pixel_total : 4688 time to create 1 rle with old method : 0.005356550216674805 time for calcul the mask position with numpy : 0.021034717559814453 nb_pixel_total : 7335 time to create 1 rle with old method : 0.008211851119995117 time for calcul the mask position with numpy : 0.02765941619873047 nb_pixel_total : 70381 time to create 1 rle with old method : 0.07839369773864746 time for calcul the mask position with numpy : 0.03647661209106445 nb_pixel_total : 79071 time to create 1 rle with old method : 0.09001398086547852 time for calcul the mask position with numpy : 0.025014638900756836 nb_pixel_total : 31079 time to create 1 rle with old method : 0.03530287742614746 time for calcul the mask position with numpy : 0.02325892448425293 nb_pixel_total : 90406 time to create 1 rle with old method : 0.15047287940979004 create new chi : 2.2525885105133057 time to delete rle : 0.027062177658081055 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9064 TO DO : save crop sub photo not yet done ! save time : 0.5788273811340332 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 4.40271520614624 time for calcul the mask position with numpy : 0.3145120143890381 nb_pixel_total : 6396227 time to create 1 rle with new method : 0.4211726188659668 time for calcul the mask position with numpy : 0.027611494064331055 nb_pixel_total : 16548 time to create 1 rle with old method : 0.01865530014038086 time for calcul the mask position with numpy : 0.021547555923461914 nb_pixel_total : 45267 time to create 1 rle with old method : 0.050167083740234375 time for calcul the mask position with numpy : 0.02213764190673828 nb_pixel_total : 79032 time to create 1 rle with old method : 0.08806920051574707 time for calcul the mask position with numpy : 0.02310919761657715 nb_pixel_total : 53340 time to create 1 rle with old method : 0.059139251708984375 time for calcul the mask position with numpy : 0.021948814392089844 nb_pixel_total : 55807 time to create 1 rle with old method : 0.06072187423706055 time for calcul the mask position with numpy : 0.02205514907836914 nb_pixel_total : 20945 time to create 1 rle with old method : 0.023212671279907227 time for calcul the mask position with numpy : 0.023657560348510742 nb_pixel_total : 55239 time to create 1 rle with old method : 0.06155800819396973 time for calcul the mask position with numpy : 0.025180578231811523 nb_pixel_total : 30592 time to create 1 rle with old method : 0.03421521186828613 time for calcul the mask position with numpy : 0.021386384963989258 nb_pixel_total : 32749 time to create 1 rle with old method : 0.037682533264160156 time for calcul the mask position with numpy : 0.021248579025268555 nb_pixel_total : 21378 time to create 1 rle with old method : 0.02443981170654297 time for calcul the mask position with numpy : 0.022788286209106445 nb_pixel_total : 143575 time to create 1 rle with old method : 0.18477416038513184 time for calcul the mask position with numpy : 0.021582603454589844 nb_pixel_total : 28690 time to create 1 rle with old method : 0.031850576400756836 time for calcul the mask position with numpy : 0.021511316299438477 nb_pixel_total : 70851 time to create 1 rle with old method : 0.07834339141845703 create new chi : 1.8228003978729248 time to delete rle : 0.002346038818359375 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9252 TO DO : save crop sub photo not yet done ! save time : 0.5640387535095215 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 4.7336931228637695 time for calcul the mask position with numpy : 0.459841251373291 nb_pixel_total : 6129873 time to create 1 rle with new method : 0.631744384765625 time for calcul the mask position with numpy : 0.021641016006469727 nb_pixel_total : 16014 time to create 1 rle with old method : 0.017510652542114258 time for calcul the mask position with numpy : 0.029081344604492188 nb_pixel_total : 21957 time to create 1 rle with old method : 0.023864269256591797 time for calcul the mask position with numpy : 0.022461414337158203 nb_pixel_total : 42170 time to create 1 rle with old method : 0.0464472770690918 time for calcul the mask position with numpy : 0.02286052703857422 nb_pixel_total : 156621 time to create 1 rle with new method : 0.40208959579467773 time for calcul the mask position with numpy : 0.02065443992614746 nb_pixel_total : 44957 time to create 1 rle with old method : 0.05624842643737793 time for calcul the mask position with numpy : 0.03577828407287598 nb_pixel_total : 50285 time to create 1 rle with old method : 0.05401039123535156 time for calcul the mask position with numpy : 0.03508710861206055 nb_pixel_total : 89830 time to create 1 rle with old method : 0.09842228889465332 time for calcul the mask position with numpy : 0.03618597984313965 nb_pixel_total : 159351 time to create 1 rle with new method : 0.4940056800842285 time for calcul the mask position with numpy : 0.03300046920776367 nb_pixel_total : 45486 time to create 1 rle with old method : 0.05005979537963867 time for calcul the mask position with numpy : 0.022158145904541016 nb_pixel_total : 206905 time to create 1 rle with new method : 0.4728834629058838 time for calcul the mask position with numpy : 0.02111196517944336 nb_pixel_total : 29590 time to create 1 rle with old method : 0.03220653533935547 time for calcul the mask position with numpy : 0.020404577255249023 nb_pixel_total : 18717 time to create 1 rle with old method : 0.021406173706054688 time for calcul the mask position with numpy : 0.024408578872680664 nb_pixel_total : 23967 time to create 1 rle with old method : 0.025649309158325195 time for calcul the mask position with numpy : 0.020791053771972656 nb_pixel_total : 14517 time to create 1 rle with old method : 0.015434741973876953 create new chi : 3.373568534851074 time to delete rle : 0.0032205581665039062 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 12297 TO DO : save crop sub photo not yet done ! save time : 0.7585036754608154 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.64117693901062 time for calcul the mask position with numpy : 0.7975866794586182 nb_pixel_total : 6886897 time to create 1 rle with new method : 0.517960786819458 time for calcul the mask position with numpy : 0.020757198333740234 nb_pixel_total : 13158 time to create 1 rle with old method : 0.014564275741577148 time for calcul the mask position with numpy : 0.020708322525024414 nb_pixel_total : 23907 time to create 1 rle with old method : 0.026613950729370117 time for calcul the mask position with numpy : 0.021798133850097656 nb_pixel_total : 69152 time to create 1 rle with old method : 0.07604837417602539 time for calcul the mask position with numpy : 0.0208437442779541 nb_pixel_total : 20523 time to create 1 rle with old method : 0.022515535354614258 time for calcul the mask position with numpy : 0.02007293701171875 nb_pixel_total : 36603 time to create 1 rle with old method : 0.03957700729370117 create new chi : 1.6381876468658447 time to delete rle : 0.0007293224334716797 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3896 TO DO : save crop sub photo not yet done ! save time : 0.2643733024597168 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 2.959357738494873 time for calcul the mask position with numpy : 0.3874197006225586 nb_pixel_total : 6301461 time to create 1 rle with new method : 1.1176481246948242 time for calcul the mask position with numpy : 0.02158331871032715 nb_pixel_total : 146437 time to create 1 rle with old method : 0.16081666946411133 time for calcul the mask position with numpy : 0.020816326141357422 nb_pixel_total : 551 time to create 1 rle with old method : 0.0008714199066162109 time for calcul the mask position with numpy : 0.02082085609436035 nb_pixel_total : 62643 time to create 1 rle with old method : 0.06864714622497559 time for calcul the mask position with numpy : 0.02094292640686035 nb_pixel_total : 32161 time to create 1 rle with old method : 0.03570723533630371 time for calcul the mask position with numpy : 0.03661990165710449 nb_pixel_total : 177040 time to create 1 rle with new method : 0.8259050846099854 time for calcul the mask position with numpy : 0.03262495994567871 nb_pixel_total : 44114 time to create 1 rle with old method : 0.04922604560852051 time for calcul the mask position with numpy : 0.021296262741088867 nb_pixel_total : 9150 time to create 1 rle with old method : 0.01013946533203125 time for calcul the mask position with numpy : 0.0210268497467041 nb_pixel_total : 15137 time to create 1 rle with old method : 0.01690196990966797 time for calcul the mask position with numpy : 0.0220184326171875 nb_pixel_total : 82549 time to create 1 rle with old method : 0.0896461009979248 time for calcul the mask position with numpy : 0.022622346878051758 nb_pixel_total : 178997 time to create 1 rle with new method : 0.532590389251709 create new chi : 3.6233043670654297 time to delete rle : 0.0013158321380615234 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7951 TO DO : save crop sub photo not yet done ! save time : 0.5131864547729492 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 4.138464450836182 time for calcul the mask position with numpy : 0.7248415946960449 nb_pixel_total : 6415652 time to create 1 rle with new method : 0.5363943576812744 time for calcul the mask position with numpy : 0.03219413757324219 nb_pixel_total : 13331 time to create 1 rle with old method : 0.015433788299560547 time for calcul the mask position with numpy : 0.020992755889892578 nb_pixel_total : 6277 time to create 1 rle with old method : 0.006943464279174805 time for calcul the mask position with numpy : 0.022396326065063477 nb_pixel_total : 11834 time to create 1 rle with old method : 0.012642383575439453 time for calcul the mask position with numpy : 0.021134138107299805 nb_pixel_total : 8869 time to create 1 rle with old method : 0.009900808334350586 time for calcul the mask position with numpy : 0.02088022232055664 nb_pixel_total : 24928 time to create 1 rle with old method : 0.027184009552001953 time for calcul the mask position with numpy : 0.022238492965698242 nb_pixel_total : 17874 time to create 1 rle with old method : 0.019771575927734375 time for calcul the mask position with numpy : 0.022504568099975586 nb_pixel_total : 245965 time to create 1 rle with new method : 0.7697036266326904 time for calcul the mask position with numpy : 0.023046255111694336 nb_pixel_total : 235244 time to create 1 rle with new method : 0.7206137180328369 time for calcul the mask position with numpy : 0.02167534828186035 nb_pixel_total : 18393 time to create 1 rle with old method : 0.020670175552368164 time for calcul the mask position with numpy : 0.022806644439697266 nb_pixel_total : 20821 time to create 1 rle with old method : 0.02356100082397461 time for calcul the mask position with numpy : 0.021899938583374023 nb_pixel_total : 31052 time to create 1 rle with old method : 0.038191795349121094 create new chi : 3.2634661197662354 time to delete rle : 0.0013687610626220703 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 8617 TO DO : save crop sub photo not yet done ! save time : 0.557114839553833 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 4.294350862503052 time for calcul the mask position with numpy : 0.44005799293518066 nb_pixel_total : 5951048 time to create 1 rle with new method : 0.6477141380310059 time for calcul the mask position with numpy : 0.022178173065185547 nb_pixel_total : 10297 time to create 1 rle with old method : 0.011669397354125977 time for calcul the mask position with numpy : 0.022625207901000977 nb_pixel_total : 150155 time to create 1 rle with new method : 0.5469369888305664 time for calcul the mask position with numpy : 0.022144079208374023 nb_pixel_total : 145582 time to create 1 rle with old method : 0.1610262393951416 time for calcul the mask position with numpy : 0.020508766174316406 nb_pixel_total : 45031 time to create 1 rle with old method : 0.05309605598449707 time for calcul the mask position with numpy : 0.022402286529541016 nb_pixel_total : 219797 time to create 1 rle with new method : 0.5820407867431641 time for calcul the mask position with numpy : 0.022871971130371094 nb_pixel_total : 22237 time to create 1 rle with old method : 0.033428192138671875 time for calcul the mask position with numpy : 0.022925615310668945 nb_pixel_total : 922 time to create 1 rle with old method : 0.0018820762634277344 time for calcul the mask position with numpy : 0.023820161819458008 nb_pixel_total : 33623 time to create 1 rle with old method : 0.03663492202758789 time for calcul the mask position with numpy : 0.022752761840820312 nb_pixel_total : 80077 time to create 1 rle with old method : 0.09004664421081543 time for calcul the mask position with numpy : 0.02083563804626465 nb_pixel_total : 56817 time to create 1 rle with old method : 0.06250143051147461 time for calcul the mask position with numpy : 0.022587060928344727 nb_pixel_total : 238816 time to create 1 rle with new method : 0.43556785583496094 time for calcul the mask position with numpy : 0.021100997924804688 nb_pixel_total : 48564 time to create 1 rle with old method : 0.057301998138427734 time for calcul the mask position with numpy : 0.02168416976928711 nb_pixel_total : 47274 time to create 1 rle with old method : 0.053015708923339844 create new chi : 3.614276885986328 time to delete rle : 0.002405881881713867 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++Number RLEs to save : 10816 TO DO : save crop sub photo not yet done ! save time : 0.6520891189575195 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.544577360153198 time for calcul the mask position with numpy : 0.659600019454956 nb_pixel_total : 6628639 time to create 1 rle with new method : 0.738396406173706 time for calcul the mask position with numpy : 0.022419214248657227 nb_pixel_total : 72559 time to create 1 rle with old method : 0.0861501693725586 time for calcul the mask position with numpy : 0.022103309631347656 nb_pixel_total : 18040 time to create 1 rle with old method : 0.02019047737121582 time for calcul the mask position with numpy : 0.022383451461791992 nb_pixel_total : 26455 time to create 1 rle with old method : 0.029564857482910156 time for calcul the mask position with numpy : 0.02347850799560547 nb_pixel_total : 41918 time to create 1 rle with old method : 0.04664945602416992 time for calcul the mask position with numpy : 0.023028850555419922 nb_pixel_total : 11191 time to create 1 rle with old method : 0.012980222702026367 time for calcul the mask position with numpy : 0.022327184677124023 nb_pixel_total : 61023 time to create 1 rle with old method : 0.06794428825378418 time for calcul the mask position with numpy : 0.022895097732543945 nb_pixel_total : 41195 time to create 1 rle with old method : 0.045731306076049805 time for calcul the mask position with numpy : 0.02339339256286621 nb_pixel_total : 30229 time to create 1 rle with old method : 0.0335080623626709 time for calcul the mask position with numpy : 0.02247309684753418 nb_pixel_total : 118991 time to create 1 rle with old method : 0.13168883323669434 create new chi : 2.120481491088867 time to delete rle : 0.0012004375457763672 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 7420 TO DO : save crop sub photo not yet done ! save time : 0.4860653877258301 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 5.615934133529663 time for calcul the mask position with numpy : 0.49642157554626465 nb_pixel_total : 6544971 time to create 1 rle with new method : 0.6455292701721191 time for calcul the mask position with numpy : 0.04576992988586426 nb_pixel_total : 25122 time to create 1 rle with old method : 0.03118729591369629 time for calcul the mask position with numpy : 0.039861440658569336 nb_pixel_total : 88085 time to create 1 rle with old method : 0.10475325584411621 time for calcul the mask position with numpy : 0.0388646125793457 nb_pixel_total : 55018 time to create 1 rle with old method : 0.06276702880859375 time for calcul the mask position with numpy : 0.037487030029296875 nb_pixel_total : 7326 time to create 1 rle with old method : 0.008307456970214844 time for calcul the mask position with numpy : 0.03986334800720215 nb_pixel_total : 36382 time to create 1 rle with old method : 0.04074525833129883 time for calcul the mask position with numpy : 0.0390019416809082 nb_pixel_total : 67432 time to create 1 rle with old method : 0.07627081871032715 time for calcul the mask position with numpy : 0.0382390022277832 nb_pixel_total : 91336 time to create 1 rle with old method : 0.10399436950683594 time for calcul the mask position with numpy : 0.042348623275756836 nb_pixel_total : 14938 time to create 1 rle with old method : 0.020022869110107422 time for calcul the mask position with numpy : 0.026153087615966797 nb_pixel_total : 11767 time to create 1 rle with old method : 0.018955469131469727 time for calcul the mask position with numpy : 0.024268627166748047 nb_pixel_total : 28498 time to create 1 rle with old method : 0.03424406051635742 time for calcul the mask position with numpy : 0.023540735244750977 nb_pixel_total : 22434 time to create 1 rle with old method : 0.025137662887573242 time for calcul the mask position with numpy : 0.02342367172241211 nb_pixel_total : 56931 time to create 1 rle with old method : 0.0637056827545166 create new chi : 2.19797420501709 time to delete rle : 0.0019435882568359375 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7574 TO DO : save crop sub photo not yet done ! save time : 0.49439311027526855 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 4.589746713638306 time for calcul the mask position with numpy : 0.28941869735717773 nb_pixel_total : 6647615 time to create 1 rle with new method : 0.8725018501281738 time for calcul the mask position with numpy : 0.03539276123046875 nb_pixel_total : 46253 time to create 1 rle with old method : 0.05017900466918945 time for calcul the mask position with numpy : 0.03580331802368164 nb_pixel_total : 12633 time to create 1 rle with old method : 0.013872385025024414 time for calcul the mask position with numpy : 0.03576779365539551 nb_pixel_total : 113406 time to create 1 rle with old method : 0.12339401245117188 time for calcul the mask position with numpy : 0.03522086143493652 nb_pixel_total : 36073 time to create 1 rle with old method : 0.03971219062805176 time for calcul the mask position with numpy : 0.03471517562866211 nb_pixel_total : 14127 time to create 1 rle with old method : 0.01552128791809082 time for calcul the mask position with numpy : 0.03303813934326172 nb_pixel_total : 11915 time to create 1 rle with old method : 0.012828826904296875 time for calcul the mask position with numpy : 0.023008346557617188 nb_pixel_total : 40074 time to create 1 rle with old method : 0.04253101348876953 time for calcul the mask position with numpy : 0.020564556121826172 nb_pixel_total : 12254 time to create 1 rle with old method : 0.01305246353149414 time for calcul the mask position with numpy : 0.02132439613342285 nb_pixel_total : 84564 time to create 1 rle with old method : 0.09270572662353516 time for calcul the mask position with numpy : 0.020604372024536133 nb_pixel_total : 10949 time to create 1 rle with old method : 0.011971712112426758 time for calcul the mask position with numpy : 0.020202159881591797 nb_pixel_total : 20377 time to create 1 rle with old method : 0.022946834564208984 create new chi : 1.9544322490692139 time to delete rle : 0.0012524127960205078 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7160 TO DO : save crop sub photo not yet done ! save time : 0.4545152187347412 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 2.955526351928711 time for calcul the mask position with numpy : 0.278043270111084 nb_pixel_total : 6642704 time to create 1 rle with new method : 0.7864446640014648 time for calcul the mask position with numpy : 0.0352787971496582 nb_pixel_total : 25109 time to create 1 rle with old method : 0.028010845184326172 time for calcul the mask position with numpy : 0.021564245223999023 nb_pixel_total : 66783 time to create 1 rle with old method : 0.07453727722167969 time for calcul the mask position with numpy : 0.022653818130493164 nb_pixel_total : 45476 time to create 1 rle with old method : 0.0499262809753418 time for calcul the mask position with numpy : 0.021890640258789062 nb_pixel_total : 112260 time to create 1 rle with old method : 0.12129974365234375 time for calcul the mask position with numpy : 0.021864891052246094 nb_pixel_total : 14884 time to create 1 rle with old method : 0.016391992568969727 time for calcul the mask position with numpy : 0.022279024124145508 nb_pixel_total : 11165 time to create 1 rle with old method : 0.012637138366699219 time for calcul the mask position with numpy : 0.024262666702270508 nb_pixel_total : 69972 time to create 1 rle with old method : 0.07777571678161621 time for calcul the mask position with numpy : 0.021675825119018555 nb_pixel_total : 19167 time to create 1 rle with old method : 0.021424293518066406 time for calcul the mask position with numpy : 0.021459102630615234 nb_pixel_total : 16767 time to create 1 rle with old method : 0.01883530616760254 time for calcul the mask position with numpy : 0.021685123443603516 nb_pixel_total : 25953 time to create 1 rle with old method : 0.028851747512817383 create new chi : 1.7901175022125244 time to delete rle : 0.0011217594146728516 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 7240 TO DO : save crop sub photo not yet done ! save time : 0.5080394744873047 map_output_result : {1361046470: (0.0, 'Should be the crop_list due to order', 0), 1361046468: (0.0, 'Should be the crop_list due to order', 0), 1361046425: (0.0, 'Should be the crop_list due to order', 0), 1361046392: (0.0, 'Should be the crop_list due to order', 0), 1361046389: (0.0, 'Should be the crop_list due to order', 0), 1361046386: (0.0, 'Should be the crop_list due to order', 0), 1361046384: (0.0, 'Should be the crop_list due to order', 0), 1361046364: (0.0, 'Should be the crop_list due to order', 0), 1361046361: (0.0, 'Should be the crop_list due to order', 0), 1361046356: (0.0, 'Should be the crop_list due to order', 0), 1361046351: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361046470, 1361046468, 1361046425, 1361046392, 1361046389, 1361046386, 1361046384, 1361046364, 1361046361, 1361046356, 1361046351] Looping around the photos to save general results len do output : 11 /1361046470.Didn't retrieve data . /1361046468.Didn't retrieve data . /1361046425.Didn't retrieve data . /1361046392.Didn't retrieve data . /1361046389.Didn't retrieve data . /1361046386.Didn't retrieve data . /1361046384.Didn't retrieve data . /1361046364.Didn't retrieve data . /1361046361.Didn't retrieve data . /1361046356.Didn't retrieve data . /1361046351.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046470', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046468', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046425', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046392', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046389', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046386', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046384', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046364', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046361', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046356', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046351', None, None, None, None, None, '2953415') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.013567209243774414 save_final save missing photos in datou_result : time spend for datou_step_exec : 79.82372331619263 time spend to save output : 0.014082193374633789 total time spend for step 3 : 79.83780550956726 step4:ventilate_hashtags_in_portfolio Mon May 26 13:44:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23334483 get user id for portfolio 23334483 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334483 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','papier','pet_fonce','pehd','pet_clair','flou','mal_croppe','carton','metal','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334483 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','papier','pet_fonce','pehd','pet_clair','flou','mal_croppe','carton','metal','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334483 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','papier','pet_fonce','pehd','pet_clair','flou','mal_croppe','carton','metal','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23335993,23335994,23335995,23335996,23335997,23335998,23335999,23336000,23336001,23336002,23336003?tags=background,autre,papier,pet_fonce,pehd,pet_clair,flou,mal_croppe,carton,metal,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361046470, 1361046468, 1361046425, 1361046392, 1361046389, 1361046386, 1361046384, 1361046364, 1361046361, 1361046356, 1361046351] Looping around the photos to save general results len do output : 1 /23334483. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046470', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046468', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046425', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046392', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046389', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046386', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046384', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046364', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046361', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046356', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046351', None, None, None, None, None, '2953415') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014988899230957031 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5655322074890137 time spend to save output : 0.015332221984863281 total time spend for step 4 : 1.580864429473877 step5:final Mon May 26 13:44:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361046470: ('0.08529745731415458',), 1361046468: ('0.08529745731415458',), 1361046425: ('0.08529745731415458',), 1361046392: ('0.08529745731415458',), 1361046389: ('0.08529745731415458',), 1361046386: ('0.08529745731415458',), 1361046384: ('0.08529745731415458',), 1361046364: ('0.08529745731415458',), 1361046361: ('0.08529745731415458',), 1361046356: ('0.08529745731415458',), 1361046351: ('0.08529745731415458',)} new output for save of step final : {1361046470: ('0.08529745731415458',), 1361046468: ('0.08529745731415458',), 1361046425: ('0.08529745731415458',), 1361046392: ('0.08529745731415458',), 1361046389: ('0.08529745731415458',), 1361046386: ('0.08529745731415458',), 1361046384: ('0.08529745731415458',), 1361046364: ('0.08529745731415458',), 1361046361: ('0.08529745731415458',), 1361046356: ('0.08529745731415458',), 1361046351: ('0.08529745731415458',)} [1361046470, 1361046468, 1361046425, 1361046392, 1361046389, 1361046386, 1361046384, 1361046364, 1361046361, 1361046356, 1361046351] Looping around the photos to save general results len do output : 11 /1361046470.Didn't retrieve data . /1361046468.Didn't retrieve data . /1361046425.Didn't retrieve data . /1361046392.Didn't retrieve data . /1361046389.Didn't retrieve data . /1361046386.Didn't retrieve data . /1361046384.Didn't retrieve data . /1361046364.Didn't retrieve data . /1361046361.Didn't retrieve data . /1361046356.Didn't retrieve data . /1361046351.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046470', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046468', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046425', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046392', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046389', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046386', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046384', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046364', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046361', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046356', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046351', None, None, None, None, None, '2953415') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.013532638549804688 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10869455337524414 time spend to save output : 0.014057397842407227 total time spend for step 5 : 0.12275195121765137 step6:blur_detection Mon May 26 13:44:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814.jpg resize: (2160, 3264) 1361046470 -1.8882732021978266 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70.jpg resize: (2160, 3264) 1361046468 1.1391432209971444 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c.jpg resize: (2160, 3264) 1361046425 -2.1879874395934396 treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e.jpg resize: (2160, 3264) 1361046392 0.6564205239017352 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c.jpg resize: (2160, 3264) 1361046389 -2.151751596061381 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be.jpg resize: (2160, 3264) 1361046386 -1.494638806985465 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d.jpg resize: (2160, 3264) 1361046384 -0.8291316916042202 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3.jpg resize: (2160, 3264) 1361046364 0.30482401177650337 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121.jpg resize: (2160, 3264) 1361046361 -3.600207480081884 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a.jpg resize: (2160, 3264) 1361046356 -1.8451563929572838 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8.jpg resize: (2160, 3264) 1361046351 0.011706684766812584 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074960_0.png resize: (412, 322) 1361073953 -1.0664134101591973 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074968_0.png resize: (312, 315) 1361073954 -0.7718235137227211 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074971_0.png resize: (184, 238) 1361073955 -1.2987322102949659 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074972_0.png resize: (154, 232) 1361073956 -0.615693172557304 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074973_0.png resize: (290, 328) 1361073957 1.3559114846858795 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074974_0.png resize: (296, 137) 1361073958 -1.2268280731421466 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074975_0.png resize: (671, 261) 1361073959 -1.5703856113248233 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074976_0.png resize: (118, 316) 1361073960 -0.883555209209864 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074979_0.png resize: (325, 283) 1361073962 -1.5003392492212353 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074980_0.png resize: (229, 118) 1361073963 0.04701633876293351 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074981_0.png resize: (213, 383) 1361073964 -0.5174084195358477 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074983_0.png resize: (386, 323) 1361073966 -0.9656667788068226 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074984_0.png resize: (249, 223) 1361073968 0.3718301648438357 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074985_0.png resize: (181, 117) 1361073969 -0.38946292788712594 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074986_0.png resize: (134, 143) 1361073970 -0.6901252971444639 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074987_0.png resize: (215, 181) 1361073972 -1.4425383274620882 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074988_0.png resize: (267, 156) 1361073973 -1.1019223369218658 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074989_0.png resize: (254, 190) 1361073974 -0.8694896142889237 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074991_0.png resize: (222, 241) 1361073976 -1.4822871332728391 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074994_0.png resize: (400, 240) 1361073977 -1.7446235678805142 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074996_0.png resize: (1083, 379) 1361073978 -0.6670689434175193 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074997_0.png resize: (247, 220) 1361073979 -1.0873198219219407 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074998_0.png resize: (193, 192) 1361073981 -1.2553386159256128 treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075000_0.png resize: (245, 219) 1361073982 -0.6396298216257073 treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075001_0.png resize: (159, 147) 1361073983 0.8667643947749983 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075008_0.png resize: (96, 165) 1361073985 -1.1694155160892399 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075013_0.png resize: (189, 237) 1361073986 -1.4862956956252227 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075014_0.png resize: (371, 624) 1361073987 -0.832440318561988 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075015_0.png resize: (197, 225) 1361073989 -1.3227881737348812 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075016_0.png resize: (145, 186) 1361073990 -1.0154439850852373 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075017_0.png resize: (155, 304) 1361073991 -0.6699264517148686 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075018_0.png resize: (517, 772) 1361073992 -0.48422093075036315 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075020_0.png resize: (138, 204) 1361073994 -1.5159204475513375 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075021_0.png resize: (401, 115) 1361073995 -1.4480535595101847 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075022_0.png resize: (164, 74) 1361073996 -0.433742691612991 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075023_0.png resize: (179, 94) 1361073998 -0.9103524321121633 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075024_0.png resize: (74, 122) 1361073999 -1.0000357753399873 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075027_0.png resize: (344, 191) 1361074000 -1.18838750608289 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075031_0.png resize: (321, 216) 1361074002 -0.7990682292563533 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075032_0.png resize: (423, 279) 1361074003 -1.3610410383375815 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075033_0.png resize: (256, 171) 1361074004 -1.7375566626435384 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075036_0.png resize: (457, 446) 1361074006 -1.2889038746271266 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075037_0.png resize: (442, 640) 1361074007 -2.532505864954798 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075039_0.png resize: (362, 519) 1361074008 -0.5065486998937313 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075043_0.png resize: (211, 428) 1361074010 -1.4703275182293216 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075044_0.png resize: (355, 161) 1361074011 -1.8856973144450582 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075045_0.png resize: (214, 168) 1361074012 -0.5533932257525142 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075049_0.png resize: (220, 155) 1361074013 -0.5906733936421994 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075050_0.png resize: (184, 245) 1361074015 -1.6125410102061755 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075052_0.png resize: (90, 238) 1361074016 -1.190564108950401 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075055_0.png resize: (286, 200) 1361074017 -2.3696882450591232 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075056_0.png resize: (60, 141) 1361074019 0.28197515487092384 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075058_0.png resize: (269, 439) 1361074020 -2.186137441055607 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075059_0.png resize: (258, 125) 1361074021 -3.2205016297545423 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075060_0.png resize: (153, 166) 1361074023 -0.542791929634936 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075064_0.png resize: (242, 240) 1361074024 -1.2861599458692068 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075066_0.png resize: (71, 273) 1361074025 -2.2255582958021876 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075072_0.png resize: (184, 167) 1361074027 -0.6630243474256188 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075078_0.png resize: (480, 157) 1361074028 -2.4547926315451036 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075080_0.png resize: (210, 177) 1361074029 -1.043379486416723 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074962_0.png resize: (265, 486) 1361074085 -0.5531415350980666 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074978_0.png resize: (199, 215) 1361074086 -0.6360650588090303 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074999_0.png resize: (179, 119) 1361074087 0.5214334942208296 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075009_0.png resize: (277, 218) 1361074089 -1.4334988413439427 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075019_0.png resize: (880, 452) 1361074090 -1.5263794878215966 treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075025_0.png resize: (492, 841) 1361074091 -0.42586483599881764 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075026_0.png resize: (134, 520) 1361074092 -1.7239056477739216 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075029_0.png resize: (238, 305) 1361074093 -1.0208171607729752 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075038_0.png resize: (96, 158) 1361074094 -1.2393935214906462 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075040_0.png resize: (180, 265) 1361074095 -0.22269283021043923 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075041_0.png resize: (284, 201) 1361074096 -0.6186555320696198 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075051_0.png resize: (160, 139) 1361074097 -1.0929569811884154 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075061_0.png resize: (118, 157) 1361074098 -1.480909751830971 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075065_0.png resize: (146, 120) 1361074099 -1.5527188129826015 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075076_0.png resize: (184, 135) 1361074100 -1.508308777188182 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074961_0.png resize: (193, 193) 1361074159 -0.5409271230943989 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074963_0.png resize: (359, 242) 1361074161 -2.5841850500581014 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074965_0.png resize: (42, 146) 1361074162 -1.937827013565265 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074966_0.png resize: (249, 135) 1361074164 -1.307153524250473 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074967_0.png resize: (357, 303) 1361074165 -1.4504928887604318 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074969_0.png resize: (213, 515) 1361074166 -1.831186614200379 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074970_0.png resize: (523, 612) 1361074168 -1.7674014997449303 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074977_0.png resize: (100, 420) 1361074169 -0.2109680800979993 treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074982_0.png resize: (215, 336) 1361074170 -0.5119240176620677 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074990_0.png resize: (647, 615) 1361074171 -0.34298845930304345 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074992_0.png resize: (581, 324) 1361074173 -2.3327839841205615 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074993_0.png resize: (269, 461) 1361074174 -0.29125492794434227 treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074995_0.png resize: (183, 351) 1361074175 -3.0994009214717417 treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075002_0.png resize: (201, 452) 1361074177 -0.4459919886381127 treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075003_0.png resize: (117, 256) 1361074178 -2.664270231635149 treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075004_0.png resize: (139, 125) 1361074179 -0.7109859319101997 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075005_0.png resize: (549, 559) 1361074181 -1.5411782730451205 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075006_0.png resize: (392, 292) 1361074182 -1.4973737829222538 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075007_0.png resize: (163, 116) 1361074183 -1.2079565400423338 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075010_0.png resize: (468, 477) 1361074185 -0.9869511842299835 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075011_0.png resize: (184, 262) 1361074186 -1.4546380743625091 treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075012_0.png resize: (255, 359) 1361074187 -1.4765878703218729 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075028_0.png resize: (320, 994) 1361074188 -0.24951961669528408 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075030_0.png resize: (422, 286) 1361074190 -1.3411760761142812 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075034_0.png resize: (566, 507) 1361074191 0.6369682404139699 treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075035_0.png resize: (260, 223) 1361074192 -2.973761566338174 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075042_0.png resize: (271, 497) 1361074194 -1.5820165813950575 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075046_0.png resize: (183, 132) 1361074195 -0.28966863097945805 treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075047_0.png resize: (508, 231) 1361074196 -0.6879084231650305 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075048_0.png resize: (303, 251) 1361074198 -4.407479231736213 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075053_0.png resize: (339, 358) 1361074199 -1.6677405367118299 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075054_0.png resize: (225, 368) 1361074200 -1.0859559126620508 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075062_0.png resize: (311, 326) 1361074202 -0.06643041115316418 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075067_0.png resize: (279, 182) 1361074203 -3.0510170145849664 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075068_0.png resize: (274, 632) 1361074204 -2.01732257539618 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075069_0.png resize: (112, 135) 1361074205 0.4301105281833531 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075070_0.png resize: (453, 332) 1361074207 -1.9939888815739328 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075071_0.png resize: (175, 235) 1361074208 -2.571693468660293 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075073_0.png resize: (135, 172) 1361074209 -0.2677131517951702 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075074_0.png resize: (340, 445) 1361074212 -0.6381391162277743 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075075_0.png resize: (88, 153) 1361074213 -0.14995957024947837 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075079_0.png resize: (358, 232) 1361074214 -0.6967665117313196 treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074964_0.png resize: (88, 100) 1361074226 2.3121202137883854 treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075057_0.png resize: (226, 274) 1361074227 -0.43580448483234746 treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075063_0.png resize: (152, 95) 1361074228 -0.7278816263363898 treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075077_0.png resize: (227, 789) 1361074229 -0.15962960941475443 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 132 time used for this insertion : 0.018858671188354492 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 132 time used for this insertion : 0.031156063079833984 save missing photos in datou_result : time spend for datou_step_exec : 41.52881693840027 time spend to save output : 0.05597209930419922 total time spend for step 6 : 41.58478903770447 step7:brightness Mon May 26 13:44:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814.jpg treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70.jpg treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c.jpg treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e.jpg treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c.jpg treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be.jpg treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d.jpg treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3.jpg treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121.jpg treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a.jpg treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8.jpg treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074960_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074968_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074971_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074972_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074973_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074974_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074975_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074976_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074979_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074980_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074981_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074983_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074984_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074985_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074986_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074987_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074988_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074989_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074991_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074994_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074996_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074997_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074998_0.png treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075000_0.png treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075001_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075008_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075013_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075014_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075015_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075016_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075017_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075018_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075020_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075021_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075022_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075023_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075024_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075027_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075031_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075032_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075033_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075036_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075037_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075039_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075043_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075044_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075045_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075049_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075050_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075052_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075055_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075056_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075058_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075059_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075060_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075064_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075066_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075072_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075078_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075080_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074962_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074978_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074999_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075009_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075019_0.png treat image : temp/1748259628_3831438_1361046386_f2e852e5b83d4010c3ce75fb4b21d4be_rle_crop_3813075025_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075026_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075029_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075038_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075040_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075041_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075051_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075061_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075065_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075076_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074961_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074963_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074965_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074966_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074967_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074969_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074970_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074977_0.png treat image : temp/1748259628_3831438_1361046468_a064b90476e60edbccf25743e661ec70_rle_crop_3813074982_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074990_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074992_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074993_0.png treat image : temp/1748259628_3831438_1361046425_1adeb861ec90946610eabe344d4fed7c_rle_crop_3813074995_0.png treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075002_0.png treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075003_0.png treat image : temp/1748259628_3831438_1361046392_a1c4acde7b694bfd1fd3bc70a51d505e_rle_crop_3813075004_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075005_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075006_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075007_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075010_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075011_0.png treat image : temp/1748259628_3831438_1361046389_2df01c2123a1c83b8464f2b182dad58c_rle_crop_3813075012_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075028_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075030_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075034_0.png treat image : temp/1748259628_3831438_1361046384_861faab852749b10753481cd4993de7d_rle_crop_3813075035_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075042_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075046_0.png treat image : temp/1748259628_3831438_1361046364_b3870b0f8f5da577eb12e5a865e199f3_rle_crop_3813075047_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075048_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075053_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075054_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075062_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075067_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075068_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075069_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075070_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075071_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075073_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075074_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075075_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075079_0.png treat image : temp/1748259628_3831438_1361046470_23f316418762bd414cb2137276726814_rle_crop_3813074964_0.png treat image : temp/1748259628_3831438_1361046361_652108b27a7b410c21106873a3e6c121_rle_crop_3813075057_0.png treat image : temp/1748259628_3831438_1361046356_4c2a49872d6244d607dfd0fbe21d3d4a_rle_crop_3813075063_0.png treat image : temp/1748259628_3831438_1361046351_c990952031120d24f0fcfdfb0dd911a8_rle_crop_3813075077_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 132 time used for this insertion : 0.019368410110473633 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 132 time used for this insertion : 0.030266523361206055 save missing photos in datou_result : time spend for datou_step_exec : 12.02516770362854 time spend to save output : 0.05588269233703613 total time spend for step 7 : 12.081050395965576 step8:velours_tree Mon May 26 13:45:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10713624954223633 time spend to save output : 5.364418029785156e-05 total time spend for step 8 : 0.10718989372253418 step9:send_mail_cod Mon May 26 13:45:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23334483_26-05-2025_13_45_09.pdf 23335993 imagette233359931748259909 23335994 change filename to text .change filename to text .change filename to text .change filename to text .imagette233359941748259909 23335995 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233359951748259910 23335996 imagette233359961748259911 23335997 imagette233359971748259911 23335998 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233359981748259911 23335999 imagette233359991748259913 23336000 imagette233360001748259913 23336001 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233360011748259913 23336002 imagette233360021748259914 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23334483 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23335993,23335994,23335995,23335996,23335997,23335998,23335999,23336000,23336001,23336002,23336003?tags=background,autre,papier,pet_fonce,pehd,pet_clair,flou,mal_croppe,carton,metal,environnement args[1361046470] : ((1361046470, -1.8882732021978266, 492688767), (1361046470, 0.3170602892558599, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046468] : ((1361046468, 1.1391432209971444, 492688767), (1361046468, -0.003542702439909578, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046425] : ((1361046425, -2.1879874395934396, 492609224), (1361046425, 0.42970798909290525, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046392] : ((1361046392, 0.6564205239017352, 492688767), (1361046392, 0.04746011731916061, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046389] : ((1361046389, -2.151751596061381, 492609224), (1361046389, 0.5644858048511215, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046386] : ((1361046386, -1.494638806985465, 492688767), (1361046386, 0.0074566810155175045, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046384] : ((1361046384, -0.8291316916042202, 492688767), (1361046384, -0.0972075549173117, 496442774), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046364] : ((1361046364, 0.30482401177650337, 492688767), (1361046364, 0.24103984873890427, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046361] : ((1361046361, -3.600207480081884, 492609224), (1361046361, 0.1401365491190724, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046356] : ((1361046356, -1.8451563929572838, 492688767), (1361046356, -0.0372349265093038, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com args[1361046351] : ((1361046351, 0.011706684766812584, 492688767), (1361046351, 0.23623774940634798, 2107752395), '0.08529745731415458') We are sending mail with results at report@fotonower.com refus_total : 0.08529745731415458 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23334483 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334483_26-05-2025_13_45_09.pdf results_Auto_P23334483_26-05-2025_13_45_09.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334483_26-05-2025_13_45_09.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23334483','results_Auto_P23334483_26-05-2025_13_45_09.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334483_26-05-2025_13_45_09.pdf','pdf','','0.69','0.08529745731415458') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23334483

https://www.fotonower.com/image?json=false&list_photos_id=1361046470
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046468
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1391432209971444)
https://www.fotonower.com/image?json=false&list_photos_id=1361046425
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046392
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046389
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046386
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046384
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046364
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046361
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046356
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361046351
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.53%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/23335994?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23335995?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23335998?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23336001?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334483_26-05-2025_13_45_09.pdf.

Lien vers velours :https://www.fotonower.com/velours/23335993,23335994,23335995,23335996,23335997,23335998,23335999,23336000,23336001,23336002,23336003?tags=background,autre,papier,pet_fonce,pehd,pet_clair,flou,mal_croppe,carton,metal,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 11:45:17 GMT Content-Length: 0 Connection: close X-Message-Id: wjTtx9neQ2SoNZGar-IaFA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361046470, 1361046468, 1361046425, 1361046392, 1361046389, 1361046386, 1361046384, 1361046364, 1361046361, 1361046356, 1361046351] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046470', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046468', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046425', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046392', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046389', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046386', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046384', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046364', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046361', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046356', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046351', None, None, None, None, None, '2953415') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013498783111572266 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.212945222854614 time spend to save output : 0.013739585876464844 total time spend for step 9 : 7.226684808731079 step10:split_time_score Mon May 26 13:45:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26052025 23334483 Nombre de photos uploadées : 11 / 23040 (0%) 26052025 23334483 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 26052025 23334483 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0040857791900634766 elapsed_time : insert_dashboard_record_day_entry 0.0242767333984375 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334478 order by id desc limit 1 Qualite : 0.08529745731415458 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334483_26-05-2025_13_45_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334483 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334483 AND mptpi.`type`=3594 To do Qualite : 0.10314590041490454 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334484_26-05-2025_13_39_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334484 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334484 AND mptpi.`type`=3594 To do Qualite : 0.1298923511823711 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334517_26-05-2025_13_24_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334517 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334517 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361046470, 1361046468, 1361046425, 1361046392, 1361046389, 1361046386, 1361046384, 1361046364, 1361046361, 1361046356, 1361046351] Looping around the photos to save general results len do output : 1 /23334483Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046470', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046468', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046425', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046392', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046389', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046386', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046384', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046364', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046361', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046356', None, None, None, None, None, '2953415') ('3318', None, None, None, None, None, None, None, '2953415') ('3318', '23334483', '1361046351', None, None, None, None, None, '2953415') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.013522624969482422 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.2089745998382568 time spend to save output : 0.013812780380249023 total time spend for step 10 : 1.2227873802185059 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 131.94user 120.10system 4:53.27elapsed 85%CPU (0avgtext+0avgdata 4649220maxresident)k 538280inputs+79808outputs (1832major+11986439minor)pagefaults 0swaps